-- Logs begin at Thu 2022-09-01 13:07:10 UTC, end at Thu 2022-09-01 14:30:03 UTC. -- Sep 01 13:43:48.368424 dv-cinder-852211-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 13:43:48.377053 dv-cinder-852211-7-smb devstack@keystone.service[81688]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 13:43:48.379077 dv-cinder-852211-7-smb devstack@keystone.service[81688]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 13:43:48 2022] *** Sep 01 13:43:48.379077 dv-cinder-852211-7-smb devstack@keystone.service[81688]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 13:43:48.379077 dv-cinder-852211-7-smb devstack@keystone.service[81688]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 13:43:48.379077 dv-cinder-852211-7-smb devstack@keystone.service[81688]: nodename: dv-cinder-852211-7-smb Sep 01 13:43:48.379077 dv-cinder-852211-7-smb devstack@keystone.service[81688]: machine: x86_64 Sep 01 13:43:48.379077 dv-cinder-852211-7-smb devstack@keystone.service[81688]: clock source: unix Sep 01 13:43:48.379077 dv-cinder-852211-7-smb devstack@keystone.service[81688]: pcre jit disabled Sep 01 13:43:48.379077 dv-cinder-852211-7-smb devstack@keystone.service[81688]: detected number of CPU cores: 4 Sep 01 13:43:48.379077 dv-cinder-852211-7-smb devstack@keystone.service[81688]: current working directory: / Sep 01 13:43:48.379077 dv-cinder-852211-7-smb devstack@keystone.service[81688]: detected binary path: /usr/bin/uwsgi-core Sep 01 13:43:48.379077 dv-cinder-852211-7-smb devstack@keystone.service[81688]: your processes number limit is 47680 Sep 01 13:43:48.379683 dv-cinder-852211-7-smb devstack@keystone.service[81688]: your memory page size is 4096 bytes Sep 01 13:43:48.379683 dv-cinder-852211-7-smb devstack@keystone.service[81688]: detected max file descriptor number: 2048 Sep 01 13:43:48.379683 dv-cinder-852211-7-smb devstack@keystone.service[81688]: lock engine: pthread robust mutexes Sep 01 13:43:48.379683 dv-cinder-852211-7-smb devstack@keystone.service[81688]: thunder lock: enabled Sep 01 13:43:48.379683 dv-cinder-852211-7-smb devstack@keystone.service[81688]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 13:43:48.379683 dv-cinder-852211-7-smb devstack@keystone.service[81688]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 13:43:48.418652 dv-cinder-852211-7-smb devstack@keystone.service[81688]: Python main interpreter initialized at 0x564f431649c0 Sep 01 13:43:48.418652 dv-cinder-852211-7-smb devstack@keystone.service[81688]: python threads support enabled Sep 01 13:43:48.418652 dv-cinder-852211-7-smb devstack@keystone.service[81688]: your server socket listen backlog is limited to 100 connections Sep 01 13:43:48.418652 dv-cinder-852211-7-smb devstack@keystone.service[81688]: your mercy for graceful operations on workers is 90 seconds Sep 01 13:43:48.418977 dv-cinder-852211-7-smb devstack@keystone.service[81688]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 13:43:48.419053 dv-cinder-852211-7-smb devstack@keystone.service[81688]: *** Operational MODE: preforking *** Sep 01 13:43:48.419369 dv-cinder-852211-7-smb devstack@keystone.service[81688]: *** uWSGI is running in multiple interpreter mode *** Sep 01 13:43:48.419369 dv-cinder-852211-7-smb devstack@keystone.service[81688]: spawned uWSGI master process (pid: 81688) Sep 01 13:43:48.419522 dv-cinder-852211-7-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 01 13:43:48.420495 dv-cinder-852211-7-smb devstack@keystone.service[81688]: spawned uWSGI worker 1 (pid: 81699, cores: 1) Sep 01 13:43:48.420495 dv-cinder-852211-7-smb devstack@keystone.service[81688]: spawned uWSGI worker 2 (pid: 81700, cores: 1) Sep 01 13:43:48.421907 dv-cinder-852211-7-smb devstack@keystone.service[81688]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 13:43:52.763838 dv-cinder-852211-7-smb devstack@keystone.service[81699]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:43:52.763838 dv-cinder-852211-7-smb devstack@keystone.service[81699]: from cryptography.utils import int_from_bytes Sep 01 13:43:52.764630 dv-cinder-852211-7-smb devstack@keystone.service[81699]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:43:52.764630 dv-cinder-852211-7-smb devstack@keystone.service[81699]: from cryptography.utils import int_from_bytes Sep 01 13:43:52.765403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:43:52.765403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: from cryptography.utils import int_from_bytes Sep 01 13:43:52.765876 dv-cinder-852211-7-smb devstack@keystone.service[81700]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:43:52.765876 dv-cinder-852211-7-smb devstack@keystone.service[81700]: from cryptography.utils import int_from_bytes Sep 01 13:43:52.815410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 13:43:52.815613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 13:43:52.815797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] command line args: [] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 13:43:52.815964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 13:43:52.816077 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 13:43:52.816155 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 13:43:52.816262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ================================================================================ {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 13:43:52.816351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] command line args: [] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 13:43:52.816512 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] admin_token = **** {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.816603 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 13:43:52.816758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] config_dir = [] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.816839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ================================================================================ {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 13:43:52.816970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.817072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] admin_token = **** {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.817157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] config_source = [] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.817261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] config_dir = [] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.817350 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] debug = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.817497 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.817596 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.817819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] config_source = [] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.817819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] debug = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.817944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.818009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.818079 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.818312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.818401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.818463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.818526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.818684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.818778 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] list_limit = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.818922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] log_config_append = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.819008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.819076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.819136 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] list_limit = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.819199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] log_dir = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.819354 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] log_config_append = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.819444 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] log_file = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.819512 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.819576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.819636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] log_dir = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.819820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] log_file = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.819931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.820089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.820223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.820677 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.820802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.820802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.820952 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.821038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.821118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.821199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.821277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.821277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.821424 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.821503 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.821572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.821641 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.821712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.821860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.821959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.822099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.822194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.822332 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.822500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.822613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.822766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.822876 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.823014 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.823125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.823303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.823472 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.823660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] publish_errors = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.823797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.828809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.828902 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] publish_errors = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.828970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.828970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829086 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] standard_threads = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] use_journal = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] use_json = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] use_stderr = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829774 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] use_syslog = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829897 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.829964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.830032 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.830091 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] standard_threads = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.830157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.830225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.830290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.830355 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.830419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.830477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.830610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.830672 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] use_journal = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.830672 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] use_json = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.830782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.830841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] use_stderr = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.830918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.830988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] use_syslog = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.831048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.831105 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:43:52.831162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.831219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.831282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.831349 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.831349 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.831454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.831511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.831574 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.831632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.831697 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.831761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.831821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.831907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.831971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832098 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832165 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832846 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832923 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.832982 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.833038 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.833102 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.833656 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.833723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.833781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.833845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.833845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.833949 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.834081 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.834143 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.834207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.834266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.834323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.834380 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.834448 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.834513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.834572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.834629 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.834774 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.834857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.835014 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.835085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.835289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.835363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.835526 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.835643 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.835751 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.835925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.836035 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.836137 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.836288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.836368 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.836524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.836604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.836759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.836837 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.837010 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.837090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.837249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.837328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.837479 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.837558 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.837716 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.837810 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.837949 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.838027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.838181 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.838295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.838418 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.838531 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.838636 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.838739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.838868 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.838982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.839081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.839209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.839320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.839402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.839558 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.839647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.839794 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.839899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.840052 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.840190 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.840291 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.840372 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.840526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.840603 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.840762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.840849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.840992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.841072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.841243 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.841325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.841518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.841608 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.841758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.841841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.841990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.842081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.842250 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.842343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.842487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.842567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.842717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.842798 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.842948 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.843041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.843182 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.843262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.843425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.843515 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.843668 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.843758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.843926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.844011 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.844171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.844255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.844407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.844496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.844662 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.844749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.844867 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.844946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.845103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.845263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.845346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.845418 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.845560 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.845641 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.845804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.845892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.846040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.846119 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.846285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.846364 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.846520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.846613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.846755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.846836 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.846987 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.847073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.847222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.847314 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.847456 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.847544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.847701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.847781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.847964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.848046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.848212 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.848295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.848450 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.848529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.848684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.848764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.849460 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.849550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.849704 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.849786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.849940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.850020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.850175 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.850257 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.850405 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.850491 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.850633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.850713 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.850862 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.850945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.851095 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.851175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.851325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.851411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.851567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.851649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.851802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.851903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.852073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.852153 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.852312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.852420 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.852548 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.852644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.852782 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.852934 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.853050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.853181 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.853286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.853415 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] auth.external = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.853531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.853650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.853774 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.853951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.854032 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.854188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.854283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.854423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] auth.password = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.854504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.854661 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] auth.token = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.854750 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.854903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.854984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.855142 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.855222 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] auth.external = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.855391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.855480 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.855624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.855713 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.855963 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.856050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.856124 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.856214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] auth.password = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.856358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.856441 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] auth.token = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.856594 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] credential.caching = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.856674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.856841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.856932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.857091 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.857174 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.857326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.857406 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.857570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.857658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.857817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.857897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.858092 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.858254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.858342 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] credential.caching = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.858418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.858533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.858614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.858786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.858867 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.859040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.859122 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.859288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.859378 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.859537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.859618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.859786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.859881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.860037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.860120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.860295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.860388 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.860530 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] federation.caching = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.860611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.860766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.860854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.861012 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.861097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.861258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.861341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.861487 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.861568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.861732 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.861812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.861970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.862052 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.862223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.862303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] federation.caching = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.862459 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.862540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.862713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.862811 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.862950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.863031 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.863184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.863264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.863423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity.caching = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.863504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.863666 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.863752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.863931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.864015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.864171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.864253 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.864458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.864540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.864703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.864784 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.864957 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.865064 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.865189 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity.caching = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.865267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.865439 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.865521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.865688 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.865769 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.865921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.866001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.866152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.866232 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.866381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.866463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.866622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.866702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.866864 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.866945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.867107 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.867188 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.867360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.867439 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.867599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.867709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.867836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.868097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.868249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.874610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.874610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.874822 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.874903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.874903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.875037 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.875110 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.875191 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.875273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.875273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.875407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.875480 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.875480 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.875616 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.875699 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.875773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.875846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.875945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.876020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.876092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.876176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.876253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.876325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.876397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.876469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.876613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.876710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.876787 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.876860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.876931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.877054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.877133 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.877215 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.877291 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.877363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.877435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.877507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.877579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.877659 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.877734 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.877807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.877879 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.877951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.878023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.878103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.878179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.878251 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.878324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.878396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.878467 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.878547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.878623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.878695 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.878767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.878839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.878911 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.878991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.879072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.879147 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.879226 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.879301 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.879377 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.879458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.879534 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.879606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.879678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.879750 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.879821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.879928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.880006 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.880101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.880174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.880246 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.880317 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.880402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.880478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.880551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.880623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.881675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.881768 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.881849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.882845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.883510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.883601 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.883678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.883753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.883839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.883938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.884013 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.884341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.884417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.884489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.884967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.885064 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.885140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.885213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.885285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.885347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.885437 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.885514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.885586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.885659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.885731 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.885924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.886022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.886100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.886173 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.886245 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.886317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.887293 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.887388 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.887465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.887539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.887613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.887685 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.887768 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.887844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.887994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.888087 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.888164 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.888225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.888363 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.888440 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.888502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.888561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.888621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.888679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.888747 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.888809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.888868 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.888975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.889057 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.889119 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.889188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.889251 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.889310 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.889369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.889428 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.889487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.889554 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.889622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.889684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.889743 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.889812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] resource.caching = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.889929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.890079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.890215 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] resource.caching = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.890339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.890339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.890468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.890528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.890597 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.890659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.890727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.890788 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.890846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.890909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.890977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.891051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.891123 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.891195 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.891266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.891337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] role.caching = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.891412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.891485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] role.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.891557 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.891628 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.891699 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] role.caching = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.891770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.891850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] role.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.892004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.892078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.892150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.892222 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.892340 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.892474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.892555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.892555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.892743 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.892804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.892863 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.892933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.892995 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.893055 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.893118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.893118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.893232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.893300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.893300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.893408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.893467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.893525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.894552 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.895199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.895291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.895291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.895429 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.895429 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.895571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.895571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.896241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.896241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.896366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.896426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.896998 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.897090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.897155 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.897224 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.897297 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.897358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.897428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.897502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.897564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.897624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.897691 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.897886 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.897973 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.898050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.898112 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.898171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.898237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.899183 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.899291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.899367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.899443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.899505 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.899572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.899644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.899714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.899788 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.899850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900071 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900131 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] token.caching = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900329 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] token.caching = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900387 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900446 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900694 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900872 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.900940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901002 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901375 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901495 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901612 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901741 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901858 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.901976 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.902048 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.902120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.902182 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.902249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.902319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.902381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.connection = **** {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.902442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.902502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.902569 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.connection = **** {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.902631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.902692 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.902751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.902810 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.902870 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.903003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.903069 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.903129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.903189 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.903249 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.903309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.903384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.903448 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.903509 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.903569 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.903732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.903806 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.904003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.904089 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.904245 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.904329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.904491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.904573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.904725 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.904823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.904988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.905137 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.905273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.905411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.905555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.905693 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.905824 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.905913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.905913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 13:43:52.906023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.906126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:43:52.906316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81700) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 13:43:52.938101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:52.938330 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:52.938561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:52.938651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:52.938876 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:52.939104 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:52.947238 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:52.948380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:52.983343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:52.983614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:52.983704 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:52.983892 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.045918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.047309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.098244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.098474 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.100090 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.100490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.262907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.263148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.263367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.263585 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.263802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.264040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.265373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.265611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.265839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.266067 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.266285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.266504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.288537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.288692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.288766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.288830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.288976 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.289064 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.289197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.289362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.289658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.289809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.289935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.290019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.290019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.290144 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.301839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.302896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.321999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.322175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.322271 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.322349 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.322449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.322530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.322636 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.322724 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.322854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.322949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.323069 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.323200 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.323284 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81700) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.323394 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81699) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 13:43:53.340423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.340632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 13:43:53.340981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.341076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.341186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 13:43:53.341260 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 13:43:53.341468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.341736 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.341819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.341992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 13:43:53.342074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.342254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.342343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.342546 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.342811 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.343072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.353235 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.353522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.353800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.353887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.354090 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.354176 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.354500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.354785 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.361094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.362268 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.364000 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.364289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.366787 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.366787 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.366787 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.367040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.367103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.367174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.367239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.367300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.367361 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.367421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.367482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.367550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.367613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.367673 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.367733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.367794 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.367794 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.368112 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.368391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.368664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.391109 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.392620 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.392720 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.392908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.394204 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.394488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.397473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.397759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.398045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.399364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.399643 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.399954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.405365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.405659 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.406948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.407457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.409631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.409930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.410220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.410581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.410868 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.411837 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.412149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.412433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.412823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.413102 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.413401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.413482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.413671 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.413777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.413948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.414071 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.430216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.430580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.432240 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.432533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.437226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.438660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.441931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.446994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.447101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.447175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.447239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.449782 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.451334 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.452907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.453222 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.453546 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.453777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.454062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.454452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.454880 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.457980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.459000 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.459290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.459578 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.459878 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.460163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.470987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.471281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.471555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.471828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.477015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.477305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.477574 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.477840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.479996 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.481681 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.483235 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.483518 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.485492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.486179 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.486473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.486769 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.487059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.487353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.487438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.490012 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.490410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.494756 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.495039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.495333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.495669 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.496032 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.498772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.499061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.499352 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.499639 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.499952 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.500237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.500539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.507366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.507641 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.507951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.508237 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.508520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.508810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.509367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.517109 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.520171 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.523649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.525125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.526496 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.526612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.526907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.527204 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.529567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.532580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.534143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.534278 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.535668 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.535822 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.535975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.536282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.539269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.539579 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.539885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.540193 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.543391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.545028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.548044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.548345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.548638 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.548921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.549005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.549255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.549551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.556544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81700) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.556779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.557075 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.557356 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.557440 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.557633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.557718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.557923 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.558047 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.558204 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.558487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.558772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.559052 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.559333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.559602 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.559905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.560179 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81700) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.564954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81699) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 13:43:53.565239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.565529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.565803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.566076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.566356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.566633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.566957 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.567339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.567646 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.567955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.568221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.568486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.568774 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81699) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 13:43:53.595859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564f431649c0 pid: 81700 (default app) Sep 01 13:43:53.600058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689bef8-68bc-4c90-9b8f-cc38950ae173 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:43:53.600352 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689bef8-68bc-4c90-9b8f-cc38950ae173 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:43:53.600627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689bef8-68bc-4c90-9b8f-cc38950ae173 None None] PATH_INFO: `/v3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:43:53.604794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Thu Sep 1 13:43:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:43:53.605652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564f431649c0 pid: 81699 (default app) Sep 01 13:44:01.771993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648704c4-a990-497a-8c8d-cdb03c5880da None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:01.772575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648704c4-a990-497a-8c8d-cdb03c5880da None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:01.772575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648704c4-a990-497a-8c8d-cdb03c5880da None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:01.773885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:44:01.781156 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f3081-7e2c-4813-8dd9-75683fd31fba None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:01.781698 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f3081-7e2c-4813-8dd9-75683fd31fba None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:01.781698 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f3081-7e2c-4813-8dd9-75683fd31fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:01.852139 dv-cinder-852211-7-smb devstack@keystone.service[81699]: INFO dbcounter [None req-e88f3081-7e2c-4813-8dd9-75683fd31fba None None] Registered counter for database keystone Sep 01 13:44:01.872924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG oslo_db.sqlalchemy.engines [None req-e88f3081-7e2c-4813-8dd9-75683fd31fba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:44:01.879250 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writer thread running {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:44:02.077743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG passlib.handlers.bcrypt [None req-e88f3081-7e2c-4813-8dd9-75683fd31fba None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81699) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 13:44:02.078137 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG passlib.handlers.bcrypt [None req-e88f3081-7e2c-4813-8dd9-75683fd31fba None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81699) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 13:44:02.136180 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e88f3081-7e2c-4813-8dd9-75683fd31fba None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:02.137809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e88f3081-7e2c-4813-8dd9-75683fd31fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:02.270220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1/3] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 13:44:02.716479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648704c4-a990-497a-8c8d-cdb03c5880da None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:02.785909 dv-cinder-852211-7-smb devstack@keystone.service[81700]: INFO dbcounter [None req-648704c4-a990-497a-8c8d-cdb03c5880da None None] Registered counter for database keystone Sep 01 13:44:02.805773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG oslo_db.sqlalchemy.engines [None req-648704c4-a990-497a-8c8d-cdb03c5880da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81700) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:44:02.812121 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writer thread running {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:44:02.935167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648704c4-a990-497a-8c8d-cdb03c5880da None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:02.939509 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4ca7e-8e2e-4fcd-8c5f-8682de791d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:02.940160 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4ca7e-8e2e-4fcd-8c5f-8682de791d0a admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:02.940453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4ca7e-8e2e-4fcd-8c5f-8682de791d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:02.940731 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4ca7e-8e2e-4fcd-8c5f-8682de791d0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:02.949361 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4ca7e-8e2e-4fcd-8c5f-8682de791d0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:03.000757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: WARNING keystone.common.rbac_enforcer.enforcer [None req-efc4ca7e-8e2e-4fcd-8c5f-8682de791d0a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 13:44:03.000993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4ca7e-8e2e-4fcd-8c5f-8682de791d0a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:03.011608 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 3/4] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Sep 1 13:44:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 13:44:03.019083 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f3081-7e2c-4813-8dd9-75683fd31fba None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:03.035275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f3081-7e2c-4813-8dd9-75683fd31fba None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:03.040928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7847b16-3493-4eae-807c-33f0e3ac9806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:03.042055 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7847b16-3493-4eae-807c-33f0e3ac9806 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:03.042343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7847b16-3493-4eae-807c-33f0e3ac9806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:03.042625 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7847b16-3493-4eae-807c-33f0e3ac9806 admin admin] PATH_INFO: `/v3/projects/0fc2f50aab224fc68a4db65bf6dd738c` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:03.044099 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7847b16-3493-4eae-807c-33f0e3ac9806 admin admin] RBAC: Authorizing `identity:get_project(project_id=0fc2f50aab224fc68a4db65bf6dd738c)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:03.097622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c7847b16-3493-4eae-807c-33f0e3ac9806 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 13:44:03.097967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7847b16-3493-4eae-807c-33f0e3ac9806 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:03.103192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 2/5] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Sep 1 13:44:03 2022] GET /identity/v3/projects/0fc2f50aab224fc68a4db65bf6dd738c => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:04.982283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed745a-190b-4dc7-99ac-bbed2ccda82b None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:04.982801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed745a-190b-4dc7-99ac-bbed2ccda82b None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:04.982885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed745a-190b-4dc7-99ac-bbed2ccda82b None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:04.986996 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 4/6] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:44:04.992970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbd9c7-ea44-414f-912e-fc5a6faf661c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:04.993389 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbd9c7-ea44-414f-912e-fc5a6faf661c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:04.993523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbd9c7-ea44-414f-912e-fc5a6faf661c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:05.014054 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6fbbd9c7-ea44-414f-912e-fc5a6faf661c None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:05.015615 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6fbbd9c7-ea44-414f-912e-fc5a6faf661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:05.023349 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 3/7] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 13:44:05.293202 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed745a-190b-4dc7-99ac-bbed2ccda82b None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:05.305309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed745a-190b-4dc7-99ac-bbed2ccda82b None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:05.309442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3825e-280b-4290-8e5e-3912b88df3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:05.310048 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3825e-280b-4290-8e5e-3912b88df3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:05.310328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3825e-280b-4290-8e5e-3912b88df3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:05.310598 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3825e-280b-4290-8e5e-3912b88df3a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:05.318631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3825e-280b-4290-8e5e-3912b88df3a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:05.320485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3825e-280b-4290-8e5e-3912b88df3a6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:05.329054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 5/8] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Sep 1 13:44:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 13:44:05.334862 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbd9c7-ea44-414f-912e-fc5a6faf661c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:05.343852 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbd9c7-ea44-414f-912e-fc5a6faf661c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:05.348266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a57e56-3546-41f1-9da4-f233c406277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:05.348922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a57e56-3546-41f1-9da4-f233c406277b admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:05.349206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a57e56-3546-41f1-9da4-f233c406277b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:05.349480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a57e56-3546-41f1-9da4-f233c406277b admin admin] PATH_INFO: `/v3/users/ff4c484fb0f14c218e0baa6d6c4c76d5` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:05.350853 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a57e56-3546-41f1-9da4-f233c406277b admin admin] RBAC: Authorizing `identity:get_user(user_id=ff4c484fb0f14c218e0baa6d6c4c76d5)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:05.352709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a57e56-3546-41f1-9da4-f233c406277b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:05.354218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 4/9] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Sep 1 13:44:05 2022] GET /identity/v3/users/ff4c484fb0f14c218e0baa6d6c4c76d5 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:07.355310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b34a6-10d0-48e3-9095-14b68047f822 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:07.355847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b34a6-10d0-48e3-9095-14b68047f822 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:07.355847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b34a6-10d0-48e3-9095-14b68047f822 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:07.357237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:07.362377 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d9778-6fc2-441c-a9a3-0f43c340b556 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:07.362815 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d9778-6fc2-441c-a9a3-0f43c340b556 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:07.362993 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d9778-6fc2-441c-a9a3-0f43c340b556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:07.381433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-2d5d9778-6fc2-441c-a9a3-0f43c340b556 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:07.382605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2d5d9778-6fc2-441c-a9a3-0f43c340b556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:07.396235 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb5f5-7aed-4997-9023-3837f2753a9f None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:07.396528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb5f5-7aed-4997-9023-3837f2753a9f None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:07.396808 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb5f5-7aed-4997-9023-3837f2753a9f None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:07.398122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 7/11] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:07.403067 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343c7c6-ce89-4c44-8149-c0ab8a6a3e98 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:07.403354 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343c7c6-ce89-4c44-8149-c0ab8a6a3e98 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:07.403634 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343c7c6-ce89-4c44-8149-c0ab8a6a3e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:07.446305 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG passlib.handlers.bcrypt [None req-f343c7c6-ce89-4c44-8149-c0ab8a6a3e98 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81700) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 13:44:07.446610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG passlib.handlers.bcrypt [None req-f343c7c6-ce89-4c44-8149-c0ab8a6a3e98 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81700) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 13:44:07.463726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 5/12] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:07.495494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-f343c7c6-ce89-4c44-8149-c0ab8a6a3e98 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:07.497128 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f343c7c6-ce89-4c44-8149-c0ab8a6a3e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:07.595499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 8/13] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:44:07.728608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d9778-6fc2-441c-a9a3-0f43c340b556 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:07.752620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:07.832433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d9778-6fc2-441c-a9a3-0f43c340b556 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:07.865272 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343c7c6-ce89-4c44-8149-c0ab8a6a3e98 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:07.866241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ed9d7-0a26-46e0-a415-d3a460d8c8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:07.866863 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ed9d7-0a26-46e0-a415-d3a460d8c8af None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:07.867149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ed9d7-0a26-46e0-a415-d3a460d8c8af None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:07.867626 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ed9d7-0a26-46e0-a415-d3a460d8c8af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:07.936968 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ed9d7-0a26-46e0-a415-d3a460d8c8af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:07.938443 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ed9d7-0a26-46e0-a415-d3a460d8c8af None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:07.961753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:07.966291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343c7c6-ce89-4c44-8149-c0ab8a6a3e98 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:07.968587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:08.010573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4da057-780c-4785-8137-08cac763ff7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:08.011612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4da057-780c-4785-8137-08cac763ff7e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:08.011944 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4da057-780c-4785-8137-08cac763ff7e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:08.012211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4da057-780c-4785-8137-08cac763ff7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:08.030100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4da057-780c-4785-8137-08cac763ff7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-eb4da057-780c-4785-8137-08cac763ff7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:08.039797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:08.040922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:08.042261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:08.042261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:08.042261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:08.042261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:08.042261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:08.042261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:08.042261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:08.042261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:08.042261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:08.042261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:08.042261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:08.042261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:08.042261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 9/14] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:44:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:44:08.046793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4da057-780c-4785-8137-08cac763ff7e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:08.055850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 6/15] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 13:44:08.061375 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ed9d7-0a26-46e0-a415-d3a460d8c8af None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:08.149181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4da057-780c-4785-8137-08cac763ff7e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:08.163606 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ed9d7-0a26-46e0-a415-d3a460d8c8af None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:08.183371 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efd5bd-d635-4990-97d9-f0803809cf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:08.184019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efd5bd-d635-4990-97d9-f0803809cf90 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:08.184304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efd5bd-d635-4990-97d9-f0803809cf90 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:08.184586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efd5bd-d635-4990-97d9-f0803809cf90 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:08.185257 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efd5bd-d635-4990-97d9-f0803809cf90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:08.185566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efd5bd-d635-4990-97d9-f0803809cf90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:08.186218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:08.187008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efd5bd-d635-4990-97d9-f0803809cf90 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:08.198218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fe832-a089-4c7b-bff3-deab83e35912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:08.198861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe832-a089-4c7b-bff3-deab83e35912 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:08.199148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe832-a089-4c7b-bff3-deab83e35912 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:08.199283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 10/16] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:08.199430 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fe832-a089-4c7b-bff3-deab83e35912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:08.204809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efd5bd-d635-4990-97d9-f0803809cf90 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:08.210824 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fe832-a089-4c7b-bff3-deab83e35912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:08.212331 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fe832-a089-4c7b-bff3-deab83e35912 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-cb8fe832-a089-4c7b-bff3-deab83e35912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:44:08.231536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:08.232499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:44:08.233330 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:44:08.233330 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:44:08.233330 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:08.233500 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:08.233587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 7/17] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:44:08.238979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fe832-a089-4c7b-bff3-deab83e35912 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:08.318303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efd5bd-d635-4990-97d9-f0803809cf90 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:08.338264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fe832-a089-4c7b-bff3-deab83e35912 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:08.352913 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b56b66-4ba5-4340-b2eb-9b9f9def241d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:08.353550 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b56b66-4ba5-4340-b2eb-9b9f9def241d None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:08.353836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b56b66-4ba5-4340-b2eb-9b9f9def241d None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:08.354114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b56b66-4ba5-4340-b2eb-9b9f9def241d None admin] PATH_INFO: `/v3/users/ff4c484fb0f14c218e0baa6d6c4c76d5` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:08.355593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b56b66-4ba5-4340-b2eb-9b9f9def241d None admin] RBAC: Authorizing `identity:get_user(user_id=ff4c484fb0f14c218e0baa6d6c4c76d5)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:08.357089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b56b66-4ba5-4340-b2eb-9b9f9def241d None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:08.358698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 11/18] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:08 2022] GET /identity/v3/users/ff4c484fb0f14c218e0baa6d6c4c76d5 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:08.364574 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b56b66-4ba5-4340-b2eb-9b9f9def241d None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:08.371711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6d4f4-98df-4e11-a464-0147b8be80f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:08.372369 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6d4f4-98df-4e11-a464-0147b8be80f0 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:08.372658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6d4f4-98df-4e11-a464-0147b8be80f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:08.372939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6d4f4-98df-4e11-a464-0147b8be80f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:08.373590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6d4f4-98df-4e11-a464-0147b8be80f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:08.373898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6d4f4-98df-4e11-a464-0147b8be80f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:08.375297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6d4f4-98df-4e11-a464-0147b8be80f0 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:08.394316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 8/19] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:08.465152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:08.471771 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b56b66-4ba5-4340-b2eb-9b9f9def241d None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:08.509637 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05134750-60d2-41ee-b521-2b107a5cd749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:08.510286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05134750-60d2-41ee-b521-2b107a5cd749 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:08.510571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05134750-60d2-41ee-b521-2b107a5cd749 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:08.510847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05134750-60d2-41ee-b521-2b107a5cd749 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:08.512046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05134750-60d2-41ee-b521-2b107a5cd749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:08.513524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05134750-60d2-41ee-b521-2b107a5cd749 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:08.515116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 12/20] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:08.521914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6d4f4-98df-4e11-a464-0147b8be80f0 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:08.558529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:08.628630 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6d4f4-98df-4e11-a464-0147b8be80f0 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:08.664480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13db0b5-e6af-4a75-b102-ca9dbfece349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:08.665106 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13db0b5-e6af-4a75-b102-ca9dbfece349 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:08.665386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13db0b5-e6af-4a75-b102-ca9dbfece349 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:08.665661 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13db0b5-e6af-4a75-b102-ca9dbfece349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:08.666388 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13db0b5-e6af-4a75-b102-ca9dbfece349 None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.domain.id=default, user.id=ff4c484fb0f14c218e0baa6d6c4c76d5) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:08.666699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13db0b5-e6af-4a75-b102-ca9dbfece349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:08.668244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13db0b5-e6af-4a75-b102-ca9dbfece349 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:08.675900 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 9/21] 10.222.0.64 () {56 vars in 1322 bytes} [Thu Sep 1 13:44:08 2022] GET /identity/v3/role_assignments?user.id=ff4c484fb0f14c218e0baa6d6c4c76d5&scope.domain.id=default&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:10.750535 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94efda-3999-48ba-864c-395f484419af None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:10.751206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94efda-3999-48ba-864c-395f484419af None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:10.751206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94efda-3999-48ba-864c-395f484419af None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:10.752454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 13/22] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:10.762756 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772baf6-0621-47b9-85ce-a576f9670ab6 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:10.763234 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772baf6-0621-47b9-85ce-a576f9670ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:10.763326 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772baf6-0621-47b9-85ce-a576f9670ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:10.801401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-7772baf6-0621-47b9-85ce-a576f9670ab6 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:10.803706 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7772baf6-0621-47b9-85ce-a576f9670ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:10.896712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 10/23] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:10.911754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9c672-3198-4ee8-8ce8-f7a3c2a66d54 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:10.912085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9c672-3198-4ee8-8ce8-f7a3c2a66d54 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:10.912374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9c672-3198-4ee8-8ce8-f7a3c2a66d54 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:10.913703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 14/24] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:10.919117 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13240357-cacc-4adf-b4a3-087766661290 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:10.919622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13240357-cacc-4adf-b4a3-087766661290 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:10.920118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13240357-cacc-4adf-b4a3-087766661290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:10.941477 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-13240357-cacc-4adf-b4a3-087766661290 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:10.943520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-13240357-cacc-4adf-b4a3-087766661290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:10.975780 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:11.025356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 11/25] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:11.258291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9c672-3198-4ee8-8ce8-f7a3c2a66d54 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:11.390625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9c672-3198-4ee8-8ce8-f7a3c2a66d54 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:11.432415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa632b-78e3-4f0a-aaf6-2637d46535b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:11.433383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa632b-78e3-4f0a-aaf6-2637d46535b7 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:11.433883 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa632b-78e3-4f0a-aaf6-2637d46535b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:11.434358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa632b-78e3-4f0a-aaf6-2637d46535b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:11.435225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa632b-78e3-4f0a-aaf6-2637d46535b7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:11.436932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa632b-78e3-4f0a-aaf6-2637d46535b7 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:11.468469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb71ca2-9fd5-4efa-8e81-7c5e1e3c6433 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:11.468752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb71ca2-9fd5-4efa-8e81-7c5e1e3c6433 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:11.469188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb71ca2-9fd5-4efa-8e81-7c5e1e3c6433 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:11.470723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 12/26] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:44:11.484806 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f8612-57cc-4f04-89dc-cc48068366b5 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:11.485252 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f8612-57cc-4f04-89dc-cc48068366b5 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:11.485670 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f8612-57cc-4f04-89dc-cc48068366b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:11.510940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-750f8612-57cc-4f04-89dc-cc48068366b5 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:11.512220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-750f8612-57cc-4f04-89dc-cc48068366b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:11.592016 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 13/27] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:44:11.593453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd91e3d-a13e-4092-82b4-1a43ff8370be None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:11.593751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd91e3d-a13e-4092-82b4-1a43ff8370be None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:11.594089 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd91e3d-a13e-4092-82b4-1a43ff8370be None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:11.595676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 14/28] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:11.596589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd91e3d-a13e-4092-82b4-1a43ff8370be None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:11.715985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 15/29] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Sep 1 13:44:11 2022] POST /identity/v3/roles => generated 219 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:44:11.715985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecd2ee-16bc-4bb6-a27f-754049086734 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:11.715985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecd2ee-16bc-4bb6-a27f-754049086734 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:11.715985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecd2ee-16bc-4bb6-a27f-754049086734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:11.757162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:11.757381 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-e9ecd2ee-16bc-4bb6-a27f-754049086734 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:11.759898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e9ecd2ee-16bc-4bb6-a27f-754049086734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:11.797162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd91e3d-a13e-4092-82b4-1a43ff8370be None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:11.815389 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:11.892153 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ece8d-31e3-4b63-9406-41295a6e986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:11.892816 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ece8d-31e3-4b63-9406-41295a6e986b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:11.893095 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ece8d-31e3-4b63-9406-41295a6e986b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:11.893372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ece8d-31e3-4b63-9406-41295a6e986b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:11.920756 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ece8d-31e3-4b63-9406-41295a6e986b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:11.922267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ece8d-31e3-4b63-9406-41295a6e986b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:11.946149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 16/30] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-801ece8d-31e3-4b63-9406-41295a6e986b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:44:11.951524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:11.952400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:44:11.953209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:44:11.953209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:44:11.953209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:11.953209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 15/31] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:11.959379 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecd2ee-16bc-4bb6-a27f-754049086734 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:11.990202 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ece8d-31e3-4b63-9406-41295a6e986b None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:12.120763 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecd2ee-16bc-4bb6-a27f-754049086734 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:12.170286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be361000-eae3-46dd-8597-a56418b66bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:12.171264 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be361000-eae3-46dd-8597-a56418b66bbe None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:12.173346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be361000-eae3-46dd-8597-a56418b66bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:12.173839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be361000-eae3-46dd-8597-a56418b66bbe None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:12.175478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be361000-eae3-46dd-8597-a56418b66bbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:12.176214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be361000-eae3-46dd-8597-a56418b66bbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:12.178873 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be361000-eae3-46dd-8597-a56418b66bbe None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:12.222067 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 17/32] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:12.222067 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741479bf-2175-4ee2-acf2-411088595239 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:12.222302 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741479bf-2175-4ee2-acf2-411088595239 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:12.222886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741479bf-2175-4ee2-acf2-411088595239 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:12.224810 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 18/33] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:12.229801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741479bf-2175-4ee2-acf2-411088595239 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:12.236687 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ece8d-31e3-4b63-9406-41295a6e986b None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:12.247857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:12.275395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe46140-0607-4841-9bc3-102155d24e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:12.276096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46140-0607-4841-9bc3-102155d24e22 None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:12.276385 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46140-0607-4841-9bc3-102155d24e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:12.276661 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46140-0607-4841-9bc3-102155d24e22 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:12.277438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe46140-0607-4841-9bc3-102155d24e22 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:12.278886 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe46140-0607-4841-9bc3-102155d24e22 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:12.336925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741479bf-2175-4ee2-acf2-411088595239 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:12.370110 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951c65a-2c88-4678-ab3d-071e4857c32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:12.370718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951c65a-2c88-4678-ab3d-071e4857c32b None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:12.371007 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951c65a-2c88-4678-ab3d-071e4857c32b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:12.371274 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951c65a-2c88-4678-ab3d-071e4857c32b None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:12.371941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951c65a-2c88-4678-ab3d-071e4857c32b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:12.373392 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951c65a-2c88-4678-ab3d-071e4857c32b None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:12.392777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:12.503990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 19/34] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 13:44:12 2022] POST /identity/v3/projects => generated 301 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:44:12.503990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b5f8d-f983-4f6f-9808-2ae845f032ee None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:12.503990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b5f8d-f983-4f6f-9808-2ae845f032ee None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:12.503990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b5f8d-f983-4f6f-9808-2ae845f032ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:12.510493 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 16/35] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Sep 1 13:44:11 2022] POST /identity/v3/roles => generated 225 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:44:12.512083 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc764da1-498d-4635-a81c-6e7e4057e8c6 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:12.512381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc764da1-498d-4635-a81c-6e7e4057e8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:12.512665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc764da1-498d-4635-a81c-6e7e4057e8c6 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:12.513277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-d67b5f8d-f983-4f6f-9808-2ae845f032ee None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:12.514022 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 17/36] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:12.516071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc764da1-498d-4635-a81c-6e7e4057e8c6 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:12.517119 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d67b5f8d-f983-4f6f-9808-2ae845f032ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:12.602037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:12.612225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 20/37] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:12.613581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8d1f0-b478-4005-98a5-1338ddcf9fa2 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:12.613878 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8d1f0-b478-4005-98a5-1338ddcf9fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:12.614231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8d1f0-b478-4005-98a5-1338ddcf9fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:12.635944 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-30e8d1f0-b478-4005-98a5-1338ddcf9fa2 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:12.637301 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-30e8d1f0-b478-4005-98a5-1338ddcf9fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:12.676354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc764da1-498d-4635-a81c-6e7e4057e8c6 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:12.728499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 21/38] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:12.729218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf290792-91b3-4a75-958d-5ed491155af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:12.730064 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf290792-91b3-4a75-958d-5ed491155af7 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:12.730432 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf290792-91b3-4a75-958d-5ed491155af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:12.730773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf290792-91b3-4a75-958d-5ed491155af7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:12.745296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf290792-91b3-4a75-958d-5ed491155af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-cf290792-91b3-4a75-958d-5ed491155af7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:12.751413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:12.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:12.753070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:12.753070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:12.753070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:12.753070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:12.753070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:12.753070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:12.753070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:12.753070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:12.753070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:12.753070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:12.753070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:12.753070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:12.753070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 18/39] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:12.759668 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8d1f0-b478-4005-98a5-1338ddcf9fa2 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:12.863089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8d1f0-b478-4005-98a5-1338ddcf9fa2 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:12.886975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:12.898501 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e333f6-8a29-4dd9-842b-85e57667da91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:12.899590 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e333f6-8a29-4dd9-842b-85e57667da91 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:12.899590 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e333f6-8a29-4dd9-842b-85e57667da91 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:12.899756 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e333f6-8a29-4dd9-842b-85e57667da91 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:12.900352 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e333f6-8a29-4dd9-842b-85e57667da91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:12.900664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e333f6-8a29-4dd9-842b-85e57667da91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:12.901260 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf290792-91b3-4a75-958d-5ed491155af7 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:12.902065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e333f6-8a29-4dd9-842b-85e57667da91 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:12.912244 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 22/40] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:12.917504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e333f6-8a29-4dd9-842b-85e57667da91 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:12.965928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:13.008233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf290792-91b3-4a75-958d-5ed491155af7 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:13.026638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e333f6-8a29-4dd9-842b-85e57667da91 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:13.043516 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d60bc-f49b-4e6c-ba65-fd117f59912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:13.044168 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d60bc-f49b-4e6c-ba65-fd117f59912b None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:13.044457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d60bc-f49b-4e6c-ba65-fd117f59912b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:13.044732 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d60bc-f49b-4e6c-ba65-fd117f59912b None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:13.045407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d60bc-f49b-4e6c-ba65-fd117f59912b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:13.046937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d60bc-f49b-4e6c-ba65-fd117f59912b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:13.060984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c5d50-6d56-4082-8e90-8ed05f6f19d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:13.061627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c5d50-6d56-4082-8e90-8ed05f6f19d7 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:13.065423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c5d50-6d56-4082-8e90-8ed05f6f19d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:13.065423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c5d50-6d56-4082-8e90-8ed05f6f19d7 None admin] PATH_INFO: `/v3/users/ff4c484fb0f14c218e0baa6d6c4c76d5` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:13.065423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c5d50-6d56-4082-8e90-8ed05f6f19d7 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4c484fb0f14c218e0baa6d6c4c76d5)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:13.065423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c5d50-6d56-4082-8e90-8ed05f6f19d7 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:13.066468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 23/41] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:12 2022] GET /identity/v3/users/ff4c484fb0f14c218e0baa6d6c4c76d5 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:13.067354 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c5d50-6d56-4082-8e90-8ed05f6f19d7 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:13.122113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:13.134284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 19/42] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Sep 1 13:44:12 2022] POST /identity/v3/roles => generated 223 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:44:13.136604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d60bc-f49b-4e6c-ba65-fd117f59912b None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:13.190922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c5d50-6d56-4082-8e90-8ed05f6f19d7 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:13.230902 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe94b6a-4ebc-4e68-826c-894cdfa65c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:13.231554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe94b6a-4ebc-4e68-826c-894cdfa65c86 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:13.231847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe94b6a-4ebc-4e68-826c-894cdfa65c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:13.232164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe94b6a-4ebc-4e68-826c-894cdfa65c86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:13.233324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe94b6a-4ebc-4e68-826c-894cdfa65c86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:13.239635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe94b6a-4ebc-4e68-826c-894cdfa65c86 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:13.239635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 24/43] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:13.242678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe94b6a-4ebc-4e68-826c-894cdfa65c86 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:13.266590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d60bc-f49b-4e6c-ba65-fd117f59912b None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:13.292096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:13.308609 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c040b1-92da-4927-915d-75c01e28f03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:13.309267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c040b1-92da-4927-915d-75c01e28f03d None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:13.309553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c040b1-92da-4927-915d-75c01e28f03d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:13.309836 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c040b1-92da-4927-915d-75c01e28f03d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:13.311070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c040b1-92da-4927-915d-75c01e28f03d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:13.312582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c040b1-92da-4927-915d-75c01e28f03d None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:13.314933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 20/44] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:13.321074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c040b1-92da-4927-915d-75c01e28f03d None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:13.360976 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe94b6a-4ebc-4e68-826c-894cdfa65c86 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:13.385939 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:13.397008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61af48-d2ac-4e32-a429-1ff3e7d6766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:13.397473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61af48-d2ac-4e32-a429-1ff3e7d6766f None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:13.397759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61af48-d2ac-4e32-a429-1ff3e7d6766f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:13.398037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61af48-d2ac-4e32-a429-1ff3e7d6766f None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:13.398694 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61af48-d2ac-4e32-a429-1ff3e7d6766f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:13.400185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61af48-d2ac-4e32-a429-1ff3e7d6766f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:13.481232 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 25/45] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 13:44:13 2022] POST /identity/v3/projects => generated 312 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:44:13.553586 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c040b1-92da-4927-915d-75c01e28f03d None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:13.589525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffa1c2-c477-43f3-a75f-fa178ad67bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:13.590230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffa1c2-c477-43f3-a75f-fa178ad67bbc None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:13.590519 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffa1c2-c477-43f3-a75f-fa178ad67bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:13.590803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffa1c2-c477-43f3-a75f-fa178ad67bbc None admin] PATH_INFO: `/v3/domains/default/users/ff4c484fb0f14c218e0baa6d6c4c76d5/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:13.592862 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffa1c2-c477-43f3-a75f-fa178ad67bbc None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ff4c484fb0f14c218e0baa6d6c4c76d5, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:13.594375 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffa1c2-c477-43f3-a75f-fa178ad67bbc None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:13.682377 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 21/46] 10.222.0.64 () {58 vars in 1361 bytes} [Thu Sep 1 13:44:13 2022] PUT /identity/v3/domains/default/users/ff4c484fb0f14c218e0baa6d6c4c76d5/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:44:15.393520 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6f465-e168-41e2-847a-973b7425ccdf None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:15.394029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6f465-e168-41e2-847a-973b7425ccdf None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:15.394111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6f465-e168-41e2-847a-973b7425ccdf None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:15.395434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 26/47] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:15.400670 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a3bc5-029e-4e56-807e-80debed24a1b None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:15.401078 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a3bc5-029e-4e56-807e-80debed24a1b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:15.401230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a3bc5-029e-4e56-807e-80debed24a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:15.419313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-d39a3bc5-029e-4e56-807e-80debed24a1b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:15.420814 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d39a3bc5-029e-4e56-807e-80debed24a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:15.464466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:15.486579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 22/48] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:15.545098 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d25d3-8ac7-42e9-a370-f7a66a469b34 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:15.545390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d25d3-8ac7-42e9-a370-f7a66a469b34 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:15.545674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d25d3-8ac7-42e9-a370-f7a66a469b34 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:15.547042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 27/49] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:15.552589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089daa75-bdbd-45ac-999f-699f7ad9be17 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:15.552977 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089daa75-bdbd-45ac-999f-699f7ad9be17 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:15.553170 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089daa75-bdbd-45ac-999f-699f7ad9be17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:15.572865 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-089daa75-bdbd-45ac-999f-699f7ad9be17 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:15.574114 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-089daa75-bdbd-45ac-999f-699f7ad9be17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:15.640030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 23/50] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:15.754498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d25d3-8ac7-42e9-a370-f7a66a469b34 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:15.854633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d25d3-8ac7-42e9-a370-f7a66a469b34 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:15.888001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e3152-87e2-44d4-b55b-e5ee587bba52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:15.888639 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e3152-87e2-44d4-b55b-e5ee587bba52 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:15.888927 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e3152-87e2-44d4-b55b-e5ee587bba52 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:15.889208 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e3152-87e2-44d4-b55b-e5ee587bba52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:15.890325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e3152-87e2-44d4-b55b-e5ee587bba52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:15.891768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e3152-87e2-44d4-b55b-e5ee587bba52 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:15.893353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 28/51] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:15.899519 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089daa75-bdbd-45ac-999f-699f7ad9be17 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:15.914457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e3152-87e2-44d4-b55b-e5ee587bba52 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:15.957228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:15.999689 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089daa75-bdbd-45ac-999f-699f7ad9be17 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:16.009750 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:16.018553 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e3152-87e2-44d4-b55b-e5ee587bba52 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:16.040297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e9917-40ec-40b6-8b20-80a32f1b5f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:16.040917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e9917-40ec-40b6-8b20-80a32f1b5f00 None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:16.041203 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e9917-40ec-40b6-8b20-80a32f1b5f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:16.041482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e9917-40ec-40b6-8b20-80a32f1b5f00 None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:16.042143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e9917-40ec-40b6-8b20-80a32f1b5f00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:16.043604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e9917-40ec-40b6-8b20-80a32f1b5f00 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:16.048104 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b04b76-502a-4d10-a7b0-e48d88a5a993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:16.048743 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b04b76-502a-4d10-a7b0-e48d88a5a993 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:16.049027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b04b76-502a-4d10-a7b0-e48d88a5a993 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:16.049303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b04b76-502a-4d10-a7b0-e48d88a5a993 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:16.064290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b04b76-502a-4d10-a7b0-e48d88a5a993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-d4b04b76-502a-4d10-a7b0-e48d88a5a993 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:16.069805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:16.078247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:16.079018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:16.079018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:16.079018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:16.079018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:16.079018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:16.079018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:16.079018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:16.079018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:16.079018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:16.079018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:16.079018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:16.079018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:16.079018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 29/52] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:44:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:44:16.079018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b04b76-502a-4d10-a7b0-e48d88a5a993 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:16.143219 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 24/53] 10.222.0.64 () {60 vars in 1140 bytes} [Thu Sep 1 13:44:15 2022] POST /identity/v3/projects => generated 298 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:44:16.183373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b04b76-502a-4d10-a7b0-e48d88a5a993 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:16.185086 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:16.220658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38312755-2841-4a91-9ff8-62df6e8a470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:16.221333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38312755-2841-4a91-9ff8-62df6e8a470d None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:16.221930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38312755-2841-4a91-9ff8-62df6e8a470d None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:16.222444 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38312755-2841-4a91-9ff8-62df6e8a470d None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:16.223420 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38312755-2841-4a91-9ff8-62df6e8a470d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:16.223735 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38312755-2841-4a91-9ff8-62df6e8a470d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:16.225211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38312755-2841-4a91-9ff8-62df6e8a470d None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:16.234293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 30/54] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:16.240591 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e9917-40ec-40b6-8b20-80a32f1b5f00 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:16.347027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e9917-40ec-40b6-8b20-80a32f1b5f00 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:16.382147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed369c5-a37b-40ed-bd66-2643416ad762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:16.382791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed369c5-a37b-40ed-bd66-2643416ad762 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:16.383075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed369c5-a37b-40ed-bd66-2643416ad762 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:16.383352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed369c5-a37b-40ed-bd66-2643416ad762 None admin] PATH_INFO: `/v3/users/ff4c484fb0f14c218e0baa6d6c4c76d5` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:16.384796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed369c5-a37b-40ed-bd66-2643416ad762 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4c484fb0f14c218e0baa6d6c4c76d5)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:16.386241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed369c5-a37b-40ed-bd66-2643416ad762 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:16.387816 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 25/55] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:16 2022] GET /identity/v3/users/ff4c484fb0f14c218e0baa6d6c4c76d5 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:16.393646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38312755-2841-4a91-9ff8-62df6e8a470d None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:16.600727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38312755-2841-4a91-9ff8-62df6e8a470d None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:16.634959 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6113bf6-fe99-45c5-8198-c6e0aeef86e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:16.635600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6113bf6-fe99-45c5-8198-c6e0aeef86e7 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:16.635919 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6113bf6-fe99-45c5-8198-c6e0aeef86e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:16.636207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6113bf6-fe99-45c5-8198-c6e0aeef86e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:16.637323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6113bf6-fe99-45c5-8198-c6e0aeef86e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:16.638778 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6113bf6-fe99-45c5-8198-c6e0aeef86e7 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:16.640546 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 31/56] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:16.646098 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed369c5-a37b-40ed-bd66-2643416ad762 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:16.674842 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:16.747459 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed369c5-a37b-40ed-bd66-2643416ad762 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:16.782574 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb1d92-b130-49ed-97ba-6c9ae605e50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:16.783185 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1d92-b130-49ed-97ba-6c9ae605e50c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:16.783471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1d92-b130-49ed-97ba-6c9ae605e50c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:16.783747 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1d92-b130-49ed-97ba-6c9ae605e50c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:16.784509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb1d92-b130-49ed-97ba-6c9ae605e50c None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.domain.id=default, user.id=ff4c484fb0f14c218e0baa6d6c4c76d5) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:16.784824 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb1d92-b130-49ed-97ba-6c9ae605e50c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:16.786838 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb1d92-b130-49ed-97ba-6c9ae605e50c None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:16.792547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 26/57] 10.222.0.64 () {56 vars in 1322 bytes} [Thu Sep 1 13:44:16 2022] GET /identity/v3/role_assignments?user.id=ff4c484fb0f14c218e0baa6d6c4c76d5&scope.domain.id=default&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:18.078383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66706e47-1c76-467a-bbcb-bf2ac34df5f7 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:18.078889 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66706e47-1c76-467a-bbcb-bf2ac34df5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:18.078973 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66706e47-1c76-467a-bbcb-bf2ac34df5f7 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:18.080333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 32/58] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:18.086184 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9700628-a17a-4574-aa35-3ffd8a43d8fe None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:18.086651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9700628-a17a-4574-aa35-3ffd8a43d8fe None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:18.086735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9700628-a17a-4574-aa35-3ffd8a43d8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:18.104529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-a9700628-a17a-4574-aa35-3ffd8a43d8fe None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:18.105713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a9700628-a17a-4574-aa35-3ffd8a43d8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:18.171074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 27/59] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:18.444894 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66706e47-1c76-467a-bbcb-bf2ac34df5f7 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:18.476571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:18.544731 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66706e47-1c76-467a-bbcb-bf2ac34df5f7 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:18.577782 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73556e-5b6f-4054-a3c8-44b1891be3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:18.695312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73556e-5b6f-4054-a3c8-44b1891be3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:18.695312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73556e-5b6f-4054-a3c8-44b1891be3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:18.695312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73556e-5b6f-4054-a3c8-44b1891be3e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:18.695312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73556e-5b6f-4054-a3c8-44b1891be3e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:18.695312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73556e-5b6f-4054-a3c8-44b1891be3e2 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:18.695312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 33/60] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:18.695839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9700628-a17a-4574-aa35-3ffd8a43d8fe None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:18.695839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:18.695839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9700628-a17a-4574-aa35-3ffd8a43d8fe None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:18.726974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6011569-481c-42cf-8134-30f160c0ef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:18.727588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6011569-481c-42cf-8134-30f160c0ef7a None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:18.727885 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6011569-481c-42cf-8134-30f160c0ef7a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:18.728179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6011569-481c-42cf-8134-30f160c0ef7a None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:18.728828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6011569-481c-42cf-8134-30f160c0ef7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:18.730276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6011569-481c-42cf-8134-30f160c0ef7a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:18.818740 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 28/61] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:44:18 2022] POST /identity/v3/users => generated 275 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:44:21.704808 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82aeec-4b41-4cac-a983-04dad63724cd None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:21.705910 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82aeec-4b41-4cac-a983-04dad63724cd None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:21.706417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82aeec-4b41-4cac-a983-04dad63724cd None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:21.708108 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 34/62] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:21.713239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e235f32-c364-4329-8f52-5fce8931fdec None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:21.714052 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e235f32-c364-4329-8f52-5fce8931fdec None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:21.714539 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e235f32-c364-4329-8f52-5fce8931fdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:21.740906 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-8e235f32-c364-4329-8f52-5fce8931fdec None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:21.742453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-8e235f32-c364-4329-8f52-5fce8931fdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:21.832488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 29/63] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:21.931480 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338705f-bb00-4b23-ae2b-fb54c54306b1 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:21.932166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338705f-bb00-4b23-ae2b-fb54c54306b1 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:21.932684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338705f-bb00-4b23-ae2b-fb54c54306b1 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:21.934513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 35/64] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:21.939811 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae8d90-6331-4207-927d-9ea9206e788e None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:21.940137 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae8d90-6331-4207-927d-9ea9206e788e None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:21.940423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae8d90-6331-4207-927d-9ea9206e788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:21.974627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-74ae8d90-6331-4207-927d-9ea9206e788e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:21.976940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-74ae8d90-6331-4207-927d-9ea9206e788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:21.979335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:22.058023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 30/65] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:22.221025 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338705f-bb00-4b23-ae2b-fb54c54306b1 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:22.258214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1f202-884b-4208-b1e7-4f3beac7ee52 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:22.258442 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1f202-884b-4208-b1e7-4f3beac7ee52 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:22.258782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1f202-884b-4208-b1e7-4f3beac7ee52 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:22.260347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 31/66] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:44:22.266130 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf5b4f-2f14-4b0c-a3a7-6632715dea92 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:22.266698 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf5b4f-2f14-4b0c-a3a7-6632715dea92 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:22.267189 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf5b4f-2f14-4b0c-a3a7-6632715dea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:22.298469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-9ccf5b4f-2f14-4b0c-a3a7-6632715dea92 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:22.301344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-9ccf5b4f-2f14-4b0c-a3a7-6632715dea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:22.376251 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:22.380585 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338705f-bb00-4b23-ae2b-fb54c54306b1 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:22.403647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 32/67] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:22.405341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb299dc-d58e-47ec-bc9e-6ecf7330ede2 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:22.405849 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb299dc-d58e-47ec-bc9e-6ecf7330ede2 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:22.406327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb299dc-d58e-47ec-bc9e-6ecf7330ede2 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:22.408435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 33/68] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:22.416034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb299dc-d58e-47ec-bc9e-6ecf7330ede2 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:22.419772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f1736-5cfd-43ee-a9f6-ef59bc6be86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:22.420462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f1736-5cfd-43ee-a9f6-ef59bc6be86d None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:22.420750 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f1736-5cfd-43ee-a9f6-ef59bc6be86d None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:22.421038 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f1736-5cfd-43ee-a9f6-ef59bc6be86d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:22.433453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f1736-5cfd-43ee-a9f6-ef59bc6be86d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-511f1736-5cfd-43ee-a9f6-ef59bc6be86d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:22.439635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:22.440631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:22.441442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:22.441442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:22.441442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:22.441442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:22.441442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:22.441442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:22.441442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:22.441442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:22.441442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:22.441442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:22.441442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:22.441442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:22.441442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 36/69] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:22.443112 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5a418-b9dd-4e8f-9d8d-3343cc07218d None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:22.443221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5a418-b9dd-4e8f-9d8d-3343cc07218d None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:22.443517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5a418-b9dd-4e8f-9d8d-3343cc07218d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:22.465211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-8ae5a418-b9dd-4e8f-9d8d-3343cc07218d None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:22.466882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-8ae5a418-b9dd-4e8f-9d8d-3343cc07218d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:22.495210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:22.531895 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb299dc-d58e-47ec-bc9e-6ecf7330ede2 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:22.542115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 37/70] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:22.543166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5a418-b9dd-4e8f-9d8d-3343cc07218d None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:22.571177 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d6e4b-f7a4-4230-9053-d555b9caa1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:22.572445 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d6e4b-f7a4-4230-9053-d555b9caa1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:22.573134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d6e4b-f7a4-4230-9053-d555b9caa1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:22.573941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d6e4b-f7a4-4230-9053-d555b9caa1e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:22.587981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d6e4b-f7a4-4230-9053-d555b9caa1e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-923d6e4b-f7a4-4230-9053-d555b9caa1e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:22.595301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:22.596197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:22.596984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:22.596984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:22.596984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:22.596984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:22.596984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:22.596984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:22.596984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:22.596984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:22.596984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:22.596984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:22.596984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:22.596984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:22.600335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 34/71] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:44:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:22.602146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec877d-2b28-4259-bfa9-229bf79b1a02 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:22.602442 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec877d-2b28-4259-bfa9-229bf79b1a02 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:22.602723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec877d-2b28-4259-bfa9-229bf79b1a02 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:22.604039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 35/72] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:22.608705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec877d-2b28-4259-bfa9-229bf79b1a02 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:22.648334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:22.661510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5a418-b9dd-4e8f-9d8d-3343cc07218d None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:22.706906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba87e1c-eba5-4075-8144-00d6385bab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:22.708357 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87e1c-eba5-4075-8144-00d6385bab73 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:22.708645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87e1c-eba5-4075-8144-00d6385bab73 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:22.708935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87e1c-eba5-4075-8144-00d6385bab73 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:22.709781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba87e1c-eba5-4075-8144-00d6385bab73 None admin] RBAC: Adding query filter params (name=member) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:22.710495 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba87e1c-eba5-4075-8144-00d6385bab73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:22.711924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba87e1c-eba5-4075-8144-00d6385bab73 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:22.716809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec877d-2b28-4259-bfa9-229bf79b1a02 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:22.721541 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 38/73] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:22.725605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde476b0-7e46-4e6f-9886-68e81288df9f None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:22.725605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde476b0-7e46-4e6f-9886-68e81288df9f None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:22.725605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde476b0-7e46-4e6f-9886-68e81288df9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:22.743728 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-fde476b0-7e46-4e6f-9886-68e81288df9f None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:22.744966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fde476b0-7e46-4e6f-9886-68e81288df9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:22.745898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:22.754060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdc427-7708-47af-bfc7-97c98a2357ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:22.754814 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdc427-7708-47af-bfc7-97c98a2357ba None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:22.755105 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdc427-7708-47af-bfc7-97c98a2357ba None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:22.755388 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdc427-7708-47af-bfc7-97c98a2357ba None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:22.756156 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdc427-7708-47af-bfc7-97c98a2357ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:22.762422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdc427-7708-47af-bfc7-97c98a2357ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:22.762422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdc427-7708-47af-bfc7-97c98a2357ba None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:22.776007 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 36/74] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:22.776007 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdc427-7708-47af-bfc7-97c98a2357ba None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:22.820870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 39/75] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:22.822095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde476b0-7e46-4e6f-9886-68e81288df9f None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:22.886969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdc427-7708-47af-bfc7-97c98a2357ba None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:22.910174 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:22.924724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f257cee-9862-49a3-8937-2d864f247bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:22.925545 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f257cee-9862-49a3-8937-2d864f247bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:22.926003 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f257cee-9862-49a3-8937-2d864f247bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:22.926473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f257cee-9862-49a3-8937-2d864f247bf0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:22.928452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde476b0-7e46-4e6f-9886-68e81288df9f None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:22.937199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f257cee-9862-49a3-8937-2d864f247bf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-0f257cee-9862-49a3-8937-2d864f247bf0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:22.942339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:22.943263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:22.944305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:22.944305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:22.944305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:22.944305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:22.944305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:22.944305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:22.944305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:22.944305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:22.944305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:22.944305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:22.944305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:44:22.944305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:22.944305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 37/76] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:44:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:22.948908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f257cee-9862-49a3-8937-2d864f247bf0 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:22.967531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b80fed-2b7e-4c8c-b888-1f010a7baca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:22.968445 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b80fed-2b7e-4c8c-b888-1f010a7baca5 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:22.969126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b80fed-2b7e-4c8c-b888-1f010a7baca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:22.969407 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b80fed-2b7e-4c8c-b888-1f010a7baca5 None admin] PATH_INFO: `/v3/users/61066d74ba554ad286195a8631d292e4` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:22.984553 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b80fed-2b7e-4c8c-b888-1f010a7baca5 None admin] RBAC: Authorizing `identity:get_user(user_id=61066d74ba554ad286195a8631d292e4)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:22.986015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b80fed-2b7e-4c8c-b888-1f010a7baca5 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:22.987828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 40/77] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:22 2022] GET /identity/v3/users/61066d74ba554ad286195a8631d292e4 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:22.988539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b80fed-2b7e-4c8c-b888-1f010a7baca5 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:23.009758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:23.066076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f257cee-9862-49a3-8937-2d864f247bf0 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:23.102550 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b80fed-2b7e-4c8c-b888-1f010a7baca5 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:23.104327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ace556-2c1f-40d6-a721-ce893a56ddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:23.104976 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ace556-2c1f-40d6-a721-ce893a56ddd6 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:23.105265 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ace556-2c1f-40d6-a721-ce893a56ddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:23.105548 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ace556-2c1f-40d6-a721-ce893a56ddd6 None admin] PATH_INFO: `/v3/users/ff4c484fb0f14c218e0baa6d6c4c76d5` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:23.106684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ace556-2c1f-40d6-a721-ce893a56ddd6 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4c484fb0f14c218e0baa6d6c4c76d5)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:23.108174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ace556-2c1f-40d6-a721-ce893a56ddd6 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:23.109831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 38/78] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:22 2022] GET /identity/v3/users/ff4c484fb0f14c218e0baa6d6c4c76d5 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:23.110595 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ace556-2c1f-40d6-a721-ce893a56ddd6 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:23.136509 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f6ef5-8bc7-4fcf-8b58-97c7b33934e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:23.137151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f6ef5-8bc7-4fcf-8b58-97c7b33934e6 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:23.137441 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f6ef5-8bc7-4fcf-8b58-97c7b33934e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:23.137722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f6ef5-8bc7-4fcf-8b58-97c7b33934e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:23.145708 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:23.148657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f6ef5-8bc7-4fcf-8b58-97c7b33934e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-e61f6ef5-8bc7-4fcf-8b58-97c7b33934e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:23.154024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:23.154932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:23.161754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:23.161754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:23.161754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:23.161754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:23.161754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:23.161754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:23.161754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:23.161754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:23.161754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:23.161754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:23.161754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:23.161754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:23.161754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 41/79] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:23.161754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f6ef5-8bc7-4fcf-8b58-97c7b33934e6 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:23.219384 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ace556-2c1f-40d6-a721-ce893a56ddd6 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:23.237364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:23.254231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcc417-bb2f-40c3-b02d-c1f1cb6397e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:23.255369 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcc417-bb2f-40c3-b02d-c1f1cb6397e6 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:23.255654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcc417-bb2f-40c3-b02d-c1f1cb6397e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:23.255756 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f6ef5-8bc7-4fcf-8b58-97c7b33934e6 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:23.255961 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcc417-bb2f-40c3-b02d-c1f1cb6397e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:23.256692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcc417-bb2f-40c3-b02d-c1f1cb6397e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:23.257001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcc417-bb2f-40c3-b02d-c1f1cb6397e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:23.258404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcc417-bb2f-40c3-b02d-c1f1cb6397e6 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:23.268264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 39/80] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:44:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:23.269073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcc417-bb2f-40c3-b02d-c1f1cb6397e6 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:23.290440 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a39a01-dcce-4817-951b-e01f017a768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:23.291058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a39a01-dcce-4817-951b-e01f017a768c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:23.291348 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a39a01-dcce-4817-951b-e01f017a768c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:23.291627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a39a01-dcce-4817-951b-e01f017a768c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:23.356781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:23.359037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a39a01-dcce-4817-951b-e01f017a768c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:23.360546 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a39a01-dcce-4817-951b-e01f017a768c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:23.370202 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcc417-bb2f-40c3-b02d-c1f1cb6397e6 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:23.404887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fed307-235f-4866-ae26-3c7f5c0cec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:23.405524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fed307-235f-4866-ae26-3c7f5c0cec07 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:23.405813 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fed307-235f-4866-ae26-3c7f5c0cec07 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:23.406093 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fed307-235f-4866-ae26-3c7f5c0cec07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:23.407203 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fed307-235f-4866-ae26-3c7f5c0cec07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:23.408681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fed307-235f-4866-ae26-3c7f5c0cec07 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:23.410242 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 40/81] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:23.411041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fed307-235f-4866-ae26-3c7f5c0cec07 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:23.459582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 42/82] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:23.460586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a39a01-dcce-4817-951b-e01f017a768c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:23.460839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:23.514956 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fed307-235f-4866-ae26-3c7f5c0cec07 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:23.548839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ff9b9-c0f3-4d4b-b53e-7ac2fce5592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:23.549452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ff9b9-c0f3-4d4b-b53e-7ac2fce5592c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:23.549734 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ff9b9-c0f3-4d4b-b53e-7ac2fce5592c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:23.550009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ff9b9-c0f3-4d4b-b53e-7ac2fce5592c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:23.557889 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:23.560807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a39a01-dcce-4817-951b-e01f017a768c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:23.594926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf883d87-8961-4c97-8a94-628c0a3be9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:23.595545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf883d87-8961-4c97-8a94-628c0a3be9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:23.595835 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf883d87-8961-4c97-8a94-628c0a3be9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:23.596193 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf883d87-8961-4c97-8a94-628c0a3be9b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:23.596865 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf883d87-8961-4c97-8a94-628c0a3be9b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:23.597178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf883d87-8961-4c97-8a94-628c0a3be9b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:23.599124 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf883d87-8961-4c97-8a94-628c0a3be9b8 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:23.607193 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 43/83] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:23.607955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf883d87-8961-4c97-8a94-628c0a3be9b8 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:23.619321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ff9b9-c0f3-4d4b-b53e-7ac2fce5592c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:23.620826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ff9b9-c0f3-4d4b-b53e-7ac2fce5592c None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:23.668419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:23.709855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf883d87-8961-4c97-8a94-628c0a3be9b8 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:23.719481 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 41/84] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:23.720325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ff9b9-c0f3-4d4b-b53e-7ac2fce5592c None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:23.750700 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9653c-160b-4101-a894-752f167d45af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:23.751334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9653c-160b-4101-a894-752f167d45af None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:23.751617 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9653c-160b-4101-a894-752f167d45af None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:23.751918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9653c-160b-4101-a894-752f167d45af None admin] PATH_INFO: `/v3/users/61066d74ba554ad286195a8631d292e4` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:23.753058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9653c-160b-4101-a894-752f167d45af None admin] RBAC: Authorizing `identity:get_user(user_id=61066d74ba554ad286195a8631d292e4)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:23.754506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9653c-160b-4101-a894-752f167d45af None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:23.756176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 44/85] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:23 2022] GET /identity/v3/users/61066d74ba554ad286195a8631d292e4 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:23.756927 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9653c-160b-4101-a894-752f167d45af None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:23.789005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:23.845320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ff9b9-c0f3-4d4b-b53e-7ac2fce5592c None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:23.858254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9653c-160b-4101-a894-752f167d45af None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:23.879898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a5d3-fc7d-4c9c-bd37-f6f9ab4186ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:23.880518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a5d3-fc7d-4c9c-bd37-f6f9ab4186ad None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:23.880799 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a5d3-fc7d-4c9c-bd37-f6f9ab4186ad None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:23.881081 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a5d3-fc7d-4c9c-bd37-f6f9ab4186ad None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:23.881726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4a5d3-fc7d-4c9c-bd37-f6f9ab4186ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:23.883210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4a5d3-fc7d-4c9c-bd37-f6f9ab4186ad None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:23.894378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8b7fa-f97f-432e-a4b5-c8f5f6b11824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:23.895100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8b7fa-f97f-432e-a4b5-c8f5f6b11824 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:23.895941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8b7fa-f97f-432e-a4b5-c8f5f6b11824 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:23.901310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8b7fa-f97f-432e-a4b5-c8f5f6b11824 None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:23.901310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8b7fa-f97f-432e-a4b5-c8f5f6b11824 None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:23.901310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8b7fa-f97f-432e-a4b5-c8f5f6b11824 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:23.901310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 45/86] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:23 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:23.901310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8b7fa-f97f-432e-a4b5-c8f5f6b11824 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:23.981623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 42/87] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:44:23 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:44:23.982472 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a5d3-fc7d-4c9c-bd37-f6f9ab4186ad None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:23.985999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:24.002747 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:24.007564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8b7fa-f97f-432e-a4b5-c8f5f6b11824 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:24.046468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c4a2f-8df3-4fe1-b600-6df0af765feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:24.047524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c4a2f-8df3-4fe1-b600-6df0af765feb None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:24.047947 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c4a2f-8df3-4fe1-b600-6df0af765feb None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:24.048237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c4a2f-8df3-4fe1-b600-6df0af765feb None admin] PATH_INFO: `/v3/users/61066d74ba554ad286195a8631d292e4` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:24.049632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c4a2f-8df3-4fe1-b600-6df0af765feb None admin] RBAC: Authorizing `identity:get_user(user_id=61066d74ba554ad286195a8631d292e4)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:24.051199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c4a2f-8df3-4fe1-b600-6df0af765feb None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:24.053089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 46/88] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:23 2022] GET /identity/v3/users/61066d74ba554ad286195a8631d292e4 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:24.053792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c4a2f-8df3-4fe1-b600-6df0af765feb None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:24.105178 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a5d3-fc7d-4c9c-bd37-f6f9ab4186ad None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:24.151144 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e3a62-17fb-4f5e-8be2-cc6655041bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:24.151756 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e3a62-17fb-4f5e-8be2-cc6655041bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:24.152138 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e3a62-17fb-4f5e-8be2-cc6655041bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:24.152422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e3a62-17fb-4f5e-8be2-cc6655041bf0 None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:24.153611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e3a62-17fb-4f5e-8be2-cc6655041bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:24.155095 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e3a62-17fb-4f5e-8be2-cc6655041bf0 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:24.156796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 43/89] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:23 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:24.157576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e3a62-17fb-4f5e-8be2-cc6655041bf0 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:24.210468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c4a2f-8df3-4fe1-b600-6df0af765feb None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:24.261301 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d9015-784c-4d1a-8789-2dd66d60b3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:24.262786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d9015-784c-4d1a-8789-2dd66d60b3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:24.262786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d9015-784c-4d1a-8789-2dd66d60b3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:24.263691 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:24.264385 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d9015-784c-4d1a-8789-2dd66d60b3e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:24.308497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e3a62-17fb-4f5e-8be2-cc6655041bf0 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:24.312540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:24.354366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89ea3f-ea91-4a7a-8351-538abaff4cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:24.355108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89ea3f-ea91-4a7a-8351-538abaff4cdd None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:24.355559 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89ea3f-ea91-4a7a-8351-538abaff4cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:24.356719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89ea3f-ea91-4a7a-8351-538abaff4cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:24.356719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89ea3f-ea91-4a7a-8351-538abaff4cdd None admin] RBAC: Adding query filter params (role.id=d949d82256654aa9b25ca259d33df4c3, scope.project.id=1a0e34213bab467880b704e894812e37, user.id=61066d74ba554ad286195a8631d292e4) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:24.357041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89ea3f-ea91-4a7a-8351-538abaff4cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:24.358999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89ea3f-ea91-4a7a-8351-538abaff4cdd None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:24.365900 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 44/90] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:24 2022] GET /identity/v3/role_assignments?user.id=61066d74ba554ad286195a8631d292e4&scope.project.id=1a0e34213bab467880b704e894812e37&role.id=d949d82256654aa9b25ca259d33df4c3 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:24.366970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89ea3f-ea91-4a7a-8351-538abaff4cdd None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:24.383680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d9015-784c-4d1a-8789-2dd66d60b3e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:24.386712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d9015-784c-4d1a-8789-2dd66d60b3e1 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:24.524767 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 47/91] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:24.526041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d9015-784c-4d1a-8789-2dd66d60b3e1 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:24.545297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89ea3f-ea91-4a7a-8351-538abaff4cdd None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:24.604402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05821ab3-db24-4cf3-8c2f-36c0d8066e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:24.605411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05821ab3-db24-4cf3-8c2f-36c0d8066e5f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:24.605936 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05821ab3-db24-4cf3-8c2f-36c0d8066e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:24.606414 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05821ab3-db24-4cf3-8c2f-36c0d8066e5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:24.610691 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:24.663840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:24.737444 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d9015-784c-4d1a-8789-2dd66d60b3e1 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:24.750053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05821ab3-db24-4cf3-8c2f-36c0d8066e5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:24.752201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05821ab3-db24-4cf3-8c2f-36c0d8066e5f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:24.805766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3940c72-8a49-40c4-96e5-0b8042cb606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:24.806795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3940c72-8a49-40c4-96e5-0b8042cb606a None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:24.807302 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3940c72-8a49-40c4-96e5-0b8042cb606a None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:24.807776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3940c72-8a49-40c4-96e5-0b8042cb606a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:24.815916 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3940c72-8a49-40c4-96e5-0b8042cb606a None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=1a0e34213bab467880b704e894812e37, user.id=ff4c484fb0f14c218e0baa6d6c4c76d5) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:24.815916 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3940c72-8a49-40c4-96e5-0b8042cb606a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:24.815916 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3940c72-8a49-40c4-96e5-0b8042cb606a None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:24.833590 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 48/92] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:24 2022] GET /identity/v3/role_assignments?user.id=ff4c484fb0f14c218e0baa6d6c4c76d5&scope.project.id=1a0e34213bab467880b704e894812e37&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:24.833590 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3940c72-8a49-40c4-96e5-0b8042cb606a None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:25.034394 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 45/93] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:25.045542 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3940c72-8a49-40c4-96e5-0b8042cb606a None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:25.053521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05821ab3-db24-4cf3-8c2f-36c0d8066e5f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:25.104403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:25.116816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b36d30-094b-4a2c-9b9c-edb73cbda5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:25.117549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b36d30-094b-4a2c-9b9c-edb73cbda5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:25.117843 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b36d30-094b-4a2c-9b9c-edb73cbda5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:25.118132 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b36d30-094b-4a2c-9b9c-edb73cbda5b7 None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:25.122419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b36d30-094b-4a2c-9b9c-edb73cbda5b7 None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:25.124063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b36d30-094b-4a2c-9b9c-edb73cbda5b7 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:25.125903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 49/94] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:24 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:25.132257 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b36d30-094b-4a2c-9b9c-edb73cbda5b7 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:25.150871 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:25.251685 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b36d30-094b-4a2c-9b9c-edb73cbda5b7 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:25.290507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d7607-cf5c-490f-ad82-2e9241ef0b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:25.291231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d7607-cf5c-490f-ad82-2e9241ef0b61 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:25.291723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d7607-cf5c-490f-ad82-2e9241ef0b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:25.292225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d7607-cf5c-490f-ad82-2e9241ef0b61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:25.293107 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d7607-cf5c-490f-ad82-2e9241ef0b61 None admin] RBAC: Adding query filter params (role.id=af21992d300b4bb3acb7b7f5f5b04252, scope.project.id=1a0e34213bab467880b704e894812e37, user.id=61066d74ba554ad286195a8631d292e4) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:25.293739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d7607-cf5c-490f-ad82-2e9241ef0b61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:25.295353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d7607-cf5c-490f-ad82-2e9241ef0b61 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:25.302178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 50/95] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:25 2022] GET /identity/v3/role_assignments?user.id=61066d74ba554ad286195a8631d292e4&scope.project.id=1a0e34213bab467880b704e894812e37&role.id=af21992d300b4bb3acb7b7f5f5b04252 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:25.342527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05821ab3-db24-4cf3-8c2f-36c0d8066e5f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:25.398007 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f23913-6757-4ecb-9ea1-a6b905f1e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:25.398595 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f23913-6757-4ecb-9ea1-a6b905f1e503 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:25.398879 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f23913-6757-4ecb-9ea1-a6b905f1e503 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:25.399154 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f23913-6757-4ecb-9ea1-a6b905f1e503 None admin] PATH_INFO: `/v3/projects/6844e446691445fd84b38e2cd652828a` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:25.400363 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f23913-6757-4ecb-9ea1-a6b905f1e503 None admin] RBAC: Authorizing `identity:get_project(project_id=6844e446691445fd84b38e2cd652828a)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:25.401839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f23913-6757-4ecb-9ea1-a6b905f1e503 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:25.403846 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 46/96] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:25 2022] GET /identity/v3/projects/6844e446691445fd84b38e2cd652828a => generated 312 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:25.409805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d7607-cf5c-490f-ad82-2e9241ef0b61 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:25.500479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:25.546078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d7607-cf5c-490f-ad82-2e9241ef0b61 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:25.585905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abf238-3872-49eb-b8d7-23ee2f1248bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:25.586532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abf238-3872-49eb-b8d7-23ee2f1248bc None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:25.586823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abf238-3872-49eb-b8d7-23ee2f1248bc None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:25.587105 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abf238-3872-49eb-b8d7-23ee2f1248bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:25.587944 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abf238-3872-49eb-b8d7-23ee2f1248bc None admin] RBAC: Adding query filter params (role.id=d949d82256654aa9b25ca259d33df4c3, scope.project.id=6844e446691445fd84b38e2cd652828a, user.id=61066d74ba554ad286195a8631d292e4) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:25.588265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abf238-3872-49eb-b8d7-23ee2f1248bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:25.589742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abf238-3872-49eb-b8d7-23ee2f1248bc None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:25.595751 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 51/97] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:25 2022] GET /identity/v3/role_assignments?user.id=61066d74ba554ad286195a8631d292e4&scope.project.id=6844e446691445fd84b38e2cd652828a&role.id=d949d82256654aa9b25ca259d33df4c3 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:26.766000 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42f6ba-385f-47f2-bf49-104be75fbb0e None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:26.766511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42f6ba-385f-47f2-bf49-104be75fbb0e None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:26.766584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42f6ba-385f-47f2-bf49-104be75fbb0e None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:26.767899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 47/98] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:26.785630 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44d0d4-1372-44ff-92ab-5fb6b625393a None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:26.786778 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44d0d4-1372-44ff-92ab-5fb6b625393a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:26.786778 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44d0d4-1372-44ff-92ab-5fb6b625393a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:26.812936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-2b44d0d4-1372-44ff-92ab-5fb6b625393a None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:26.814156 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2b44d0d4-1372-44ff-92ab-5fb6b625393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:26.900220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 52/99] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:27.266060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2b705-1ba0-4089-8eec-5f3fa7d9e3ff None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:27.266381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2b705-1ba0-4089-8eec-5f3fa7d9e3ff None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:27.266617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2b705-1ba0-4089-8eec-5f3fa7d9e3ff None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:27.267984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 48/100] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:27.274230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c44d08-ab88-45a8-9b0e-575e7c84387a None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:27.279285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c44d08-ab88-45a8-9b0e-575e7c84387a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:27.279285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c44d08-ab88-45a8-9b0e-575e7c84387a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:27.312877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-d0c44d08-ab88-45a8-9b0e-575e7c84387a None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:27.314075 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d0c44d08-ab88-45a8-9b0e-575e7c84387a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:27.383472 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:27.390814 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2b705-1ba0-4089-8eec-5f3fa7d9e3ff None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:27.402893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 53/101] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:44:27.476067 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434fc10-e010-4f28-abc7-853b9553355c None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:27.476349 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434fc10-e010-4f28-abc7-853b9553355c None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:27.476561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434fc10-e010-4f28-abc7-853b9553355c None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:27.477916 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 54/102] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:27.484104 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d09ee7-3428-46d3-bcff-0d7934ecfcd6 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:27.484393 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d09ee7-3428-46d3-bcff-0d7934ecfcd6 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:27.484667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d09ee7-3428-46d3-bcff-0d7934ecfcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:27.518317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-82d09ee7-3428-46d3-bcff-0d7934ecfcd6 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:27.519517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-82d09ee7-3428-46d3-bcff-0d7934ecfcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:27.590768 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2b705-1ba0-4089-8eec-5f3fa7d9e3ff None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:27.600290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:27.654801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b3ae9-6cb8-49a2-90cf-b6c8276598dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:27.655818 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b3ae9-6cb8-49a2-90cf-b6c8276598dd None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:27.656356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b3ae9-6cb8-49a2-90cf-b6c8276598dd None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:27.656830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b3ae9-6cb8-49a2-90cf-b6c8276598dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:27.672885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 55/103] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:27.680790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b3ae9-6cb8-49a2-90cf-b6c8276598dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-d19b3ae9-6cb8-49a2-90cf-b6c8276598dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:27.686039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:27.686898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:27.687680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:27.687680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:27.687680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:27.687680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:27.687680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:27.687680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:27.687680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:27.687680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:27.687680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:27.687680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:27.687680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:27.687680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:27.690275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 49/104] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:44:27.696813 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d09ee7-3428-46d3-bcff-0d7934ecfcd6 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:27.815337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d09ee7-3428-46d3-bcff-0d7934ecfcd6 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:27.832698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:27.851527 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bd686-fb46-42c2-8155-7f399f7d6d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:27.852778 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bd686-fb46-42c2-8155-7f399f7d6d72 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:27.852778 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bd686-fb46-42c2-8155-7f399f7d6d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:27.852778 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bd686-fb46-42c2-8155-7f399f7d6d72 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:27.853358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bd686-fb46-42c2-8155-7f399f7d6d72 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:27.853665 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bd686-fb46-42c2-8155-7f399f7d6d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:27.856442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bd686-fb46-42c2-8155-7f399f7d6d72 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:27.856558 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b3ae9-6cb8-49a2-90cf-b6c8276598dd None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:27.875141 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 56/105] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:27.882456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bd686-fb46-42c2-8155-7f399f7d6d72 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:28.049928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b3ae9-6cb8-49a2-90cf-b6c8276598dd None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:28.093304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bd686-fb46-42c2-8155-7f399f7d6d72 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:28.104641 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c850305-8d9d-4be7-8b69-41577a8e0eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:28.105318 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c850305-8d9d-4be7-8b69-41577a8e0eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:28.105600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c850305-8d9d-4be7-8b69-41577a8e0eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:28.106027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c850305-8d9d-4be7-8b69-41577a8e0eb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:28.107393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c850305-8d9d-4be7-8b69-41577a8e0eb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:28.109029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c850305-8d9d-4be7-8b69-41577a8e0eb0 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:28.110607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 50/106] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:28.111727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb6256-36f1-4f4d-9c76-6d1b558aa511 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:28.112046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb6256-36f1-4f4d-9c76-6d1b558aa511 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:28.112328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb6256-36f1-4f4d-9c76-6d1b558aa511 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:28.113551 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 51/107] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:28.114409 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb6256-36f1-4f4d-9c76-6d1b558aa511 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:28.137543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1127ac-8e08-4ca3-ad0c-7c81d11dadf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:28.138196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1127ac-8e08-4ca3-ad0c-7c81d11dadf1 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:28.138484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1127ac-8e08-4ca3-ad0c-7c81d11dadf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:28.138762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1127ac-8e08-4ca3-ad0c-7c81d11dadf1 None admin] PATH_INFO: `/v3/users/f3417c98dfa945a68bf21c711d73d5ac` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:28.147689 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:28.158265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1127ac-8e08-4ca3-ad0c-7c81d11dadf1 None admin] RBAC: Authorizing `identity:get_user(user_id=f3417c98dfa945a68bf21c711d73d5ac)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:28.159747 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1127ac-8e08-4ca3-ad0c-7c81d11dadf1 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:28.162734 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 57/108] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:27 2022] GET /identity/v3/users/f3417c98dfa945a68bf21c711d73d5ac => generated 289 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:28.166099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f63ab1-c1b4-4b9a-a77d-1f5920dcc633 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:28.167679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f63ab1-c1b4-4b9a-a77d-1f5920dcc633 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:28.168141 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f63ab1-c1b4-4b9a-a77d-1f5920dcc633 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:28.170024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 58/109] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:28.171249 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f63ab1-c1b4-4b9a-a77d-1f5920dcc633 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:28.217423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:28.234664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb6256-36f1-4f4d-9c76-6d1b558aa511 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:28.278281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b8145-4bc7-4d34-bb2d-9723d7a3a70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:28.278921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8145-4bc7-4d34-bb2d-9723d7a3a70f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:28.279210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8145-4bc7-4d34-bb2d-9723d7a3a70f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:28.279489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b8145-4bc7-4d34-bb2d-9723d7a3a70f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:28.290338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b8145-4bc7-4d34-bb2d-9723d7a3a70f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:28.294285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f63ab1-c1b4-4b9a-a77d-1f5920dcc633 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-400b8145-4bc7-4d34-bb2d-9723d7a3a70f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:28.296324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:28.297201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:28.298010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:28.298010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:28.298010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:28.298010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:28.298010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:28.298010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:28.298010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:28.298010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:28.298010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:28.298010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:28.298010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:28.298010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:28.298010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 52/110] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:28.299917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8052758-8222-41bc-b8c2-c28f1f965179 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:28.299917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8052758-8222-41bc-b8c2-c28f1f965179 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:28.299917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8052758-8222-41bc-b8c2-c28f1f965179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:28.318515 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b8052758-8222-41bc-b8c2-c28f1f965179 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:28.319732 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b8052758-8222-41bc-b8c2-c28f1f965179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:28.337587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4976a-69f5-4682-90d1-f4988563852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:28.338482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4976a-69f5-4682-90d1-f4988563852b None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:28.338928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4976a-69f5-4682-90d1-f4988563852b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:28.339369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4976a-69f5-4682-90d1-f4988563852b None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:28.340210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4976a-69f5-4682-90d1-f4988563852b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:28.341798 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4976a-69f5-4682-90d1-f4988563852b None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:28.399967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 53/111] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:28.399967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8052758-8222-41bc-b8c2-c28f1f965179 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:28.422270 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:28.440910 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 59/112] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 13:44:28 2022] POST /identity/v3/projects => generated 302 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:44:28.443596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9204bd5-110e-430f-9cac-f8d12bbdd278 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:28.444144 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9204bd5-110e-430f-9cac-f8d12bbdd278 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:28.445069 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9204bd5-110e-430f-9cac-f8d12bbdd278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:28.486995 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-d9204bd5-110e-430f-9cac-f8d12bbdd278 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:28.488592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d9204bd5-110e-430f-9cac-f8d12bbdd278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:28.558389 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8052758-8222-41bc-b8c2-c28f1f965179 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:28.586047 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 60/113] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:28.587001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9204bd5-110e-430f-9cac-f8d12bbdd278 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:28.613391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:28.613636 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d0049-a031-439f-9c49-a2f5bdb136db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:28.614557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d0049-a031-439f-9c49-a2f5bdb136db None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:28.614919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d0049-a031-439f-9c49-a2f5bdb136db None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:28.615197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d0049-a031-439f-9c49-a2f5bdb136db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:28.690629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d0049-a031-439f-9c49-a2f5bdb136db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:28.692138 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d0049-a031-439f-9c49-a2f5bdb136db None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:28.714268 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9204bd5-110e-430f-9cac-f8d12bbdd278 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:28.721571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:28.760694 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20480683-348f-412b-ae8b-b6805b07e1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:28.761462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20480683-348f-412b-ae8b-b6805b07e1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:28.762036 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20480683-348f-412b-ae8b-b6805b07e1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:28.762368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20480683-348f-412b-ae8b-b6805b07e1d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:28.763489 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20480683-348f-412b-ae8b-b6805b07e1d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:28.763773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20480683-348f-412b-ae8b-b6805b07e1d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:28.765196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20480683-348f-412b-ae8b-b6805b07e1d0 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:28.776063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 61/114] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:28.777709 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b4cb4-fa7a-42e3-abbf-1b218aaea81d None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:28.778001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b4cb4-fa7a-42e3-abbf-1b218aaea81d None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:28.778281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b4cb4-fa7a-42e3-abbf-1b218aaea81d None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:28.779900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 62/115] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:28.780968 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b4cb4-fa7a-42e3-abbf-1b218aaea81d None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:28.807733 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 54/116] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:28.812893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d0049-a031-439f-9c49-a2f5bdb136db None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:28.888218 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:28.901150 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b4cb4-fa7a-42e3-abbf-1b218aaea81d None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:28.928790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d0049-a031-439f-9c49-a2f5bdb136db None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:28.937588 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3d7db-4667-4aba-ab9b-8b46dd1e8758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:28.938232 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3d7db-4667-4aba-ab9b-8b46dd1e8758 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:28.938891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3d7db-4667-4aba-ab9b-8b46dd1e8758 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:28.939180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3d7db-4667-4aba-ab9b-8b46dd1e8758 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:28.949798 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3d7db-4667-4aba-ab9b-8b46dd1e8758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:28.953228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-5eb3d7db-4667-4aba-ab9b-8b46dd1e8758 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:28.959115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:28.960114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:28.961044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:28.961044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:28.961044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:28.961044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:28.961044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:28.961044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:28.961044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:28.961044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:28.961044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:28.961044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:28.961044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:28.961044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:28.964008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 63/117] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:44:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:28.964008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0529b43-cadb-4bd0-bb59-1b0b5ee5ff26 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:28.964008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0529b43-cadb-4bd0-bb59-1b0b5ee5ff26 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:28.964008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0529b43-cadb-4bd0-bb59-1b0b5ee5ff26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:28.972640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89337f4-9cb8-4004-85ec-ff04aea4dda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:28.974131 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89337f4-9cb8-4004-85ec-ff04aea4dda4 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:28.974317 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89337f4-9cb8-4004-85ec-ff04aea4dda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:28.974558 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89337f4-9cb8-4004-85ec-ff04aea4dda4 None admin] PATH_INFO: `/v3/users/61066d74ba554ad286195a8631d292e4` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:28.975772 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89337f4-9cb8-4004-85ec-ff04aea4dda4 None admin] RBAC: Authorizing `identity:get_user(user_id=61066d74ba554ad286195a8631d292e4)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:28.977372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89337f4-9cb8-4004-85ec-ff04aea4dda4 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:28.979387 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 55/118] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:28 2022] GET /identity/v3/users/61066d74ba554ad286195a8631d292e4 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:28.979978 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89337f4-9cb8-4004-85ec-ff04aea4dda4 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:28.987014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-c0529b43-cadb-4bd0-bb59-1b0b5ee5ff26 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:28.988443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c0529b43-cadb-4bd0-bb59-1b0b5ee5ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:29.071913 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 64/119] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:29.073248 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0529b43-cadb-4bd0-bb59-1b0b5ee5ff26 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:29.101549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89337f4-9cb8-4004-85ec-ff04aea4dda4 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:29.143947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ff9e9-51f5-447b-b391-c39f8f604acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:29.144990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ff9e9-51f5-447b-b391-c39f8f604acc None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:29.145431 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ff9e9-51f5-447b-b391-c39f8f604acc None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:29.145858 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ff9e9-51f5-447b-b391-c39f8f604acc None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:29.147128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ff9e9-51f5-447b-b391-c39f8f604acc None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:29.148770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ff9e9-51f5-447b-b391-c39f8f604acc None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:29.150564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 56/120] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:28 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:29.151472 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ff9e9-51f5-447b-b391-c39f8f604acc None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:29.192354 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:29.222036 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:29.239627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0529b43-cadb-4bd0-bb59-1b0b5ee5ff26 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:29.269459 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ff9e9-51f5-447b-b391-c39f8f604acc None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:29.287361 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c85448-b689-4c1c-89d4-2f085d3e8c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:29.288056 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c85448-b689-4c1c-89d4-2f085d3e8c21 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:29.288346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c85448-b689-4c1c-89d4-2f085d3e8c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:29.288627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c85448-b689-4c1c-89d4-2f085d3e8c21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:29.303357 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c85448-b689-4c1c-89d4-2f085d3e8c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-d4c85448-b689-4c1c-89d4-2f085d3e8c21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:29.310989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:29.311931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:29.312753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:29.312753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:29.312753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:29.312753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:29.312753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:29.312753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:29.312753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:29.312753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:29.312753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:29.312753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:29.312753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:44:29.312753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:29.314195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 65/121] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:44:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:29.315222 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c85448-b689-4c1c-89d4-2f085d3e8c21 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:29.327093 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60f0ef-9620-4274-859a-7f365357b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:29.327719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60f0ef-9620-4274-859a-7f365357b3ad None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:29.328051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60f0ef-9620-4274-859a-7f365357b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:29.328393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60f0ef-9620-4274-859a-7f365357b3ad None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:29.329081 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60f0ef-9620-4274-859a-7f365357b3ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:29.329378 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60f0ef-9620-4274-859a-7f365357b3ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:29.330813 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60f0ef-9620-4274-859a-7f365357b3ad None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:29.339541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 57/122] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:29.339541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60f0ef-9620-4274-859a-7f365357b3ad None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:29.434299 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c85448-b689-4c1c-89d4-2f085d3e8c21 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:29.456633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60f0ef-9620-4274-859a-7f365357b3ad None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:29.466375 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:29.472932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d1177-b75c-4db9-b03e-b4d101bb751c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:29.473529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d1177-b75c-4db9-b03e-b4d101bb751c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:29.473811 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d1177-b75c-4db9-b03e-b4d101bb751c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:29.474085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d1177-b75c-4db9-b03e-b4d101bb751c None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:29.475323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d1177-b75c-4db9-b03e-b4d101bb751c None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:29.476869 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d1177-b75c-4db9-b03e-b4d101bb751c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:29.481838 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:29.481950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 66/123] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:29 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:29.481950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d1177-b75c-4db9-b03e-b4d101bb751c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:29.499076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd5255-f46b-427a-8eef-9a6a89e1c504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:29.500001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd5255-f46b-427a-8eef-9a6a89e1c504 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:29.500437 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd5255-f46b-427a-8eef-9a6a89e1c504 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:29.500932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd5255-f46b-427a-8eef-9a6a89e1c504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:29.501813 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd5255-f46b-427a-8eef-9a6a89e1c504 None admin] RBAC: Adding query filter params (role.id=1166805423244a648aaaf22296ce0f52, scope.project.id=1a0e34213bab467880b704e894812e37, user.id=f3417c98dfa945a68bf21c711d73d5ac) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:29.502296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd5255-f46b-427a-8eef-9a6a89e1c504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:29.503955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd5255-f46b-427a-8eef-9a6a89e1c504 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:29.510755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 58/124] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:29 2022] GET /identity/v3/role_assignments?user.id=f3417c98dfa945a68bf21c711d73d5ac&scope.project.id=1a0e34213bab467880b704e894812e37&role.id=1166805423244a648aaaf22296ce0f52 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:29.510755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd5255-f46b-427a-8eef-9a6a89e1c504 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:29.627105 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d1177-b75c-4db9-b03e-b4d101bb751c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:29.647073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd5255-f46b-427a-8eef-9a6a89e1c504 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:29.669815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c2ed2-40d6-4188-b022-38e6aa05ea01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:29.670454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c2ed2-40d6-4188-b022-38e6aa05ea01 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:29.670743 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c2ed2-40d6-4188-b022-38e6aa05ea01 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:29.671024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c2ed2-40d6-4188-b022-38e6aa05ea01 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:29.672158 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c2ed2-40d6-4188-b022-38e6aa05ea01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:29.672472 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c2ed2-40d6-4188-b022-38e6aa05ea01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:29.674052 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c2ed2-40d6-4188-b022-38e6aa05ea01 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:29.687710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 67/125] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:44:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:29.688877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c2ed2-40d6-4188-b022-38e6aa05ea01 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:29.692692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d9e2c-6fe3-49e8-9895-04c2b8c989f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:29.693854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d9e2c-6fe3-49e8-9895-04c2b8c989f6 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:29.694360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d9e2c-6fe3-49e8-9895-04c2b8c989f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:29.694835 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d9e2c-6fe3-49e8-9895-04c2b8c989f6 None admin] PATH_INFO: `/v3/users/ff4c484fb0f14c218e0baa6d6c4c76d5` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:29.696352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d9e2c-6fe3-49e8-9895-04c2b8c989f6 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4c484fb0f14c218e0baa6d6c4c76d5)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:29.698026 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d9e2c-6fe3-49e8-9895-04c2b8c989f6 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:29.699975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 59/126] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:29 2022] GET /identity/v3/users/ff4c484fb0f14c218e0baa6d6c4c76d5 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:29.700921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d9e2c-6fe3-49e8-9895-04c2b8c989f6 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:29.761174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:29.766727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:29.813807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c2ed2-40d6-4188-b022-38e6aa05ea01 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:29.825906 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d9e2c-6fe3-49e8-9895-04c2b8c989f6 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:29.853002 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad5d55-60aa-4742-b5ac-6030ae169b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:29.853569 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad5d55-60aa-4742-b5ac-6030ae169b6b None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:29.853860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad5d55-60aa-4742-b5ac-6030ae169b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:29.854137 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad5d55-60aa-4742-b5ac-6030ae169b6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:29.866237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad5d55-60aa-4742-b5ac-6030ae169b6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:29.870137 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c76f17-b332-4277-ba78-489899ac43a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:29.870996 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76f17-b332-4277-ba78-489899ac43a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:29.871471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76f17-b332-4277-ba78-489899ac43a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-c7ad5d55-60aa-4742-b5ac-6030ae169b6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:29.871776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:29.872651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:29.873425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:29.873425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:29.873425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:29.873425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:29.873425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:29.873425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:29.873425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:29.873425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:29.873425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:29.873425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:29.873425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:29.873425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:29.873425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 68/127] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:29.874073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad5d55-60aa-4742-b5ac-6030ae169b6b None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:29.879061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76f17-b332-4277-ba78-489899ac43a9 None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37/users/61066d74ba554ad286195a8631d292e4/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:29.880782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c76f17-b332-4277-ba78-489899ac43a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a0e34213bab467880b704e894812e37, user_id=61066d74ba554ad286195a8631d292e4, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:29.882328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c76f17-b332-4277-ba78-489899ac43a9 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:29.959953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 60/128] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:44:29 2022] PUT /identity/v3/projects/1a0e34213bab467880b704e894812e37/users/61066d74ba554ad286195a8631d292e4/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:44:29.961633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c76f17-b332-4277-ba78-489899ac43a9 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:30.023937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad5d55-60aa-4742-b5ac-6030ae169b6b None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:30.070805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:30.109276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7161e-d798-4dff-8239-e00e74e8e312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:30.109946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7161e-d798-4dff-8239-e00e74e8e312 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:30.110239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7161e-d798-4dff-8239-e00e74e8e312 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:30.110525 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7161e-d798-4dff-8239-e00e74e8e312 None admin] PATH_INFO: `/v3/users/61066d74ba554ad286195a8631d292e4` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:30.111718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7161e-d798-4dff-8239-e00e74e8e312 None admin] RBAC: Authorizing `identity:get_user(user_id=61066d74ba554ad286195a8631d292e4)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:30.113219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7161e-d798-4dff-8239-e00e74e8e312 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:30.115062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 69/129] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:29 2022] GET /identity/v3/users/61066d74ba554ad286195a8631d292e4 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:30.116674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7161e-d798-4dff-8239-e00e74e8e312 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:30.145161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c76f17-b332-4277-ba78-489899ac43a9 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:30.161389 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:30.192271 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb42aef-5d88-443b-a5a2-ca28afd9c931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:30.194029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb42aef-5d88-443b-a5a2-ca28afd9c931 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:30.194955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb42aef-5d88-443b-a5a2-ca28afd9c931 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:30.195903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb42aef-5d88-443b-a5a2-ca28afd9c931 None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:30.200506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb42aef-5d88-443b-a5a2-ca28afd9c931 None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:30.203461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb42aef-5d88-443b-a5a2-ca28afd9c931 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:30.206396 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 61/130] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:29 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:30.208163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb42aef-5d88-443b-a5a2-ca28afd9c931 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:30.248222 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7161e-d798-4dff-8239-e00e74e8e312 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:30.287734 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c0f31-1814-4284-b19e-f48441eba78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:30.288634 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c0f31-1814-4284-b19e-f48441eba78f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:30.289079 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c0f31-1814-4284-b19e-f48441eba78f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:30.289502 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c0f31-1814-4284-b19e-f48441eba78f None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:30.290321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c0f31-1814-4284-b19e-f48441eba78f None admin] RBAC: Adding query filter params (name=member) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:30.290782 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c0f31-1814-4284-b19e-f48441eba78f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:30.292365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c0f31-1814-4284-b19e-f48441eba78f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:30.301182 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 70/131] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:30.302220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c0f31-1814-4284-b19e-f48441eba78f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:30.360499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:30.405847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c0f31-1814-4284-b19e-f48441eba78f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:30.449753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d10d7-78ac-48bf-814b-fc2449156517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:30.450951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d10d7-78ac-48bf-814b-fc2449156517 None admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:30.452157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d10d7-78ac-48bf-814b-fc2449156517 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:30.453590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb42aef-5d88-443b-a5a2-ca28afd9c931 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:30.454093 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d10d7-78ac-48bf-814b-fc2449156517 None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37/users/ff4c484fb0f14c218e0baa6d6c4c76d5/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:30.458226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d10d7-78ac-48bf-814b-fc2449156517 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a0e34213bab467880b704e894812e37, user_id=ff4c484fb0f14c218e0baa6d6c4c76d5, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:30.460324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d10d7-78ac-48bf-814b-fc2449156517 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:30.500631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d71baf-41d4-49a9-8d11-78e8bbfcb5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:30.501645 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d71baf-41d4-49a9-8d11-78e8bbfcb5fc None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:30.502141 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d71baf-41d4-49a9-8d11-78e8bbfcb5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:30.502688 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d71baf-41d4-49a9-8d11-78e8bbfcb5fc None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:30.504053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d71baf-41d4-49a9-8d11-78e8bbfcb5fc None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:30.506016 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d71baf-41d4-49a9-8d11-78e8bbfcb5fc None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:30.507885 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 62/132] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:30 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:30.509191 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d71baf-41d4-49a9-8d11-78e8bbfcb5fc None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:30.562602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:30.574484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 71/133] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:44:30 2022] PUT /identity/v3/projects/1a0e34213bab467880b704e894812e37/users/ff4c484fb0f14c218e0baa6d6c4c76d5/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:44:30.576760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d10d7-78ac-48bf-814b-fc2449156517 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:30.637247 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d71baf-41d4-49a9-8d11-78e8bbfcb5fc None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:30.681492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9599ca-694f-4307-9d32-420c96c80143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:30.682238 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9599ca-694f-4307-9d32-420c96c80143 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:30.682533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9599ca-694f-4307-9d32-420c96c80143 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:30.682814 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9599ca-694f-4307-9d32-420c96c80143 None admin] PATH_INFO: `/v3/users/61066d74ba554ad286195a8631d292e4` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:30.684380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9599ca-694f-4307-9d32-420c96c80143 None admin] RBAC: Authorizing `identity:get_user(user_id=61066d74ba554ad286195a8631d292e4)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:30.685947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9599ca-694f-4307-9d32-420c96c80143 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:30.688023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 63/134] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:30 2022] GET /identity/v3/users/61066d74ba554ad286195a8631d292e4 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:30.690071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f695c44-c96b-4b80-aba5-1db0ccf6a7c5 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:30.690376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f695c44-c96b-4b80-aba5-1db0ccf6a7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:30.690713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f695c44-c96b-4b80-aba5-1db0ccf6a7c5 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:30.693066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 64/135] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:30.698219 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f695c44-c96b-4b80-aba5-1db0ccf6a7c5 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:30.791503 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d10d7-78ac-48bf-814b-fc2449156517 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:30.802990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:30.827742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26a68e-0a83-43c4-bd2e-5453c01880c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:30.828500 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26a68e-0a83-43c4-bd2e-5453c01880c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:30.828849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26a68e-0a83-43c4-bd2e-5453c01880c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:30.829197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26a68e-0a83-43c4-bd2e-5453c01880c8 None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37/users/61066d74ba554ad286195a8631d292e4/roles/af21992d300b4bb3acb7b7f5f5b04252` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:30.831504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26a68e-0a83-43c4-bd2e-5453c01880c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a0e34213bab467880b704e894812e37, user_id=61066d74ba554ad286195a8631d292e4, role_id=af21992d300b4bb3acb7b7f5f5b04252)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:30.833038 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26a68e-0a83-43c4-bd2e-5453c01880c8 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:30.845544 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f695c44-c96b-4b80-aba5-1db0ccf6a7c5 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:30.863240 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:30.882574 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30cec9-1caf-486a-b29f-5b70f5811d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:30.883224 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30cec9-1caf-486a-b29f-5b70f5811d9d None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:30.883539 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30cec9-1caf-486a-b29f-5b70f5811d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:30.884115 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30cec9-1caf-486a-b29f-5b70f5811d9d None admin] PATH_INFO: `/v3/projects/6844e446691445fd84b38e2cd652828a` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:30.885306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30cec9-1caf-486a-b29f-5b70f5811d9d None admin] RBAC: Authorizing `identity:get_project(project_id=6844e446691445fd84b38e2cd652828a)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:30.886774 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30cec9-1caf-486a-b29f-5b70f5811d9d None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:30.888751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 65/136] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:30 2022] GET /identity/v3/projects/6844e446691445fd84b38e2cd652828a => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:30.889886 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35cf62-adc6-4fff-96ed-c08bb3d549d3 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:30.890175 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35cf62-adc6-4fff-96ed-c08bb3d549d3 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:30.890457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35cf62-adc6-4fff-96ed-c08bb3d549d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:30.908785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 72/137] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:44:30 2022] PUT /identity/v3/projects/1a0e34213bab467880b704e894812e37/users/61066d74ba554ad286195a8631d292e4/roles/af21992d300b4bb3acb7b7f5f5b04252 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:44:30.909290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-4e35cf62-adc6-4fff-96ed-c08bb3d549d3 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:30.910227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26a68e-0a83-43c4-bd2e-5453c01880c8 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:30.911095 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4e35cf62-adc6-4fff-96ed-c08bb3d549d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:31.054779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 66/138] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:31.083617 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26a68e-0a83-43c4-bd2e-5453c01880c8 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:31.131521 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dfcd7-85c4-4dfa-8234-26a8bb74b775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:31.132244 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dfcd7-85c4-4dfa-8234-26a8bb74b775 None admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:31.132530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dfcd7-85c4-4dfa-8234-26a8bb74b775 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:31.132808 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dfcd7-85c4-4dfa-8234-26a8bb74b775 None admin] PATH_INFO: `/v3/projects/6844e446691445fd84b38e2cd652828a/users/61066d74ba554ad286195a8631d292e4/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:31.135078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87dfcd7-85c4-4dfa-8234-26a8bb74b775 None admin] RBAC: Authorizing `identity:create_grant(project_id=6844e446691445fd84b38e2cd652828a, user_id=61066d74ba554ad286195a8631d292e4, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:31.136669 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87dfcd7-85c4-4dfa-8234-26a8bb74b775 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:31.228877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 73/139] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:44:30 2022] PUT /identity/v3/projects/6844e446691445fd84b38e2cd652828a/users/61066d74ba554ad286195a8631d292e4/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:44:31.513401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35cf62-adc6-4fff-96ed-c08bb3d549d3 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:31.632581 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35cf62-adc6-4fff-96ed-c08bb3d549d3 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:31.651107 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:31.672987 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608e808-8bdd-42c6-b2d8-836f748d5f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:31.674010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608e808-8bdd-42c6-b2d8-836f748d5f5b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:31.674506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608e808-8bdd-42c6-b2d8-836f748d5f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:31.674997 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608e808-8bdd-42c6-b2d8-836f748d5f5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:31.676509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608e808-8bdd-42c6-b2d8-836f748d5f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:31.678168 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608e808-8bdd-42c6-b2d8-836f748d5f5b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:31.679955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 67/140] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:31.689192 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dfcd7-85c4-4dfa-8234-26a8bb74b775 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:31.745305 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:31.835214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dfcd7-85c4-4dfa-8234-26a8bb74b775 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:31.884091 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99176bbe-0661-4288-82c6-a2c285e1865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:31.884724 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99176bbe-0661-4288-82c6-a2c285e1865e None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:31.885016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99176bbe-0661-4288-82c6-a2c285e1865e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:31.885300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99176bbe-0661-4288-82c6-a2c285e1865e None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:31.885963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99176bbe-0661-4288-82c6-a2c285e1865e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:31.887424 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99176bbe-0661-4288-82c6-a2c285e1865e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:31.894253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680dbef-746a-4fb5-829f-df7fbdae9e45 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:31.894253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680dbef-746a-4fb5-829f-df7fbdae9e45 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:31.894253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680dbef-746a-4fb5-829f-df7fbdae9e45 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:31.895452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 68/141] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:31.900834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4a176-c551-4bc2-8430-49b2c8f917d4 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:31.901455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4a176-c551-4bc2-8430-49b2c8f917d4 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:31.902850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4a176-c551-4bc2-8430-49b2c8f917d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:31.923557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-73b4a176-c551-4bc2-8430-49b2c8f917d4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:31.925306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-73b4a176-c551-4bc2-8430-49b2c8f917d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:32.017500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 69/142] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:44:32.022642 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 74/143] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:44:31 2022] POST /identity/v3/users => generated 283 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:44:32.391050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4a176-c551-4bc2-8430-49b2c8f917d4 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:32.505783 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b4a176-c551-4bc2-8430-49b2c8f917d4 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:32.522296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:32.550189 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a1112-5919-4396-9a0b-14e99df8a3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:32.551825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a1112-5919-4396-9a0b-14e99df8a3df None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:32.552352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a1112-5919-4396-9a0b-14e99df8a3df None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:32.552839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a1112-5919-4396-9a0b-14e99df8a3df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:32.571793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a1112-5919-4396-9a0b-14e99df8a3df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-cf7a1112-5919-4396-9a0b-14e99df8a3df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:32.577097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:32.577944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:32.578705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:32.578705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:32.578705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:32.578705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:32.578705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:32.578705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:32.578705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:32.578705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:32.578705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:32.578705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:32.578705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:32.578705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:32.581020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 70/144] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:32.589005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99176bbe-0661-4288-82c6-a2c285e1865e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:32.703950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e561-bf45-4dac-b42e-fd35f3c92d70 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:32.704706 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e561-bf45-4dac-b42e-fd35f3c92d70 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:32.705182 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715e561-bf45-4dac-b42e-fd35f3c92d70 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:32.707946 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 71/145] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:32.714716 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0ee20-9fd6-4f01-9e19-237f7383cd06 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:32.715547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:32.716767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0ee20-9fd6-4f01-9e19-237f7383cd06 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:32.717259 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0ee20-9fd6-4f01-9e19-237f7383cd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:32.738285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99176bbe-0661-4288-82c6-a2c285e1865e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:32.741985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b7f0ee20-9fd6-4f01-9e19-237f7383cd06 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:32.743469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b7f0ee20-9fd6-4f01-9e19-237f7383cd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:32.809200 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7278c-9555-4fc8-9901-79a1272e7fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:32.809837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7278c-9555-4fc8-9901-79a1272e7fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:32.810123 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7278c-9555-4fc8-9901-79a1272e7fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:32.810400 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7278c-9555-4fc8-9901-79a1272e7fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:32.811078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7278c-9555-4fc8-9901-79a1272e7fb8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:32.811386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7278c-9555-4fc8-9901-79a1272e7fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:32.812827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7278c-9555-4fc8-9901-79a1272e7fb8 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:32.827760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 75/146] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:32.839062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7278c-9555-4fc8-9901-79a1272e7fb8 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:32.855299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 72/147] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:44:32.979658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7278c-9555-4fc8-9901-79a1272e7fb8 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:33.019241 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704aa16-c67c-4e8a-81a6-bab8af028279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:33.019991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704aa16-c67c-4e8a-81a6-bab8af028279 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:33.020281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704aa16-c67c-4e8a-81a6-bab8af028279 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:33.020567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704aa16-c67c-4e8a-81a6-bab8af028279 None admin] PATH_INFO: `/v3/users/f3417c98dfa945a68bf21c711d73d5ac` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:33.021791 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704aa16-c67c-4e8a-81a6-bab8af028279 None admin] RBAC: Authorizing `identity:get_user(user_id=f3417c98dfa945a68bf21c711d73d5ac)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:33.023269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704aa16-c67c-4e8a-81a6-bab8af028279 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:33.025975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 76/148] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:32 2022] GET /identity/v3/users/f3417c98dfa945a68bf21c711d73d5ac => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:33.030774 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0ee20-9fd6-4f01-9e19-237f7383cd06 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:33.183126 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0ee20-9fd6-4f01-9e19-237f7383cd06 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:33.184700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:33.194454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704aa16-c67c-4e8a-81a6-bab8af028279 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:33.233858 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9c59c-0bc0-4120-86a8-a018eb581b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:33.234654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9c59c-0bc0-4120-86a8-a018eb581b4c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:33.235000 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9c59c-0bc0-4120-86a8-a018eb581b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:33.235280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9c59c-0bc0-4120-86a8-a018eb581b4c None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:33.236657 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9c59c-0bc0-4120-86a8-a018eb581b4c None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:33.238358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9c59c-0bc0-4120-86a8-a018eb581b4c None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:33.243184 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 73/149] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:33 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:33.243290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:33.247843 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9c59c-0bc0-4120-86a8-a018eb581b4c None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:33.377823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704aa16-c67c-4e8a-81a6-bab8af028279 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:33.395516 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9c59c-0bc0-4120-86a8-a018eb581b4c None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:33.424678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f78c6c-bc01-46bd-862b-5101a9df5aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:33.425260 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f78c6c-bc01-46bd-862b-5101a9df5aac None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:33.425550 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f78c6c-bc01-46bd-862b-5101a9df5aac None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:33.425827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f78c6c-bc01-46bd-862b-5101a9df5aac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:33.438738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c25286-68cb-4006-b636-5699d99d3da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:33.439640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c25286-68cb-4006-b636-5699d99d3da0 None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:33.440083 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c25286-68cb-4006-b636-5699d99d3da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:33.440492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c25286-68cb-4006-b636-5699d99d3da0 None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37/users/f3417c98dfa945a68bf21c711d73d5ac/roles/1166805423244a648aaaf22296ce0f52` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:33.440987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f78c6c-bc01-46bd-862b-5101a9df5aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:33.442828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c25286-68cb-4006-b636-5699d99d3da0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a0e34213bab467880b704e894812e37, user_id=f3417c98dfa945a68bf21c711d73d5ac, role_id=1166805423244a648aaaf22296ce0f52)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:33.445046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c25286-68cb-4006-b636-5699d99d3da0 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-07f78c6c-bc01-46bd-862b-5101a9df5aac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:33.448373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:33.449412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:33.450320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:33.450320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:33.450320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:33.450320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:33.450320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:33.450320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:33.450320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:33.450320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:33.450320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:33.450320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:33.450320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:33.450320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:33.452776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 77/150] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:33.458872 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f78c6c-bc01-46bd-862b-5101a9df5aac None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:33.522183 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 74/151] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:44:33 2022] PUT /identity/v3/projects/1a0e34213bab467880b704e894812e37/users/f3417c98dfa945a68bf21c711d73d5ac/roles/1166805423244a648aaaf22296ce0f52 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:44:33.567226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:33.568610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d798db8-0325-418b-b676-6c538f3ebbd9 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:33.569143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d798db8-0325-418b-b676-6c538f3ebbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:33.569587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d798db8-0325-418b-b676-6c538f3ebbd9 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:33.571418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 75/152] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:33.585851 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c929c-1dd0-41cf-a496-bfb1d10d5db4 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:33.586434 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c929c-1dd0-41cf-a496-bfb1d10d5db4 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:33.586882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c929c-1dd0-41cf-a496-bfb1d10d5db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:33.619936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f78c6c-bc01-46bd-862b-5101a9df5aac None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:33.621318 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-951c929c-1dd0-41cf-a496-bfb1d10d5db4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:33.622528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-951c929c-1dd0-41cf-a496-bfb1d10d5db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:33.658099 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:33.689382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23460dfd-4514-4714-935f-1e93cced4f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:33.689960 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23460dfd-4514-4714-935f-1e93cced4f25 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:33.690249 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23460dfd-4514-4714-935f-1e93cced4f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:33.690528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23460dfd-4514-4714-935f-1e93cced4f25 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:33.691242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23460dfd-4514-4714-935f-1e93cced4f25 None admin] RBAC: Adding query filter params (name=member) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:33.692098 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23460dfd-4514-4714-935f-1e93cced4f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:33.693610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23460dfd-4514-4714-935f-1e93cced4f25 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:33.707723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 78/153] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:33.713055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23460dfd-4514-4714-935f-1e93cced4f25 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:33.726299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 76/154] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:33.844930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23460dfd-4514-4714-935f-1e93cced4f25 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:33.864431 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6b642-ec31-47dc-a734-2396e6d0b0eb None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:33.864732 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6b642-ec31-47dc-a734-2396e6d0b0eb None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:33.865095 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6b642-ec31-47dc-a734-2396e6d0b0eb None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:33.866454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 77/155] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:44:33.877846 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42d2c6-786b-45d2-9e66-f3900d0aec52 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:33.878114 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42d2c6-786b-45d2-9e66-f3900d0aec52 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:33.878444 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42d2c6-786b-45d2-9e66-f3900d0aec52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:33.909819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d33077-d9e0-4079-bf2a-ba9ca4912a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:33.910526 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33077-d9e0-4079-bf2a-ba9ca4912a38 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:33.910810 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33077-d9e0-4079-bf2a-ba9ca4912a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:33.911087 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33077-d9e0-4079-bf2a-ba9ca4912a38 None admin] PATH_INFO: `/v3/users/61066d74ba554ad286195a8631d292e4` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:33.916093 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-3c42d2c6-786b-45d2-9e66-f3900d0aec52 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:33.916575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d33077-d9e0-4079-bf2a-ba9ca4912a38 None admin] RBAC: Authorizing `identity:get_user(user_id=61066d74ba554ad286195a8631d292e4)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:33.917279 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-3c42d2c6-786b-45d2-9e66-f3900d0aec52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:33.918047 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d33077-d9e0-4079-bf2a-ba9ca4912a38 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:33.919670 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 79/156] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:33 2022] GET /identity/v3/users/61066d74ba554ad286195a8631d292e4 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:33.925452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d33077-d9e0-4079-bf2a-ba9ca4912a38 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:33.967224 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:34.015810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 78/157] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:34.059143 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d33077-d9e0-4079-bf2a-ba9ca4912a38 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:34.108568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a663e1-8e43-4eb6-bbd0-51e5073a8aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:34.109260 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a663e1-8e43-4eb6-bbd0-51e5073a8aad None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:34.109479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a663e1-8e43-4eb6-bbd0-51e5073a8aad None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:34.109751 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a663e1-8e43-4eb6-bbd0-51e5073a8aad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:34.211531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a663e1-8e43-4eb6-bbd0-51e5073a8aad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:34.213040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a663e1-8e43-4eb6-bbd0-51e5073a8aad None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:34.226901 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:34.342697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 80/158] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 13:44:34.348665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42d2c6-786b-45d2-9e66-f3900d0aec52 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:34.426618 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a663e1-8e43-4eb6-bbd0-51e5073a8aad None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:34.447409 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:34.458029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42d2c6-786b-45d2-9e66-f3900d0aec52 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:34.501920 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b598d2-b9dc-4be6-862b-86aa202151bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:34.502484 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b598d2-b9dc-4be6-862b-86aa202151bb None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:34.502765 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b598d2-b9dc-4be6-862b-86aa202151bb None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:34.503037 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b598d2-b9dc-4be6-862b-86aa202151bb None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:34.504707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b598d2-b9dc-4be6-862b-86aa202151bb None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:34.506300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b598d2-b9dc-4be6-862b-86aa202151bb None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:34.508264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 79/159] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:34 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:34.514537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b598d2-b9dc-4be6-862b-86aa202151bb None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:34.656118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b598d2-b9dc-4be6-862b-86aa202151bb None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:34.657901 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a663e1-8e43-4eb6-bbd0-51e5073a8aad None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:34.672223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:34.731153 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3100d-3b96-43df-b582-b2f66628f294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:34.731779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3100d-3b96-43df-b582-b2f66628f294 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:34.732716 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c6168-2217-4f47-96a6-f59c7a16eb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:34.733358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c6168-2217-4f47-96a6-f59c7a16eb0d None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:34.733635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c6168-2217-4f47-96a6-f59c7a16eb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:34.733905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c6168-2217-4f47-96a6-f59c7a16eb0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:34.734412 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3100d-3b96-43df-b582-b2f66628f294 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:34.734762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3100d-3b96-43df-b582-b2f66628f294 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:34.735499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3100d-3b96-43df-b582-b2f66628f294 None admin] RBAC: Adding query filter params (role.id=d949d82256654aa9b25ca259d33df4c3, scope.project.id=1a0e34213bab467880b704e894812e37, user.id=61066d74ba554ad286195a8631d292e4) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:34.736052 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3100d-3b96-43df-b582-b2f66628f294 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:34.737505 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3100d-3b96-43df-b582-b2f66628f294 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:34.751069 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 80/160] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:34 2022] GET /identity/v3/role_assignments?user.id=61066d74ba554ad286195a8631d292e4&scope.project.id=1a0e34213bab467880b704e894812e37&role.id=d949d82256654aa9b25ca259d33df4c3 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:34.751783 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3100d-3b96-43df-b582-b2f66628f294 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:34.760988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c6168-2217-4f47-96a6-f59c7a16eb0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-866c6168-2217-4f47-96a6-f59c7a16eb0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:34.771565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:34.772625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:34.773415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:34.773415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:34.773415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:34.773415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:34.773415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:34.773415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:34.773415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:34.773415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:34.773415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:34.773415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:34.773415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:44:34.773415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:34.775616 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 81/161] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:44:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:44:34.782027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c6168-2217-4f47-96a6-f59c7a16eb0d None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:34.808387 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:34.984655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3100d-3b96-43df-b582-b2f66628f294 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:35.002359 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c6168-2217-4f47-96a6-f59c7a16eb0d None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:35.043252 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208034b-bdeb-473d-a8ce-5f618ad34952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:35.043886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208034b-bdeb-473d-a8ce-5f618ad34952 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:35.044169 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208034b-bdeb-473d-a8ce-5f618ad34952 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:35.044442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208034b-bdeb-473d-a8ce-5f618ad34952 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:35.045552 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208034b-bdeb-473d-a8ce-5f618ad34952 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:35.046004 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208034b-bdeb-473d-a8ce-5f618ad34952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:35.047538 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208034b-bdeb-473d-a8ce-5f618ad34952 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:35.059095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 82/162] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:44:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:35.060498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5acd6f-71ee-445d-94a3-55705bca4f33 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:35.060789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5acd6f-71ee-445d-94a3-55705bca4f33 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:35.061145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5acd6f-71ee-445d-94a3-55705bca4f33 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:35.062489 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 83/163] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:35.068833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5acd6f-71ee-445d-94a3-55705bca4f33 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:35.070888 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42cddb-6748-4b46-ac23-916d0c3b2df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:35.071663 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42cddb-6748-4b46-ac23-916d0c3b2df1 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:35.071984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42cddb-6748-4b46-ac23-916d0c3b2df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:35.072268 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42cddb-6748-4b46-ac23-916d0c3b2df1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:35.108532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42cddb-6748-4b46-ac23-916d0c3b2df1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:35.112245 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-be42cddb-6748-4b46-ac23-916d0c3b2df1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:35.115171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:35.116146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:35.117015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:35.117015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:35.117015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:35.117015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:35.117015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:35.117015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:35.117015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:35.117015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:35.117015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:35.117015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:35.117015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:35.117015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:35.120463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 81/164] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:44:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:35.126488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e96642-e0d4-4513-ae0d-dae71aacc56f None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:35.126488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e96642-e0d4-4513-ae0d-dae71aacc56f None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:35.126488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e96642-e0d4-4513-ae0d-dae71aacc56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:35.161680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-21e96642-e0d4-4513-ae0d-dae71aacc56f None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:35.162833 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-21e96642-e0d4-4513-ae0d-dae71aacc56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:35.214400 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5acd6f-71ee-445d-94a3-55705bca4f33 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:35.259852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc6cd0-3b66-4b5d-bb45-cc5c104b5859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:35.260521 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6cd0-3b66-4b5d-bb45-cc5c104b5859 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:35.260797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6cd0-3b66-4b5d-bb45-cc5c104b5859 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:35.261067 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6cd0-3b66-4b5d-bb45-cc5c104b5859 None admin] PATH_INFO: `/v3/users/61066d74ba554ad286195a8631d292e4` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:35.262709 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc6cd0-3b66-4b5d-bb45-cc5c104b5859 None admin] RBAC: Authorizing `identity:get_user(user_id=61066d74ba554ad286195a8631d292e4)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:35.264409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc6cd0-3b66-4b5d-bb45-cc5c104b5859 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:35.266197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 84/165] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:35 2022] GET /identity/v3/users/61066d74ba554ad286195a8631d292e4 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:35.266739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc6cd0-3b66-4b5d-bb45-cc5c104b5859 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:35.312127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 82/166] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:35.312905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e96642-e0d4-4513-ae0d-dae71aacc56f None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:35.336683 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:35.459591 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e96642-e0d4-4513-ae0d-dae71aacc56f None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:35.502850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:35.518450 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464e325-3ee0-40f6-8a78-de682016a254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:35.519076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e325-3ee0-40f6-8a78-de682016a254 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:35.519356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e325-3ee0-40f6-8a78-de682016a254 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:35.520225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e325-3ee0-40f6-8a78-de682016a254 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:35.523130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc6cd0-3b66-4b5d-bb45-cc5c104b5859 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:35.612820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464e325-3ee0-40f6-8a78-de682016a254 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:35.614764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464e325-3ee0-40f6-8a78-de682016a254 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:35.620662 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183e683-e391-4659-9b87-ef37821892ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:35.621304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183e683-e391-4659-9b87-ef37821892ff None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:35.621586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183e683-e391-4659-9b87-ef37821892ff None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:35.621864 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183e683-e391-4659-9b87-ef37821892ff None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:35.622546 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183e683-e391-4659-9b87-ef37821892ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:35.622851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183e683-e391-4659-9b87-ef37821892ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:35.624262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183e683-e391-4659-9b87-ef37821892ff None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:35.640501 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 85/167] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:35.641130 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:35.648522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183e683-e391-4659-9b87-ef37821892ff None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:35.755529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 83/168] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:35.761462 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464e325-3ee0-40f6-8a78-de682016a254 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:35.790763 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183e683-e391-4659-9b87-ef37821892ff None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:35.853614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7e340-0d2b-4f72-b947-7ab7c7611f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:35.854330 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e340-0d2b-4f72-b947-7ab7c7611f63 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:35.854621 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e340-0d2b-4f72-b947-7ab7c7611f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:35.854902 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e340-0d2b-4f72-b947-7ab7c7611f63 None admin] PATH_INFO: `/v3/users/ff4c484fb0f14c218e0baa6d6c4c76d5` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:35.856137 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7e340-0d2b-4f72-b947-7ab7c7611f63 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4c484fb0f14c218e0baa6d6c4c76d5)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:35.857590 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7e340-0d2b-4f72-b947-7ab7c7611f63 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:35.859478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 86/169] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:35 2022] GET /identity/v3/users/ff4c484fb0f14c218e0baa6d6c4c76d5 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:35.865872 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7e340-0d2b-4f72-b947-7ab7c7611f63 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:35.908013 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:35.934615 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464e325-3ee0-40f6-8a78-de682016a254 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:35.961914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:35.988974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7e340-0d2b-4f72-b947-7ab7c7611f63 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:36.003894 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a880aa6-3c40-4e58-849c-8ae672c461f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:36.005399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a880aa6-3c40-4e58-849c-8ae672c461f4 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:36.005873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a880aa6-3c40-4e58-849c-8ae672c461f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:36.006326 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a880aa6-3c40-4e58-849c-8ae672c461f4 None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:36.007916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a880aa6-3c40-4e58-849c-8ae672c461f4 None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:36.009930 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a880aa6-3c40-4e58-849c-8ae672c461f4 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:36.012580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 84/170] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:35 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:36.014318 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b737e5f-ca6a-4ae2-9063-925b72961bc9 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:36.014787 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b737e5f-ca6a-4ae2-9063-925b72961bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:36.015299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b737e5f-ca6a-4ae2-9063-925b72961bc9 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:36.021316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 85/171] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:36.022783 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b737e5f-ca6a-4ae2-9063-925b72961bc9 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:36.036177 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf1387-cc8a-4610-b36e-a11dc58bbd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:36.037223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf1387-cc8a-4610-b36e-a11dc58bbd7f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:36.037867 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf1387-cc8a-4610-b36e-a11dc58bbd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:36.040605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf1387-cc8a-4610-b36e-a11dc58bbd7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:36.198008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf1387-cc8a-4610-b36e-a11dc58bbd7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:36.200867 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf1387-cc8a-4610-b36e-a11dc58bbd7f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:36.249165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b737e5f-ca6a-4ae2-9063-925b72961bc9 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:36.253994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:36.334109 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2050c-3bf3-49a4-8faf-2848f0228f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:36.334728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2050c-3bf3-49a4-8faf-2848f0228f15 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:36.335009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2050c-3bf3-49a4-8faf-2848f0228f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:36.335289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2050c-3bf3-49a4-8faf-2848f0228f15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:36.336028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2050c-3bf3-49a4-8faf-2848f0228f15 None admin] RBAC: Adding query filter params (role.id=af21992d300b4bb3acb7b7f5f5b04252, scope.project.id=1a0e34213bab467880b704e894812e37, user.id=61066d74ba554ad286195a8631d292e4) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:36.336333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2050c-3bf3-49a4-8faf-2848f0228f15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:36.337763 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2050c-3bf3-49a4-8faf-2848f0228f15 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:36.354083 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 86/172] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:36 2022] GET /identity/v3/role_assignments?user.id=61066d74ba554ad286195a8631d292e4&scope.project.id=1a0e34213bab467880b704e894812e37&role.id=af21992d300b4bb3acb7b7f5f5b04252 => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:36.355318 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bccf6b-beb2-46bf-88c5-b20f7f552287 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:36.355602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bccf6b-beb2-46bf-88c5-b20f7f552287 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:36.355896 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bccf6b-beb2-46bf-88c5-b20f7f552287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:36.357593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 87/173] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:36.363272 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf1387-cc8a-4610-b36e-a11dc58bbd7f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:36.397928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-40bccf6b-beb2-46bf-88c5-b20f7f552287 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:36.399154 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-40bccf6b-beb2-46bf-88c5-b20f7f552287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:36.505561 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:36.577361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 87/174] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:36.578238 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bccf6b-beb2-46bf-88c5-b20f7f552287 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:36.626030 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf1387-cc8a-4610-b36e-a11dc58bbd7f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:36.685873 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:36.707763 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dea97e-eea5-4718-a0a8-351afa084c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:36.708448 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea97e-eea5-4718-a0a8-351afa084c14 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:36.708726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea97e-eea5-4718-a0a8-351afa084c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:36.708993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea97e-eea5-4718-a0a8-351afa084c14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:36.721602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bccf6b-beb2-46bf-88c5-b20f7f552287 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:36.730492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dea97e-eea5-4718-a0a8-351afa084c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-66dea97e-eea5-4718-a0a8-351afa084c14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:36.735331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:36.736229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:36.737041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:36.737041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:36.737041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:36.737041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:36.737041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:36.737041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:36.737041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:36.737041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:36.737041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:36.737041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:36.737041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:36.737041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:36.739526 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 88/175] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:36.749276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dea97e-eea5-4718-a0a8-351afa084c14 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:36.797192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca593a-c469-4618-8b65-a674039a8765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:36.797835 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca593a-c469-4618-8b65-a674039a8765 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:36.798110 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca593a-c469-4618-8b65-a674039a8765 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:36.798421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca593a-c469-4618-8b65-a674039a8765 None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:36.800276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca593a-c469-4618-8b65-a674039a8765 None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:36.801786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca593a-c469-4618-8b65-a674039a8765 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:36.804554 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 88/176] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:36 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:36.810444 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca593a-c469-4618-8b65-a674039a8765 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:36.888678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:36.938841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dea97e-eea5-4718-a0a8-351afa084c14 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:36.961665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca593a-c469-4618-8b65-a674039a8765 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:36.989803 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b3421-d3c3-4d64-a8e9-cccb53332dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:36.990835 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b3421-d3c3-4d64-a8e9-cccb53332dea None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:36.991550 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b3421-d3c3-4d64-a8e9-cccb53332dea None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:36.992005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b3421-d3c3-4d64-a8e9-cccb53332dea None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:36.993377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b3421-d3c3-4d64-a8e9-cccb53332dea None admin] RBAC: Adding query filter params (name=member) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:36.993851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b3421-d3c3-4d64-a8e9-cccb53332dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:36.995386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b3421-d3c3-4d64-a8e9-cccb53332dea None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:37.006045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 89/177] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:37.006729 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104f2d5-f7e7-432f-959d-88a5d08520b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:37.007444 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104f2d5-f7e7-432f-959d-88a5d08520b6 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:37.007792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104f2d5-f7e7-432f-959d-88a5d08520b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:37.008161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104f2d5-f7e7-432f-959d-88a5d08520b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:37.009213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104f2d5-f7e7-432f-959d-88a5d08520b6 None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=1a0e34213bab467880b704e894812e37, user.id=ff4c484fb0f14c218e0baa6d6c4c76d5) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:37.009580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104f2d5-f7e7-432f-959d-88a5d08520b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:37.011112 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104f2d5-f7e7-432f-959d-88a5d08520b6 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:37.011657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b3421-d3c3-4d64-a8e9-cccb53332dea None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:37.027857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 89/178] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:36 2022] GET /identity/v3/role_assignments?user.id=ff4c484fb0f14c218e0baa6d6c4c76d5&scope.project.id=1a0e34213bab467880b704e894812e37&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:37.101142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:37.154100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b3421-d3c3-4d64-a8e9-cccb53332dea None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:37.194997 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3502aa6-b398-43a3-b9df-07500320578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:37.195640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3502aa6-b398-43a3-b9df-07500320578f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:37.195943 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3502aa6-b398-43a3-b9df-07500320578f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:37.196219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3502aa6-b398-43a3-b9df-07500320578f None admin] PATH_INFO: `/v3/users/61066d74ba554ad286195a8631d292e4` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:37.197366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3502aa6-b398-43a3-b9df-07500320578f None admin] RBAC: Authorizing `identity:get_user(user_id=61066d74ba554ad286195a8631d292e4)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:37.198808 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3502aa6-b398-43a3-b9df-07500320578f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:37.200619 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 90/179] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:37 2022] GET /identity/v3/users/61066d74ba554ad286195a8631d292e4 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:37.206193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104f2d5-f7e7-432f-959d-88a5d08520b6 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:37.211789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3502aa6-b398-43a3-b9df-07500320578f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:37.334872 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104f2d5-f7e7-432f-959d-88a5d08520b6 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:37.342471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:37.368860 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939fafc-a830-4087-a97f-8251b8754eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:37.369401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939fafc-a830-4087-a97f-8251b8754eeb None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:37.369686 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939fafc-a830-4087-a97f-8251b8754eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:37.369962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939fafc-a830-4087-a97f-8251b8754eeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:37.385205 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3502aa6-b398-43a3-b9df-07500320578f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:37.402321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:37.420104 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa707bb1-8dcd-4952-a7d9-a9ffde5d5934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:37.420734 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa707bb1-8dcd-4952-a7d9-a9ffde5d5934 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:37.421021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa707bb1-8dcd-4952-a7d9-a9ffde5d5934 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:37.421300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa707bb1-8dcd-4952-a7d9-a9ffde5d5934 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:37.431760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa707bb1-8dcd-4952-a7d9-a9ffde5d5934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-fa707bb1-8dcd-4952-a7d9-a9ffde5d5934 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:37.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:37.439081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:37.440266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:37.440266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:37.440266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:37.440266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:37.440266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:37.440266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:37.440266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:37.440266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:37.440266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:37.440266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:37.440266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:37.440266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:37.440266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 91/180] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:44:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:37.440961 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939fafc-a830-4087-a97f-8251b8754eeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:37.440961 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939fafc-a830-4087-a97f-8251b8754eeb None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:37.441284 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc39e07-3f07-4575-b2a6-cc77f8b4d0f5 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:37.441994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc39e07-3f07-4575-b2a6-cc77f8b4d0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:37.442282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc39e07-3f07-4575-b2a6-cc77f8b4d0f5 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:37.443884 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 92/181] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:37.448768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f456f-963c-4f31-ac42-01b0d4889f66 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:37.449058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f456f-963c-4f31-ac42-01b0d4889f66 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:37.449337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f456f-963c-4f31-ac42-01b0d4889f66 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:37.450537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 93/182] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:37.452377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f12da0-7c8a-4f4e-bdab-a1119ab85755 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:37.452377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f12da0-7c8a-4f4e-bdab-a1119ab85755 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:37.452377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f12da0-7c8a-4f4e-bdab-a1119ab85755 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:37.453321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 94/183] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:37.454018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f12da0-7c8a-4f4e-bdab-a1119ab85755 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:37.549140 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 90/184] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:37.551004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7148a9-5121-4d89-8e47-09247f7eaa37 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:37.551289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7148a9-5121-4d89-8e47-09247f7eaa37 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:37.551570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7148a9-5121-4d89-8e47-09247f7eaa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:37.561197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f12da0-7c8a-4f4e-bdab-a1119ab85755 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:37.563132 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:37.569669 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-0b7148a9-5121-4d89-8e47-09247f7eaa37 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:37.570859 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-0b7148a9-5121-4d89-8e47-09247f7eaa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:37.595601 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf610d91-25a3-41c9-80f9-4b47ea0b4f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:37.596233 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf610d91-25a3-41c9-80f9-4b47ea0b4f05 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:37.596513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf610d91-25a3-41c9-80f9-4b47ea0b4f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:37.596785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf610d91-25a3-41c9-80f9-4b47ea0b4f05 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:37.597437 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf610d91-25a3-41c9-80f9-4b47ea0b4f05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:37.597864 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf610d91-25a3-41c9-80f9-4b47ea0b4f05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:37.599287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf610d91-25a3-41c9-80f9-4b47ea0b4f05 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:37.608584 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 95/185] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:37.609920 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6e789-ccf1-4465-939a-cc24f149e5c2 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:37.610210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6e789-ccf1-4465-939a-cc24f149e5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:37.610487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6e789-ccf1-4465-939a-cc24f149e5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:37.628292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-bbe6e789-ccf1-4465-939a-cc24f149e5c2 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:37.629953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-bbe6e789-ccf1-4465-939a-cc24f149e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:37.637128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 91/186] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:37.638411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4bb11-1b06-4fc5-a065-045068f8b80e None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:37.638697 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4bb11-1b06-4fc5-a065-045068f8b80e None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:37.638969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4bb11-1b06-4fc5-a065-045068f8b80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:37.659721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-25a4bb11-1b06-4fc5-a065-045068f8b80e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:37.661025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-25a4bb11-1b06-4fc5-a065-045068f8b80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:37.666709 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:37.706481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 96/187] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:37.716820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6e789-ccf1-4465-939a-cc24f149e5c2 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:37.733360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 92/188] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:37.740446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4bb11-1b06-4fc5-a065-045068f8b80e None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:37.807748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:37.844863 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4bb11-1b06-4fc5-a065-045068f8b80e None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:37.903396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6e789-ccf1-4465-939a-cc24f149e5c2 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:37.908599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3f60e-d019-4e8f-9f8c-ad6dbd453f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:37.909411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3f60e-d019-4e8f-9f8c-ad6dbd453f6e None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:37.909829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3f60e-d019-4e8f-9f8c-ad6dbd453f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:37.910812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3f60e-d019-4e8f-9f8c-ad6dbd453f6e None admin] PATH_INFO: `/v3/users/f80efad67d934070a5e386ffc45c0f47` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:37.926421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3f60e-d019-4e8f-9f8c-ad6dbd453f6e None admin] RBAC: Authorizing `identity:get_user(user_id=f80efad67d934070a5e386ffc45c0f47)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:37.928213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3f60e-d019-4e8f-9f8c-ad6dbd453f6e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:37.929971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 93/189] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:37 2022] GET /identity/v3/users/f80efad67d934070a5e386ffc45c0f47 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:37.930816 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3f60e-d019-4e8f-9f8c-ad6dbd453f6e None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:37.961352 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d425da-95f8-4e80-a700-b170bb8f2f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:37.963209 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d425da-95f8-4e80-a700-b170bb8f2f6d None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:37.963712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d425da-95f8-4e80-a700-b170bb8f2f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:37.964434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d425da-95f8-4e80-a700-b170bb8f2f6d None admin] PATH_INFO: `/v3/projects/6844e446691445fd84b38e2cd652828a` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:37.966007 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d425da-95f8-4e80-a700-b170bb8f2f6d None admin] RBAC: Authorizing `identity:get_project(project_id=6844e446691445fd84b38e2cd652828a)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:37.968387 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d425da-95f8-4e80-a700-b170bb8f2f6d None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:37.971120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 97/190] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:37 2022] GET /identity/v3/projects/6844e446691445fd84b38e2cd652828a => generated 312 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:37.972092 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d425da-95f8-4e80-a700-b170bb8f2f6d None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:38.018078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:38.046530 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3f60e-d019-4e8f-9f8c-ad6dbd453f6e None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:38.071562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:38.083478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1111779-3d41-4558-b312-ae6bb9723ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:38.084355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1111779-3d41-4558-b312-ae6bb9723ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:38.084709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1111779-3d41-4558-b312-ae6bb9723ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:38.085340 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1111779-3d41-4558-b312-ae6bb9723ab1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:38.090417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d425da-95f8-4e80-a700-b170bb8f2f6d None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:38.098736 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1111779-3d41-4558-b312-ae6bb9723ab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-e1111779-3d41-4558-b312-ae6bb9723ab1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:38.104707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:38.108147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:38.109149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:38.109149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:38.109149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:38.109149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:38.109149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:38.109149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:38.109149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:38.109149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:38.109149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:38.109149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:38.109149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:44:38.109149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:38.109149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 94/191] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:44:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:38.109149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1111779-3d41-4558-b312-ae6bb9723ab1 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:38.130688 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699ebbd-e64e-402c-8072-c1b855ac6f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:38.131304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699ebbd-e64e-402c-8072-c1b855ac6f70 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:38.131587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699ebbd-e64e-402c-8072-c1b855ac6f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:38.131890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699ebbd-e64e-402c-8072-c1b855ac6f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:38.201564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699ebbd-e64e-402c-8072-c1b855ac6f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:38.203034 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699ebbd-e64e-402c-8072-c1b855ac6f70 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:38.207399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1111779-3d41-4558-b312-ae6bb9723ab1 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:38.236615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:38.257368 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6dfe1-6b6b-4106-8d19-3e9e87f3dda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:38.258160 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6dfe1-6b6b-4106-8d19-3e9e87f3dda9 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:38.258447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6dfe1-6b6b-4106-8d19-3e9e87f3dda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:38.258993 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6dfe1-6b6b-4106-8d19-3e9e87f3dda9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:38.259727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6dfe1-6b6b-4106-8d19-3e9e87f3dda9 None admin] RBAC: Adding query filter params (role.id=d949d82256654aa9b25ca259d33df4c3, scope.project.id=6844e446691445fd84b38e2cd652828a, user.id=61066d74ba554ad286195a8631d292e4) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:38.260073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6dfe1-6b6b-4106-8d19-3e9e87f3dda9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:38.261531 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6dfe1-6b6b-4106-8d19-3e9e87f3dda9 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:38.267439 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 95/192] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:38 2022] GET /identity/v3/role_assignments?user.id=61066d74ba554ad286195a8631d292e4&scope.project.id=6844e446691445fd84b38e2cd652828a&role.id=d949d82256654aa9b25ca259d33df4c3 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:38.268261 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6dfe1-6b6b-4106-8d19-3e9e87f3dda9 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:38.316471 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 98/193] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:38.317593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699ebbd-e64e-402c-8072-c1b855ac6f70 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:38.328399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:38.395562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6dfe1-6b6b-4106-8d19-3e9e87f3dda9 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:38.435578 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722ae98-b75c-4e91-a7bb-56012295b60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:38.436367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722ae98-b75c-4e91-a7bb-56012295b60f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:38.436473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722ae98-b75c-4e91-a7bb-56012295b60f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:38.436777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722ae98-b75c-4e91-a7bb-56012295b60f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:38.445026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699ebbd-e64e-402c-8072-c1b855ac6f70 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:38.448046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722ae98-b75c-4e91-a7bb-56012295b60f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-a722ae98-b75c-4e91-a7bb-56012295b60f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:38.453404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:38.454453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:38.455449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:38.455449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:38.455449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:38.455449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:38.455449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:38.455449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:38.455449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:38.455449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:38.455449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:38.455449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:38.455449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:38.455449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:38.455449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 96/194] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:38.455449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722ae98-b75c-4e91-a7bb-56012295b60f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:38.488782 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1be920-90ba-4e7e-91b3-3ee3de05898c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:38.489575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1be920-90ba-4e7e-91b3-3ee3de05898c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:38.489856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1be920-90ba-4e7e-91b3-3ee3de05898c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:38.490124 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1be920-90ba-4e7e-91b3-3ee3de05898c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:38.494448 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1be920-90ba-4e7e-91b3-3ee3de05898c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:38.496416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1be920-90ba-4e7e-91b3-3ee3de05898c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:38.499327 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 99/195] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:38.499327 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1be920-90ba-4e7e-91b3-3ee3de05898c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:38.502556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:38.568711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722ae98-b75c-4e91-a7bb-56012295b60f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:38.577287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:38.600745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1be920-90ba-4e7e-91b3-3ee3de05898c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:38.602136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae91a18-f7fc-499c-9c9d-48cf86e80700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:38.602748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae91a18-f7fc-499c-9c9d-48cf86e80700 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:38.603030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae91a18-f7fc-499c-9c9d-48cf86e80700 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:38.603302 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae91a18-f7fc-499c-9c9d-48cf86e80700 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:38.603998 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae91a18-f7fc-499c-9c9d-48cf86e80700 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:38.604297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae91a18-f7fc-499c-9c9d-48cf86e80700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:38.605668 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae91a18-f7fc-499c-9c9d-48cf86e80700 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:38.614143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 97/196] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:44:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:38.614761 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae91a18-f7fc-499c-9c9d-48cf86e80700 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:38.636686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5f217-0f7c-493e-96e3-02f8ee96f456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:38.637319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5f217-0f7c-493e-96e3-02f8ee96f456 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:38.637604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5f217-0f7c-493e-96e3-02f8ee96f456 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:38.637882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5f217-0f7c-493e-96e3-02f8ee96f456 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:38.639017 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5f217-0f7c-493e-96e3-02f8ee96f456 None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:38.640506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5f217-0f7c-493e-96e3-02f8ee96f456 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:38.642124 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 100/197] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:38 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:38.642859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5f217-0f7c-493e-96e3-02f8ee96f456 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:38.714088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:38.717220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae91a18-f7fc-499c-9c9d-48cf86e80700 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:38.743070 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5f217-0f7c-493e-96e3-02f8ee96f456 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:38.751113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f995f9-04e4-4b88-bed0-31ad77f7887d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:38.751738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f995f9-04e4-4b88-bed0-31ad77f7887d None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:38.752042 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f995f9-04e4-4b88-bed0-31ad77f7887d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:38.752319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f995f9-04e4-4b88-bed0-31ad77f7887d None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:38.752981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f995f9-04e4-4b88-bed0-31ad77f7887d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:38.753288 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f995f9-04e4-4b88-bed0-31ad77f7887d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:38.754707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f995f9-04e4-4b88-bed0-31ad77f7887d None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:38.763080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 98/198] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:38.763889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f995f9-04e4-4b88-bed0-31ad77f7887d None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:38.781726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f1607-97e0-42d8-bd16-e165f1111d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:38.782340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f1607-97e0-42d8-bd16-e165f1111d74 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:38.782624 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f1607-97e0-42d8-bd16-e165f1111d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:38.782901 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f1607-97e0-42d8-bd16-e165f1111d74 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:38.783549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f1607-97e0-42d8-bd16-e165f1111d74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:38.785026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f1607-97e0-42d8-bd16-e165f1111d74 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:38.795517 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:38.861290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f995f9-04e4-4b88-bed0-31ad77f7887d None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:38.893614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8561122-4213-4c53-a750-83df60b074e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:38.894820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8561122-4213-4c53-a750-83df60b074e2 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:38.895103 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8561122-4213-4c53-a750-83df60b074e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:38.895378 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8561122-4213-4c53-a750-83df60b074e2 None admin] PATH_INFO: `/v3/users/f80efad67d934070a5e386ffc45c0f47` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:38.896525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8561122-4213-4c53-a750-83df60b074e2 None admin] RBAC: Authorizing `identity:get_user(user_id=f80efad67d934070a5e386ffc45c0f47)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:38.903988 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8561122-4213-4c53-a750-83df60b074e2 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:38.903988 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 99/199] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:38 2022] GET /identity/v3/users/f80efad67d934070a5e386ffc45c0f47 => generated 283 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:38.903988 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8561122-4213-4c53-a750-83df60b074e2 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:38.927652 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 101/200] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:44:38 2022] POST /identity/v3/users => generated 297 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:44:38.928722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f1607-97e0-42d8-bd16-e165f1111d74 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:39.008169 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:39.012067 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8561122-4213-4c53-a750-83df60b074e2 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:39.041852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f1607-97e0-42d8-bd16-e165f1111d74 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:39.049540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74191071-2fa8-4725-b902-6068d37cf8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:39.050171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74191071-2fa8-4725-b902-6068d37cf8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:39.050456 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74191071-2fa8-4725-b902-6068d37cf8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:39.050796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74191071-2fa8-4725-b902-6068d37cf8d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:39.052059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74191071-2fa8-4725-b902-6068d37cf8d9 None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=23177498aced4c369ddf2b5e5acd5ca2, user.id=f80efad67d934070a5e386ffc45c0f47) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:39.052376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74191071-2fa8-4725-b902-6068d37cf8d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:39.053880 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74191071-2fa8-4725-b902-6068d37cf8d9 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:39.064167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 100/201] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:38 2022] GET /identity/v3/role_assignments?user.id=f80efad67d934070a5e386ffc45c0f47&scope.project.id=23177498aced4c369ddf2b5e5acd5ca2&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:39.065112 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74191071-2fa8-4725-b902-6068d37cf8d9 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:39.076771 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:39.086527 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b34272-a39f-4cd3-9cb3-cc97b8aeec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:39.087187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34272-a39f-4cd3-9cb3-cc97b8aeec33 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:39.087474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34272-a39f-4cd3-9cb3-cc97b8aeec33 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:39.092613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34272-a39f-4cd3-9cb3-cc97b8aeec33 None admin] PATH_INFO: `/v3/users/f3417c98dfa945a68bf21c711d73d5ac` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:39.092613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b34272-a39f-4cd3-9cb3-cc97b8aeec33 None admin] RBAC: Authorizing `identity:get_user(user_id=f3417c98dfa945a68bf21c711d73d5ac)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:39.092613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b34272-a39f-4cd3-9cb3-cc97b8aeec33 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:39.092613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 102/202] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:38 2022] GET /identity/v3/users/f3417c98dfa945a68bf21c711d73d5ac => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:39.098865 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b34272-a39f-4cd3-9cb3-cc97b8aeec33 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:39.210204 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74191071-2fa8-4725-b902-6068d37cf8d9 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:39.248076 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b34272-a39f-4cd3-9cb3-cc97b8aeec33 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:39.257303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ebf34-7f14-4986-bcfa-c64f510446df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:39.258977 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ebf34-7f14-4986-bcfa-c64f510446df None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:39.259210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ebf34-7f14-4986-bcfa-c64f510446df None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:39.259494 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ebf34-7f14-4986-bcfa-c64f510446df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:39.296622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae573409-7351-40c7-b6c2-77afb2b6db8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:39.298099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae573409-7351-40c7-b6c2-77afb2b6db8e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:39.298652 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae573409-7351-40c7-b6c2-77afb2b6db8e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:39.299168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae573409-7351-40c7-b6c2-77afb2b6db8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:39.314133 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:39.375938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ebf34-7f14-4986-bcfa-c64f510446df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:39.378164 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ebf34-7f14-4986-bcfa-c64f510446df None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:39.392419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:39.399982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae573409-7351-40c7-b6c2-77afb2b6db8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:39.401611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae573409-7351-40c7-b6c2-77afb2b6db8e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:39.498552 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 101/203] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:39.505201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ebf34-7f14-4986-bcfa-c64f510446df None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:39.506823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 103/204] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 13:44:39.526100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae573409-7351-40c7-b6c2-77afb2b6db8e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:39.616761 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:39.629084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:39.635613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae573409-7351-40c7-b6c2-77afb2b6db8e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:39.680219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f479ac-c8b6-4be6-9053-31a0fac2914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:39.680870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f479ac-c8b6-4be6-9053-31a0fac2914f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:39.681153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f479ac-c8b6-4be6-9053-31a0fac2914f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:39.681427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f479ac-c8b6-4be6-9053-31a0fac2914f None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:39.685601 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f479ac-c8b6-4be6-9053-31a0fac2914f None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:39.687097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f479ac-c8b6-4be6-9053-31a0fac2914f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:39.688849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 104/205] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:39 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:39.697164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f479ac-c8b6-4be6-9053-31a0fac2914f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:39.709805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ebf34-7f14-4986-bcfa-c64f510446df None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:39.778831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cad07-2225-4a67-b04c-1ad2abfdab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:39.779402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cad07-2225-4a67-b04c-1ad2abfdab64 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:39.779682 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cad07-2225-4a67-b04c-1ad2abfdab64 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:39.779981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cad07-2225-4a67-b04c-1ad2abfdab64 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:39.781165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cad07-2225-4a67-b04c-1ad2abfdab64 None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:39.782624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cad07-2225-4a67-b04c-1ad2abfdab64 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:39.791796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 102/206] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:39 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:39.798464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cad07-2225-4a67-b04c-1ad2abfdab64 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:39.889964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f479ac-c8b6-4be6-9053-31a0fac2914f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:39.958580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55c1b9-4662-443c-ab38-549efeed4053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:39.959188 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55c1b9-4662-443c-ab38-549efeed4053 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:39.959470 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55c1b9-4662-443c-ab38-549efeed4053 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:39.959743 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55c1b9-4662-443c-ab38-549efeed4053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:39.960495 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55c1b9-4662-443c-ab38-549efeed4053 None admin] RBAC: Adding query filter params (role.id=1166805423244a648aaaf22296ce0f52, scope.project.id=1a0e34213bab467880b704e894812e37, user.id=f3417c98dfa945a68bf21c711d73d5ac) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:39.960807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55c1b9-4662-443c-ab38-549efeed4053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:39.962244 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55c1b9-4662-443c-ab38-549efeed4053 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:39.966192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cad07-2225-4a67-b04c-1ad2abfdab64 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:39.984025 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 105/207] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:39 2022] GET /identity/v3/role_assignments?user.id=f3417c98dfa945a68bf21c711d73d5ac&scope.project.id=1a0e34213bab467880b704e894812e37&role.id=1166805423244a648aaaf22296ce0f52 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:40.014571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:40.022155 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527916d1-70f5-4917-9ed0-616e921cd8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:40.022790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527916d1-70f5-4917-9ed0-616e921cd8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:40.023153 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527916d1-70f5-4917-9ed0-616e921cd8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:40.023429 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527916d1-70f5-4917-9ed0-616e921cd8c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:40.024284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527916d1-70f5-4917-9ed0-616e921cd8c1 None admin] RBAC: Adding query filter params (role.id=af21992d300b4bb3acb7b7f5f5b04252, scope.project.id=23177498aced4c369ddf2b5e5acd5ca2, user.id=f80efad67d934070a5e386ffc45c0f47) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:40.030390 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527916d1-70f5-4917-9ed0-616e921cd8c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:40.030390 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527916d1-70f5-4917-9ed0-616e921cd8c1 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:40.037005 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 103/208] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:39 2022] GET /identity/v3/role_assignments?user.id=f80efad67d934070a5e386ffc45c0f47&scope.project.id=23177498aced4c369ddf2b5e5acd5ca2&role.id=af21992d300b4bb3acb7b7f5f5b04252 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:41.185050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e81d5-1336-453f-b84b-fd42172e622d None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:41.186014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e81d5-1336-453f-b84b-fd42172e622d None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:41.186490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e81d5-1336-453f-b84b-fd42172e622d None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:41.188056 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 106/209] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:41.194092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ca0fb-f3d1-4d14-a30b-d4db9c7deec9 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:41.194946 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ca0fb-f3d1-4d14-a30b-d4db9c7deec9 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:41.195422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ca0fb-f3d1-4d14-a30b-d4db9c7deec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:41.214275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-c41ca0fb-f3d1-4d14-a30b-d4db9c7deec9 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:41.215781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c41ca0fb-f3d1-4d14-a30b-d4db9c7deec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:41.237699 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d50cff-e475-4ad0-b0f0-f50f45f57212 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:41.238008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d50cff-e475-4ad0-b0f0-f50f45f57212 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:41.238319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d50cff-e475-4ad0-b0f0-f50f45f57212 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:41.239773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 107/210] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:44:41.244841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6ceee-8e8b-4fff-98c3-16af68a5f1cc None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:41.245339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6ceee-8e8b-4fff-98c3-16af68a5f1cc None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:41.245778 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6ceee-8e8b-4fff-98c3-16af68a5f1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:41.266827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-29c6ceee-8e8b-4fff-98c3-16af68a5f1cc None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:41.268442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-29c6ceee-8e8b-4fff-98c3-16af68a5f1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:41.291605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 104/211] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:41.306166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:41.348746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 108/212] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:44:41.527949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5dac4-f52d-410f-8dab-ea32eef4c804 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:41.528289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5dac4-f52d-410f-8dab-ea32eef4c804 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:41.528466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5dac4-f52d-410f-8dab-ea32eef4c804 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:41.530130 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 105/213] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:41.538569 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81feab8-1a38-4e8e-89b1-908d1867cc94 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:41.538569 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81feab8-1a38-4e8e-89b1-908d1867cc94 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:41.538569 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81feab8-1a38-4e8e-89b1-908d1867cc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:41.555578 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-c81feab8-1a38-4e8e-89b1-908d1867cc94 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:41.557151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c81feab8-1a38-4e8e-89b1-908d1867cc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:41.564180 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5dac4-f52d-410f-8dab-ea32eef4c804 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:41.629264 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 109/214] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:41.668681 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81feab8-1a38-4e8e-89b1-908d1867cc94 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:41.683780 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5dac4-f52d-410f-8dab-ea32eef4c804 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:41.724242 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:41.730019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c8845-dcc3-4acb-a9cf-a749e3eec705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:41.731503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c8845-dcc3-4acb-a9cf-a749e3eec705 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:41.737886 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c8845-dcc3-4acb-a9cf-a749e3eec705 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:41.737886 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c8845-dcc3-4acb-a9cf-a749e3eec705 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:41.752563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c8845-dcc3-4acb-a9cf-a749e3eec705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-955c8845-dcc3-4acb-a9cf-a749e3eec705 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:41.762979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:41.764028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:41.765004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:41.765004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:41.765004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:41.765004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:41.765004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:41.765004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:41.765004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:41.765004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:41.765004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:41.765004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:41.765004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:41.765004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:41.773655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 106/215] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:44:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:44:41.775186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c8845-dcc3-4acb-a9cf-a749e3eec705 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:41.785742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:41.798719 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81feab8-1a38-4e8e-89b1-908d1867cc94 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:41.867026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d289267-28f4-4140-8db7-f47f3d4d7969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:41.867026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d289267-28f4-4140-8db7-f47f3d4d7969 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:41.867026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d289267-28f4-4140-8db7-f47f3d4d7969 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:41.867026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d289267-28f4-4140-8db7-f47f3d4d7969 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:41.882157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d289267-28f4-4140-8db7-f47f3d4d7969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-1d289267-28f4-4140-8db7-f47f3d4d7969 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:41.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:41.888592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:41.889398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:41.889398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:41.889398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:41.889398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:41.889398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:41.889398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:41.889398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:41.889398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:41.889398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:41.889398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:41.889398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:41.889398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:41.908206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 110/216] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:44:41.909426 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d289267-28f4-4140-8db7-f47f3d4d7969 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:41.949219 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c8845-dcc3-4acb-a9cf-a749e3eec705 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:41.986268 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243a721-784f-4878-9e07-6313a03727a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:41.986886 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243a721-784f-4878-9e07-6313a03727a5 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:41.987169 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243a721-784f-4878-9e07-6313a03727a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:41.987443 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243a721-784f-4878-9e07-6313a03727a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:41.988246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243a721-784f-4878-9e07-6313a03727a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:41.988560 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243a721-784f-4878-9e07-6313a03727a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:41.989951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243a721-784f-4878-9e07-6313a03727a5 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:41.999332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 107/217] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:42.000197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243a721-784f-4878-9e07-6313a03727a5 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:42.056550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:42.070864 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d289267-28f4-4140-8db7-f47f3d4d7969 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:42.115919 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0feffc0-af95-4e48-b3ef-9a92db6d0b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:42.115919 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feffc0-af95-4e48-b3ef-9a92db6d0b56 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:42.116361 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feffc0-af95-4e48-b3ef-9a92db6d0b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:42.116763 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feffc0-af95-4e48-b3ef-9a92db6d0b56 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:42.117776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feffc0-af95-4e48-b3ef-9a92db6d0b56 None admin] RBAC: Adding query filter params (name=member) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:42.118286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feffc0-af95-4e48-b3ef-9a92db6d0b56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:42.118609 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243a721-784f-4878-9e07-6313a03727a5 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:42.120725 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feffc0-af95-4e48-b3ef-9a92db6d0b56 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:42.131473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 111/218] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:42.132806 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0feffc0-af95-4e48-b3ef-9a92db6d0b56 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:42.155902 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:42.173398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720e8d0-d0e8-485b-ae53-a04cffc4c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:42.176454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720e8d0-d0e8-485b-ae53-a04cffc4c218 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:42.176739 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720e8d0-d0e8-485b-ae53-a04cffc4c218 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:42.177026 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720e8d0-d0e8-485b-ae53-a04cffc4c218 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:42.178379 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720e8d0-d0e8-485b-ae53-a04cffc4c218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:42.179835 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720e8d0-d0e8-485b-ae53-a04cffc4c218 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:42.181649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 108/219] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:42.182673 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c03feb-15f6-4173-af21-09fc220a2fd2 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:42.183050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c03feb-15f6-4173-af21-09fc220a2fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:42.183338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c03feb-15f6-4173-af21-09fc220a2fd2 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:42.184611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 109/220] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:42.189006 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c03feb-15f6-4173-af21-09fc220a2fd2 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:42.256236 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0feffc0-af95-4e48-b3ef-9a92db6d0b56 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:42.290518 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d22d3f-ed4f-47a2-ad3a-6de068cfe89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:42.291153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d22d3f-ed4f-47a2-ad3a-6de068cfe89c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:42.291438 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d22d3f-ed4f-47a2-ad3a-6de068cfe89c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:42.291712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d22d3f-ed4f-47a2-ad3a-6de068cfe89c None admin] PATH_INFO: `/v3/users/f80efad67d934070a5e386ffc45c0f47` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:42.292380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c03feb-15f6-4173-af21-09fc220a2fd2 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:42.292874 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d22d3f-ed4f-47a2-ad3a-6de068cfe89c None admin] RBAC: Authorizing `identity:get_user(user_id=f80efad67d934070a5e386ffc45c0f47)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:42.294330 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d22d3f-ed4f-47a2-ad3a-6de068cfe89c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:42.296122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 112/221] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:42 2022] GET /identity/v3/users/f80efad67d934070a5e386ffc45c0f47 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:42.296698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d22d3f-ed4f-47a2-ad3a-6de068cfe89c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:42.310284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:42.330329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6739771-ba59-42ca-9b27-72732cdc4b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:42.330973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6739771-ba59-42ca-9b27-72732cdc4b5f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:42.331257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6739771-ba59-42ca-9b27-72732cdc4b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:42.331534 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6739771-ba59-42ca-9b27-72732cdc4b5f None admin] PATH_INFO: `/v3/users/f39c96aeca3a4794a8d7d370a510f0ec` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:42.346071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6739771-ba59-42ca-9b27-72732cdc4b5f None admin] RBAC: Authorizing `identity:get_user(user_id=f39c96aeca3a4794a8d7d370a510f0ec)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:42.347527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6739771-ba59-42ca-9b27-72732cdc4b5f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:42.349268 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 110/222] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:42 2022] GET /identity/v3/users/f39c96aeca3a4794a8d7d370a510f0ec => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:42.355390 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0dede-549c-489b-895e-97436f2be288 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:42.355676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0dede-549c-489b-895e-97436f2be288 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:42.355973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0dede-549c-489b-895e-97436f2be288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:42.374301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-dde0dede-549c-489b-895e-97436f2be288 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:42.375502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-dde0dede-549c-489b-895e-97436f2be288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:42.382129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:42.403076 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d22d3f-ed4f-47a2-ad3a-6de068cfe89c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:42.437794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0b9d2-2331-495e-b908-4437f7725a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:42.438400 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0b9d2-2331-495e-b908-4437f7725a67 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:42.438680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0b9d2-2331-495e-b908-4437f7725a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:42.438956 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0b9d2-2331-495e-b908-4437f7725a67 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:42.439605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0b9d2-2331-495e-b908-4437f7725a67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:42.441299 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0b9d2-2331-495e-b908-4437f7725a67 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:42.444843 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 111/223] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:42.445686 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0dede-549c-489b-895e-97436f2be288 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:42.551661 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 113/224] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:44:42 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:44:42.552491 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0b9d2-2331-495e-b908-4437f7725a67 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:42.581407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0dede-549c-489b-895e-97436f2be288 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:42.584092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:42.633548 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3fbf0-a7c6-4ed9-a2de-9be8f7b245a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:42.634476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3fbf0-a7c6-4ed9-a2de-9be8f7b245a6 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:42.634807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3fbf0-a7c6-4ed9-a2de-9be8f7b245a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:42.635084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3fbf0-a7c6-4ed9-a2de-9be8f7b245a6 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:42.636318 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3fbf0-a7c6-4ed9-a2de-9be8f7b245a6 None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:42.638525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3fbf0-a7c6-4ed9-a2de-9be8f7b245a6 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:42.645371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 112/225] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:42 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:42.647953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3fbf0-a7c6-4ed9-a2de-9be8f7b245a6 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:42.698040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0b9d2-2331-495e-b908-4437f7725a67 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:42.737140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eeff79-d3ac-43ba-9052-2cf3f7b17800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:42.737761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eeff79-d3ac-43ba-9052-2cf3f7b17800 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:42.738039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eeff79-d3ac-43ba-9052-2cf3f7b17800 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:42.738494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eeff79-d3ac-43ba-9052-2cf3f7b17800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:42.741394 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:42.771113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3fbf0-a7c6-4ed9-a2de-9be8f7b245a6 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:42.817610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72be7e-7845-49f9-918e-967db3c1a3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:42.818366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72be7e-7845-49f9-918e-967db3c1a3f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:42.818610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72be7e-7845-49f9-918e-967db3c1a3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:42.818940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72be7e-7845-49f9-918e-967db3c1a3f4 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2/users/f80efad67d934070a5e386ffc45c0f47/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:42.821774 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72be7e-7845-49f9-918e-967db3c1a3f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=23177498aced4c369ddf2b5e5acd5ca2, user_id=f80efad67d934070a5e386ffc45c0f47, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:42.823139 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eeff79-d3ac-43ba-9052-2cf3f7b17800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:42.823327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72be7e-7845-49f9-918e-967db3c1a3f4 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:42.824720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eeff79-d3ac-43ba-9052-2cf3f7b17800 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:42.891100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 113/226] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:44:42 2022] PUT /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2/users/f80efad67d934070a5e386ffc45c0f47/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:44:42.891641 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72be7e-7845-49f9-918e-967db3c1a3f4 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:42.942902 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:42.950315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 114/227] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:42.958679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eeff79-d3ac-43ba-9052-2cf3f7b17800 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:43.004498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:43.075253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72be7e-7845-49f9-918e-967db3c1a3f4 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:43.075833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eeff79-d3ac-43ba-9052-2cf3f7b17800 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:43.117187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bff9d2-6009-467c-923e-2b5c998498b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:43.118047 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bff9d2-6009-467c-923e-2b5c998498b2 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:43.118417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bff9d2-6009-467c-923e-2b5c998498b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:43.118795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bff9d2-6009-467c-923e-2b5c998498b2 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:43.119852 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df2336-ab38-41c2-bd1c-3887fe14e578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:43.120274 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bff9d2-6009-467c-923e-2b5c998498b2 None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:43.120863 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df2336-ab38-41c2-bd1c-3887fe14e578 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:43.121289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df2336-ab38-41c2-bd1c-3887fe14e578 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:43.121706 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df2336-ab38-41c2-bd1c-3887fe14e578 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:43.122206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bff9d2-6009-467c-923e-2b5c998498b2 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:43.124579 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 115/228] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:42 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:43.131677 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bff9d2-6009-467c-923e-2b5c998498b2 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:43.134377 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df2336-ab38-41c2-bd1c-3887fe14e578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-28df2336-ab38-41c2-bd1c-3887fe14e578 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:43.139490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:43.140413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:43.141280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:43.141280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:43.141280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:43.141280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:43.141280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:43.141280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:43.141280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:43.141280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:43.141280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:43.141280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:43.141280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:44:43.141280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:43.143916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 114/229] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:44:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:43.154208 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df2336-ab38-41c2-bd1c-3887fe14e578 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:43.265688 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bff9d2-6009-467c-923e-2b5c998498b2 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:43.268542 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:43.313060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:43.330238 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df2336-ab38-41c2-bd1c-3887fe14e578 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:43.333537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a48f-add5-45a4-902b-dba506963ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:43.334161 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a48f-add5-45a4-902b-dba506963ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:43.334520 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a48f-add5-45a4-902b-dba506963ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:43.334806 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a48f-add5-45a4-902b-dba506963ed6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:43.335547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679a48f-add5-45a4-902b-dba506963ed6 None admin] RBAC: Adding query filter params (role.id=d949d82256654aa9b25ca259d33df4c3, scope.project.id=23177498aced4c369ddf2b5e5acd5ca2, user.id=f39c96aeca3a4794a8d7d370a510f0ec) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:43.335856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679a48f-add5-45a4-902b-dba506963ed6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:43.337313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679a48f-add5-45a4-902b-dba506963ed6 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:43.350109 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 116/230] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:43 2022] GET /identity/v3/role_assignments?user.id=f39c96aeca3a4794a8d7d370a510f0ec&scope.project.id=23177498aced4c369ddf2b5e5acd5ca2&role.id=d949d82256654aa9b25ca259d33df4c3 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:43.390868 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0920f-a3c3-4471-b591-ec7890d3b378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:43.391552 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0920f-a3c3-4471-b591-ec7890d3b378 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:43.391773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0920f-a3c3-4471-b591-ec7890d3b378 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:43.392070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0920f-a3c3-4471-b591-ec7890d3b378 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:43.392744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0920f-a3c3-4471-b591-ec7890d3b378 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:43.393049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0920f-a3c3-4471-b591-ec7890d3b378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:43.395180 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0920f-a3c3-4471-b591-ec7890d3b378 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:43.408837 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 115/231] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:44:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:43.417052 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a48f-add5-45a4-902b-dba506963ed6 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:43.584275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a48f-add5-45a4-902b-dba506963ed6 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:43.634582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aae55e-a364-4ebc-9b9d-245dd1f00f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:43.635216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aae55e-a364-4ebc-9b9d-245dd1f00f39 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:43.635494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aae55e-a364-4ebc-9b9d-245dd1f00f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:43.635761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aae55e-a364-4ebc-9b9d-245dd1f00f39 None admin] PATH_INFO: `/v3/users/f80efad67d934070a5e386ffc45c0f47` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:43.636915 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aae55e-a364-4ebc-9b9d-245dd1f00f39 None admin] RBAC: Authorizing `identity:get_user(user_id=f80efad67d934070a5e386ffc45c0f47)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:43.638350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aae55e-a364-4ebc-9b9d-245dd1f00f39 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:43.639929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 117/232] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:43 2022] GET /identity/v3/users/f80efad67d934070a5e386ffc45c0f47 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:43.645709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0920f-a3c3-4471-b591-ec7890d3b378 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:43.832858 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0920f-a3c3-4471-b591-ec7890d3b378 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:43.883452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace0ffe-0e13-4ad5-8afb-3bbab1fe08e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:43.884722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace0ffe-0e13-4ad5-8afb-3bbab1fe08e0 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:43.885203 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace0ffe-0e13-4ad5-8afb-3bbab1fe08e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:43.885700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace0ffe-0e13-4ad5-8afb-3bbab1fe08e0 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:43.887070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace0ffe-0e13-4ad5-8afb-3bbab1fe08e0 None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:43.888782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace0ffe-0e13-4ad5-8afb-3bbab1fe08e0 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:43.890618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 116/233] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:43 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:43.896934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aae55e-a364-4ebc-9b9d-245dd1f00f39 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:43.958443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:44.067177 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aae55e-a364-4ebc-9b9d-245dd1f00f39 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:44.115928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225a328-8ad5-43f3-9d4e-b01350a142ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:44.116599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225a328-8ad5-43f3-9d4e-b01350a142ba None admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:44.116878 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225a328-8ad5-43f3-9d4e-b01350a142ba None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:44.117148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225a328-8ad5-43f3-9d4e-b01350a142ba None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2/users/f80efad67d934070a5e386ffc45c0f47/roles/af21992d300b4bb3acb7b7f5f5b04252` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:44.120641 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225a328-8ad5-43f3-9d4e-b01350a142ba None admin] RBAC: Authorizing `identity:create_grant(project_id=23177498aced4c369ddf2b5e5acd5ca2, user_id=f80efad67d934070a5e386ffc45c0f47, role_id=af21992d300b4bb3acb7b7f5f5b04252)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:44.122075 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225a328-8ad5-43f3-9d4e-b01350a142ba None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:44.233630 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 118/234] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:44:43 2022] PUT /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2/users/f80efad67d934070a5e386ffc45c0f47/roles/af21992d300b4bb3acb7b7f5f5b04252 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:44:44.940781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06677999-a1d3-4757-b441-2d3e1cd41d68 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:44.940781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06677999-a1d3-4757-b441-2d3e1cd41d68 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:44.940781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06677999-a1d3-4757-b441-2d3e1cd41d68 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:44.940781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 117/235] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:44.947800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3e92-2b09-4304-b55d-812e79209154 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:44.948779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3e92-2b09-4304-b55d-812e79209154 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:44.949374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3e92-2b09-4304-b55d-812e79209154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:44.972740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-b16c3e92-2b09-4304-b55d-812e79209154 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:44.974276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b16c3e92-2b09-4304-b55d-812e79209154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:45.034492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9156f-5a1f-43b3-9b63-477719a63426 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:45.035202 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9156f-5a1f-43b3-9b63-477719a63426 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:45.035681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9156f-5a1f-43b3-9b63-477719a63426 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:45.037254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 118/236] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:44:45.042310 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc3550-26e4-4f9a-92a3-0d5600929b76 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:45.042907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc3550-26e4-4f9a-92a3-0d5600929b76 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:45.043400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc3550-26e4-4f9a-92a3-0d5600929b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:45.068923 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-abcc3550-26e4-4f9a-92a3-0d5600929b76 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:45.070259 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-abcc3550-26e4-4f9a-92a3-0d5600929b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:45.089941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 119/237] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:45.117535 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:45.203996 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 119/238] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:44:45.367973 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c3e92-2b09-4304-b55d-812e79209154 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:45.385181 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cadb59-5aba-434b-bfda-ea2ea41bdda8 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:45.385483 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cadb59-5aba-434b-bfda-ea2ea41bdda8 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:45.385753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cadb59-5aba-434b-bfda-ea2ea41bdda8 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:45.387109 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 120/239] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:44:45.398335 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:45.399476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba5f21-bd3c-41cb-8aff-0dfaa783393d None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:45.399766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba5f21-bd3c-41cb-8aff-0dfaa783393d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:45.400086 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba5f21-bd3c-41cb-8aff-0dfaa783393d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:45.440048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-8aba5f21-bd3c-41cb-8aff-0dfaa783393d None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:45.442395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-8aba5f21-bd3c-41cb-8aff-0dfaa783393d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:45.536325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c3e92-2b09-4304-b55d-812e79209154 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:45.568186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 121/240] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:44:45.569387 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba5f21-bd3c-41cb-8aff-0dfaa783393d None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:45.587016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8ca5d-1342-4d22-89ba-9cc3e393f2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:45.587668 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8ca5d-1342-4d22-89ba-9cc3e393f2ab None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:45.587974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8ca5d-1342-4d22-89ba-9cc3e393f2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:45.588254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8ca5d-1342-4d22-89ba-9cc3e393f2ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:45.608926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8ca5d-1342-4d22-89ba-9cc3e393f2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-b4f8ca5d-1342-4d22-89ba-9cc3e393f2ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:45.615099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:45.616006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:45.617403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:45.617403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:45.617403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:45.617403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:45.617403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:45.617403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:45.617403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:45.617403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:45.617403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:45.617403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:45.617403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:45.617403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:45.617403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 120/241] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:45.624587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8ca5d-1342-4d22-89ba-9cc3e393f2ab None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:45.718513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:45.735812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8ca5d-1342-4d22-89ba-9cc3e393f2ab None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:45.736925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:45.776611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba5f21-bd3c-41cb-8aff-0dfaa783393d None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:45.779362 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b814845-7272-42c1-aaec-d1178a5ff5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:45.780806 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b814845-7272-42c1-aaec-d1178a5ff5bd None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:45.780806 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b814845-7272-42c1-aaec-d1178a5ff5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:45.780806 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b814845-7272-42c1-aaec-d1178a5ff5bd None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:45.781757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b814845-7272-42c1-aaec-d1178a5ff5bd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:45.781757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b814845-7272-42c1-aaec-d1178a5ff5bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:45.783073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b814845-7272-42c1-aaec-d1178a5ff5bd None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:45.792452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 121/242] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:45.797749 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b814845-7272-42c1-aaec-d1178a5ff5bd None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:45.819371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d787d-bd86-41c1-8b2e-bd9f83cf33bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:45.820444 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d787d-bd86-41c1-8b2e-bd9f83cf33bb None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:45.820940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d787d-bd86-41c1-8b2e-bd9f83cf33bb None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:45.821412 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d787d-bd86-41c1-8b2e-bd9f83cf33bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:45.822716 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d787d-bd86-41c1-8b2e-bd9f83cf33bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:45.824617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d787d-bd86-41c1-8b2e-bd9f83cf33bb None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:45.826487 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 122/243] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:45.832512 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d787d-bd86-41c1-8b2e-bd9f83cf33bb None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:45.913686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b814845-7272-42c1-aaec-d1178a5ff5bd None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:45.951299 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0622416-3045-4796-8995-da3fcadd2fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:45.951983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0622416-3045-4796-8995-da3fcadd2fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:45.952271 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0622416-3045-4796-8995-da3fcadd2fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:45.952498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0622416-3045-4796-8995-da3fcadd2fa9 None admin] PATH_INFO: `/v3/users/8618971eac114cd8a5dc4a22953f10b5` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:45.967674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0622416-3045-4796-8995-da3fcadd2fa9 None admin] RBAC: Authorizing `identity:get_user(user_id=8618971eac114cd8a5dc4a22953f10b5)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:45.968174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d787d-bd86-41c1-8b2e-bd9f83cf33bb None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:45.969187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0622416-3045-4796-8995-da3fcadd2fa9 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:45.971045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 122/244] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:45 2022] GET /identity/v3/users/8618971eac114cd8a5dc4a22953f10b5 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:45.971045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0622416-3045-4796-8995-da3fcadd2fa9 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:45.982586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:46.006261 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6850f58-e6c4-48cb-8953-29f86b351f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:46.007762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6850f58-e6c4-48cb-8953-29f86b351f3b None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:46.007762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6850f58-e6c4-48cb-8953-29f86b351f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:46.007762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6850f58-e6c4-48cb-8953-29f86b351f3b None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:46.008072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6850f58-e6c4-48cb-8953-29f86b351f3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:46.009786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6850f58-e6c4-48cb-8953-29f86b351f3b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:46.085190 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0622416-3045-4796-8995-da3fcadd2fa9 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:46.093214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 123/245] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:44:45 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:44:46.094486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c949322-71d4-4506-bc5d-6c1cc43e7670 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:46.094839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c949322-71d4-4506-bc5d-6c1cc43e7670 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:46.095169 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c949322-71d4-4506-bc5d-6c1cc43e7670 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:46.096741 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 124/246] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:46.097355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c949322-71d4-4506-bc5d-6c1cc43e7670 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:46.109380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:46.138325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b0477-33bd-44b5-81f2-0bbe5533076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:46.138985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b0477-33bd-44b5-81f2-0bbe5533076b None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:46.139272 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b0477-33bd-44b5-81f2-0bbe5533076b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:46.143896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b0477-33bd-44b5-81f2-0bbe5533076b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:46.155352 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b0477-33bd-44b5-81f2-0bbe5533076b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-8e4b0477-33bd-44b5-81f2-0bbe5533076b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:46.161710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:46.162706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:46.163511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:46.163511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:46.163511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:46.163511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:46.163511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:46.163511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:46.163511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:46.163511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:46.163511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:46.163511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:46.163511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:44:46.163511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:46.163511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 123/247] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:44:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:46.164317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972064d9-f85c-4a92-9ba2-4c58b25fae9e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:46.165317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972064d9-f85c-4a92-9ba2-4c58b25fae9e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:46.165317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972064d9-f85c-4a92-9ba2-4c58b25fae9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:46.198476 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-972064d9-f85c-4a92-9ba2-4c58b25fae9e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:46.199832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-972064d9-f85c-4a92-9ba2-4c58b25fae9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:46.245569 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c949322-71d4-4506-bc5d-6c1cc43e7670 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:46.286987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:46.290292 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be2139-6790-424c-910d-047d19d7e785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:46.290915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be2139-6790-424c-910d-047d19d7e785 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:46.291202 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be2139-6790-424c-910d-047d19d7e785 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:46.291532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be2139-6790-424c-910d-047d19d7e785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:46.301291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 124/248] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:46.301464 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972064d9-f85c-4a92-9ba2-4c58b25fae9e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:46.396135 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be2139-6790-424c-910d-047d19d7e785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:46.398491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be2139-6790-424c-910d-047d19d7e785 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:46.408830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:46.428352 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972064d9-f85c-4a92-9ba2-4c58b25fae9e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:46.482648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabac0b1-37c4-49aa-a0c8-fe9fd4868d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:46.483282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabac0b1-37c4-49aa-a0c8-fe9fd4868d6b None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:46.483567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabac0b1-37c4-49aa-a0c8-fe9fd4868d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:46.483841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabac0b1-37c4-49aa-a0c8-fe9fd4868d6b None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:46.484765 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabac0b1-37c4-49aa-a0c8-fe9fd4868d6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:46.485079 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabac0b1-37c4-49aa-a0c8-fe9fd4868d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:46.486584 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabac0b1-37c4-49aa-a0c8-fe9fd4868d6b None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:46.501295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 125/249] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:46.507485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabac0b1-37c4-49aa-a0c8-fe9fd4868d6b None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:46.551570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 125/250] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:46.557760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be2139-6790-424c-910d-047d19d7e785 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:46.584318 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:46.637446 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabac0b1-37c4-49aa-a0c8-fe9fd4868d6b None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:46.695448 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99161c49-6de8-48e5-8548-7ebdf026129e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:46.696066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99161c49-6de8-48e5-8548-7ebdf026129e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:46.696346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99161c49-6de8-48e5-8548-7ebdf026129e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:46.696620 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99161c49-6de8-48e5-8548-7ebdf026129e None admin] PATH_INFO: `/v3/users/f80efad67d934070a5e386ffc45c0f47` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:46.698397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99161c49-6de8-48e5-8548-7ebdf026129e None admin] RBAC: Authorizing `identity:get_user(user_id=f80efad67d934070a5e386ffc45c0f47)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:46.698722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be2139-6790-424c-910d-047d19d7e785 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:46.699896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99161c49-6de8-48e5-8548-7ebdf026129e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:46.701525 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 126/251] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:46 2022] GET /identity/v3/users/f80efad67d934070a5e386ffc45c0f47 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:46.704827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99161c49-6de8-48e5-8548-7ebdf026129e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:46.707938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:46.745721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d650783-393d-4698-bb26-03cda712a4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:46.745962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d650783-393d-4698-bb26-03cda712a4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:46.746174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d650783-393d-4698-bb26-03cda712a4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:46.746423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d650783-393d-4698-bb26-03cda712a4c3 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:46.747779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d650783-393d-4698-bb26-03cda712a4c3 None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:46.749444 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d650783-393d-4698-bb26-03cda712a4c3 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:46.751416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 126/252] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:46 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:46.752632 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31910-4303-4351-9f73-c923d79f6232 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:46.752918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31910-4303-4351-9f73-c923d79f6232 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:46.753190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab31910-4303-4351-9f73-c923d79f6232 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:46.760231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 127/253] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:46.761092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31910-4303-4351-9f73-c923d79f6232 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:46.834681 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99161c49-6de8-48e5-8548-7ebdf026129e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:46.860144 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:46.872204 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfc88f-c788-4e4d-b8d1-796a746e7546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:46.872905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfc88f-c788-4e4d-b8d1-796a746e7546 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:46.876293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfc88f-c788-4e4d-b8d1-796a746e7546 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:46.876293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfc88f-c788-4e4d-b8d1-796a746e7546 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:46.885306 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfc88f-c788-4e4d-b8d1-796a746e7546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-5bbfc88f-c788-4e4d-b8d1-796a746e7546 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:46.891343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:46.892369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:46.893457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:46.893457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:46.893457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:46.893457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:46.893457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:46.893457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:46.893457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:46.893457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:46.893457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:46.893457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:46.893457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:46.893457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:46.896387 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 127/254] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:46.897239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfc88f-c788-4e4d-b8d1-796a746e7546 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:46.899768 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab31910-4303-4351-9f73-c923d79f6232 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:46.945863 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563e9f1-42eb-48a4-a8cf-826eaaf6b6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:46.946877 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563e9f1-42eb-48a4-a8cf-826eaaf6b6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:46.947164 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563e9f1-42eb-48a4-a8cf-826eaaf6b6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:46.947447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563e9f1-42eb-48a4-a8cf-826eaaf6b6a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:47.004116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:47.013124 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfc88f-c788-4e4d-b8d1-796a746e7546 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:47.037445 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563e9f1-42eb-48a4-a8cf-826eaaf6b6a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:47.039215 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563e9f1-42eb-48a4-a8cf-826eaaf6b6a8 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:47.052484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aef9cd-3bb4-4e47-85bd-295a1b1b4afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:47.053558 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aef9cd-3bb4-4e47-85bd-295a1b1b4afc None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:47.054037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aef9cd-3bb4-4e47-85bd-295a1b1b4afc None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:47.054505 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aef9cd-3bb4-4e47-85bd-295a1b1b4afc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:47.055454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aef9cd-3bb4-4e47-85bd-295a1b1b4afc None admin] RBAC: Adding query filter params (role.id=1166805423244a648aaaf22296ce0f52, scope.project.id=23177498aced4c369ddf2b5e5acd5ca2, user.id=8618971eac114cd8a5dc4a22953f10b5) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:47.056133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aef9cd-3bb4-4e47-85bd-295a1b1b4afc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:47.057884 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aef9cd-3bb4-4e47-85bd-295a1b1b4afc None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:47.064155 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 128/255] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:46 2022] GET /identity/v3/role_assignments?user.id=8618971eac114cd8a5dc4a22953f10b5&scope.project.id=23177498aced4c369ddf2b5e5acd5ca2&role.id=1166805423244a648aaaf22296ce0f52 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:47.070421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab6249-9d4c-4630-9db5-7f7c4c3337dd None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:47.071076 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab6249-9d4c-4630-9db5-7f7c4c3337dd None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:47.071658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab6249-9d4c-4630-9db5-7f7c4c3337dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:47.125098 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-a4ab6249-9d4c-4630-9db5-7f7c4c3337dd None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:47.126350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a4ab6249-9d4c-4630-9db5-7f7c4c3337dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:47.160009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 128/256] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:47.161064 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563e9f1-42eb-48a4-a8cf-826eaaf6b6a8 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:47.255154 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:47.282887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563e9f1-42eb-48a4-a8cf-826eaaf6b6a8 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:47.284224 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:47.312534 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 129/257] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:47.313497 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab6249-9d4c-4630-9db5-7f7c4c3337dd None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:47.323657 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7486315-2e30-4674-8765-0966d8cf9a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:47.324307 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7486315-2e30-4674-8765-0966d8cf9a93 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:47.324587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7486315-2e30-4674-8765-0966d8cf9a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:47.324860 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7486315-2e30-4674-8765-0966d8cf9a93 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:47.325533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7486315-2e30-4674-8765-0966d8cf9a93 None admin] RBAC: Adding query filter params (name=member) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:47.325838 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7486315-2e30-4674-8765-0966d8cf9a93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:47.327686 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7486315-2e30-4674-8765-0966d8cf9a93 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:47.338124 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 129/258] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:47.343562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7486315-2e30-4674-8765-0966d8cf9a93 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:47.532049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7486315-2e30-4674-8765-0966d8cf9a93 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:47.582527 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab6249-9d4c-4630-9db5-7f7c4c3337dd None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:47.613275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d274ac-863b-439f-b79d-5afac8f9ba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:47.613934 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d274ac-863b-439f-b79d-5afac8f9ba9d None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:47.614215 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d274ac-863b-439f-b79d-5afac8f9ba9d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:47.614475 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d274ac-863b-439f-b79d-5afac8f9ba9d None admin] PATH_INFO: `/v3/users/f39c96aeca3a4794a8d7d370a510f0ec` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:47.619351 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d274ac-863b-439f-b79d-5afac8f9ba9d None admin] RBAC: Authorizing `identity:get_user(user_id=f39c96aeca3a4794a8d7d370a510f0ec)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:47.620840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d274ac-863b-439f-b79d-5afac8f9ba9d None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:47.622779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 130/259] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:47 2022] GET /identity/v3/users/f39c96aeca3a4794a8d7d370a510f0ec => generated 297 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:47.628141 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d274ac-863b-439f-b79d-5afac8f9ba9d None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:47.647117 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:47.660624 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63c3cf-21d5-497e-af9f-69fde8f36b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:47.661475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63c3cf-21d5-497e-af9f-69fde8f36b12 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:47.661757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63c3cf-21d5-497e-af9f-69fde8f36b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:47.662035 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63c3cf-21d5-497e-af9f-69fde8f36b12 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:47.664554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63c3cf-21d5-497e-af9f-69fde8f36b12 None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:47.666128 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63c3cf-21d5-497e-af9f-69fde8f36b12 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:47.668972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 130/260] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:47 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:47.674289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63c3cf-21d5-497e-af9f-69fde8f36b12 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:47.774109 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:47.832587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63c3cf-21d5-497e-af9f-69fde8f36b12 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:47.869289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76445ce3-a922-449d-8171-ac6e94c8e22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:47.869899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76445ce3-a922-449d-8171-ac6e94c8e22e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:47.870178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76445ce3-a922-449d-8171-ac6e94c8e22e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:47.870448 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76445ce3-a922-449d-8171-ac6e94c8e22e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:47.871175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76445ce3-a922-449d-8171-ac6e94c8e22e None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=23177498aced4c369ddf2b5e5acd5ca2, user.id=f80efad67d934070a5e386ffc45c0f47) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:47.871483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76445ce3-a922-449d-8171-ac6e94c8e22e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:47.872977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76445ce3-a922-449d-8171-ac6e94c8e22e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:47.880429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 131/261] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:47 2022] GET /identity/v3/role_assignments?user.id=f80efad67d934070a5e386ffc45c0f47&scope.project.id=23177498aced4c369ddf2b5e5acd5ca2&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:47.881810 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76445ce3-a922-449d-8171-ac6e94c8e22e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:47.890037 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d274ac-863b-439f-b79d-5afac8f9ba9d None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:48.017212 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e5ff7-d556-49d2-b256-d75e27a1397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:48.017987 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e5ff7-d556-49d2-b256-d75e27a1397f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:48.018152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e5ff7-d556-49d2-b256-d75e27a1397f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:48.018416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e5ff7-d556-49d2-b256-d75e27a1397f None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:48.020261 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e5ff7-d556-49d2-b256-d75e27a1397f None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:48.022197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e5ff7-d556-49d2-b256-d75e27a1397f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:48.029371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 131/262] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:47 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:48.031461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e5ff7-d556-49d2-b256-d75e27a1397f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:48.066199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76445ce3-a922-449d-8171-ac6e94c8e22e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:48.092659 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:48.156808 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53b85c-6da3-470a-a310-144506165f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:48.158973 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53b85c-6da3-470a-a310-144506165f18 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:48.159628 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53b85c-6da3-470a-a310-144506165f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:48.160766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53b85c-6da3-470a-a310-144506165f18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:48.195165 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53b85c-6da3-470a-a310-144506165f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-2a53b85c-6da3-470a-a310-144506165f18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:48.213697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:48.215640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:48.217653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:48.217653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:48.217653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:48.217653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:48.217653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:48.217653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:48.217653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:48.217653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:48.217653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:48.217653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:48.217653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:44:48.217653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:48.228847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 132/263] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:44:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:48.242071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:48.257408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53b85c-6da3-470a-a310-144506165f18 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:48.349529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e5ff7-d556-49d2-b256-d75e27a1397f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:48.422991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0962505-387c-4e00-9770-222de8fbb214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:48.424087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0962505-387c-4e00-9770-222de8fbb214 None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:48.425465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0962505-387c-4e00-9770-222de8fbb214 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:48.425902 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0962505-387c-4e00-9770-222de8fbb214 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2/users/f39c96aeca3a4794a8d7d370a510f0ec/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:48.431786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0962505-387c-4e00-9770-222de8fbb214 None admin] RBAC: Authorizing `identity:create_grant(project_id=23177498aced4c369ddf2b5e5acd5ca2, user_id=f39c96aeca3a4794a8d7d370a510f0ec, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:48.433290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0962505-387c-4e00-9770-222de8fbb214 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:48.491648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53b85c-6da3-470a-a310-144506165f18 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:48.508197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 132/264] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:44:48 2022] PUT /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2/users/f39c96aeca3a4794a8d7d370a510f0ec/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:44:48.537286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3202f5e-52ff-431c-8555-b9a323d50d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:48.537917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3202f5e-52ff-431c-8555-b9a323d50d0f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:48.538200 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3202f5e-52ff-431c-8555-b9a323d50d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:48.538535 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3202f5e-52ff-431c-8555-b9a323d50d0f None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:48.539226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3202f5e-52ff-431c-8555-b9a323d50d0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:48.539534 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3202f5e-52ff-431c-8555-b9a323d50d0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:48.541076 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3202f5e-52ff-431c-8555-b9a323d50d0f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:48.551197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 133/265] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:44:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:48.556752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0962505-387c-4e00-9770-222de8fbb214 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:48.751300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0962505-387c-4e00-9770-222de8fbb214 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:48.784718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:48.789548 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc98f26-d30b-486c-9b68-64e923e33940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:48.790209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc98f26-d30b-486c-9b68-64e923e33940 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:48.790493 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc98f26-d30b-486c-9b68-64e923e33940 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:48.790771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc98f26-d30b-486c-9b68-64e923e33940 None admin] PATH_INFO: `/v3/users/f80efad67d934070a5e386ffc45c0f47` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:48.796073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc98f26-d30b-486c-9b68-64e923e33940 None admin] RBAC: Authorizing `identity:get_user(user_id=f80efad67d934070a5e386ffc45c0f47)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:48.801882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc98f26-d30b-486c-9b68-64e923e33940 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:48.801882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 133/266] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:48 2022] GET /identity/v3/users/f80efad67d934070a5e386ffc45c0f47 => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:48.805470 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3202f5e-52ff-431c-8555-b9a323d50d0f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:48.851682 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:48.929096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3202f5e-52ff-431c-8555-b9a323d50d0f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:48.965549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542c84b-01d3-40fd-a5cd-1a1bc6fec50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:48.966535 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542c84b-01d3-40fd-a5cd-1a1bc6fec50c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:48.966966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542c84b-01d3-40fd-a5cd-1a1bc6fec50c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:48.967383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542c84b-01d3-40fd-a5cd-1a1bc6fec50c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:49.045845 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542c84b-01d3-40fd-a5cd-1a1bc6fec50c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:49.047380 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542c84b-01d3-40fd-a5cd-1a1bc6fec50c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:49.079721 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:49.153448 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94be8d7-797b-4b20-9063-32831b6702f1 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:49.153952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94be8d7-797b-4b20-9063-32831b6702f1 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:49.154025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94be8d7-797b-4b20-9063-32831b6702f1 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:49.155357 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 134/267] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:49.162417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 134/268] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:49.166694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af12d5-7a6c-410a-b094-583717751f32 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:49.167221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af12d5-7a6c-410a-b094-583717751f32 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:49.167690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af12d5-7a6c-410a-b094-583717751f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:49.167884 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542c84b-01d3-40fd-a5cd-1a1bc6fec50c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:49.199683 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-a2af12d5-7a6c-410a-b094-583717751f32 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:49.200923 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a2af12d5-7a6c-410a-b094-583717751f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:49.327211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 135/269] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:49.328988 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bf962-b2ab-493f-8017-003a017b694e None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:49.329281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bf962-b2ab-493f-8017-003a017b694e None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:49.329562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bf962-b2ab-493f-8017-003a017b694e None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:49.331744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 136/270] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:49.332964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05649c94-eba3-4840-a21d-51c17d07a77c None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:49.333249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05649c94-eba3-4840-a21d-51c17d07a77c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:49.333534 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05649c94-eba3-4840-a21d-51c17d07a77c None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:49.334919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 137/271] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:49.340274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8d5b5-0e16-4f64-8920-7421a35de170 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:49.340817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8d5b5-0e16-4f64-8920-7421a35de170 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:49.341098 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8d5b5-0e16-4f64-8920-7421a35de170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:49.353174 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542c84b-01d3-40fd-a5cd-1a1bc6fec50c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:49.368730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-3ce8d5b5-0e16-4f64-8920-7421a35de170 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:49.370664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-3ce8d5b5-0e16-4f64-8920-7421a35de170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:49.390061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:49.395154 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879eab8-ca6f-425b-bbcf-daf7ee10de13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:49.395782 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879eab8-ca6f-425b-bbcf-daf7ee10de13 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:49.402649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879eab8-ca6f-425b-bbcf-daf7ee10de13 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:49.402649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879eab8-ca6f-425b-bbcf-daf7ee10de13 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:49.402649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879eab8-ca6f-425b-bbcf-daf7ee10de13 None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:49.402649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879eab8-ca6f-425b-bbcf-daf7ee10de13 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:49.402649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 135/272] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:49 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:49.402649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265789e-f03e-4ebf-9596-c5294e9541ff None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:49.403102 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265789e-f03e-4ebf-9596-c5294e9541ff None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:49.403324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265789e-f03e-4ebf-9596-c5294e9541ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:49.424529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1265789e-f03e-4ebf-9596-c5294e9541ff None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:49.426427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1265789e-f03e-4ebf-9596-c5294e9541ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:49.455935 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 138/273] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:49.457062 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8d5b5-0e16-4f64-8920-7421a35de170 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:49.498964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 136/274] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:49.576174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:49.633239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8d5b5-0e16-4f64-8920-7421a35de170 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:49.677414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265789e-f03e-4ebf-9596-c5294e9541ff None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:49.682000 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5323a-babb-4aff-bea7-920fcd1f4ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:49.682622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5323a-babb-4aff-bea7-920fcd1f4ead None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:49.682908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5323a-babb-4aff-bea7-920fcd1f4ead None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:49.683187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5323a-babb-4aff-bea7-920fcd1f4ead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:49.683945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5323a-babb-4aff-bea7-920fcd1f4ead None admin] RBAC: Adding query filter params (role.id=af21992d300b4bb3acb7b7f5f5b04252, scope.project.id=23177498aced4c369ddf2b5e5acd5ca2, user.id=f80efad67d934070a5e386ffc45c0f47) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:49.684265 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5323a-babb-4aff-bea7-920fcd1f4ead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:49.685710 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5323a-babb-4aff-bea7-920fcd1f4ead None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:49.695109 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 139/275] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:49 2022] GET /identity/v3/role_assignments?user.id=f80efad67d934070a5e386ffc45c0f47&scope.project.id=23177498aced4c369ddf2b5e5acd5ca2&role.id=af21992d300b4bb3acb7b7f5f5b04252 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:49.812823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265789e-f03e-4ebf-9596-c5294e9541ff None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:49.817345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5323a-babb-4aff-bea7-920fcd1f4ead None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:49.852483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:49.859605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41b404-d546-4200-9ff6-dbaa8e575ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:49.860300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41b404-d546-4200-9ff6-dbaa8e575ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:49.860582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41b404-d546-4200-9ff6-dbaa8e575ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:49.860859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41b404-d546-4200-9ff6-dbaa8e575ce9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:49.875133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41b404-d546-4200-9ff6-dbaa8e575ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-fb41b404-d546-4200-9ff6-dbaa8e575ce9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:49.880514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:49.881422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:49.882242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:49.882242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:49.882242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:49.882242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:49.882242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:49.882242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:49.882242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:49.882242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:49.882242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:49.882242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:49.882242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:49.882242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:49.882242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 137/276] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:44:49.882242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41b404-d546-4200-9ff6-dbaa8e575ce9 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:49.985267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5323a-babb-4aff-bea7-920fcd1f4ead None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:50.012993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41b404-d546-4200-9ff6-dbaa8e575ce9 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:50.016291 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:50.028972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73852829-47dd-48ea-bda1-5c2da0d74f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:50.029611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73852829-47dd-48ea-bda1-5c2da0d74f21 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:50.029893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73852829-47dd-48ea-bda1-5c2da0d74f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:50.030171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73852829-47dd-48ea-bda1-5c2da0d74f21 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:50.041269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73852829-47dd-48ea-bda1-5c2da0d74f21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-73852829-47dd-48ea-bda1-5c2da0d74f21 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:50.046285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:50.047157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:50.047985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:50.047985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:50.047985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:50.047985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:50.047985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:50.047985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:50.047985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:50.047985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:50.047985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:50.047985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:50.047985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:50.047985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:50.047985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 140/277] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:50.052762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73852829-47dd-48ea-bda1-5c2da0d74f21 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:50.055227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204dd1b-0af2-48fa-8f5b-af2f3ab796d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:50.055890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204dd1b-0af2-48fa-8f5b-af2f3ab796d3 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:50.056200 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204dd1b-0af2-48fa-8f5b-af2f3ab796d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:50.056478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204dd1b-0af2-48fa-8f5b-af2f3ab796d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:50.057597 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204dd1b-0af2-48fa-8f5b-af2f3ab796d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:50.059074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204dd1b-0af2-48fa-8f5b-af2f3ab796d3 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:50.060790 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 138/278] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:50.065711 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204dd1b-0af2-48fa-8f5b-af2f3ab796d3 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:50.124172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:50.164186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73852829-47dd-48ea-bda1-5c2da0d74f21 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:50.171297 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204dd1b-0af2-48fa-8f5b-af2f3ab796d3 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:50.204411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc3e52-6700-4712-89e5-89cf3b3d555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:50.205025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc3e52-6700-4712-89e5-89cf3b3d555f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:50.205308 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc3e52-6700-4712-89e5-89cf3b3d555f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:50.205576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc3e52-6700-4712-89e5-89cf3b3d555f None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:50.206240 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc3e52-6700-4712-89e5-89cf3b3d555f None admin] RBAC: Adding query filter params (name=member) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:50.206608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc3e52-6700-4712-89e5-89cf3b3d555f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:50.207733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea12c-55d6-450f-95e9-d0a8cce892ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:50.208712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc3e52-6700-4712-89e5-89cf3b3d555f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:50.208835 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea12c-55d6-450f-95e9-d0a8cce892ac None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:50.208835 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea12c-55d6-450f-95e9-d0a8cce892ac None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:50.209092 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea12c-55d6-450f-95e9-d0a8cce892ac None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:50.209707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ea12c-55d6-450f-95e9-d0a8cce892ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:50.210011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ea12c-55d6-450f-95e9-d0a8cce892ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:50.211366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ea12c-55d6-450f-95e9-d0a8cce892ac None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:50.222092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 141/279] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:50.222092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc3e52-6700-4712-89e5-89cf3b3d555f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:50.225908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 139/280] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:50.230471 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea12c-55d6-450f-95e9-d0a8cce892ac None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:50.275152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:50.333595 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc3e52-6700-4712-89e5-89cf3b3d555f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:50.338045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea12c-55d6-450f-95e9-d0a8cce892ac None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:50.359480 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:50.369619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30481320-b583-4f8e-a6d4-101b2fffe219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:50.370239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481320-b583-4f8e-a6d4-101b2fffe219 None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:50.370531 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481320-b583-4f8e-a6d4-101b2fffe219 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:50.370798 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481320-b583-4f8e-a6d4-101b2fffe219 None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:50.371445 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30481320-b583-4f8e-a6d4-101b2fffe219 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:50.372986 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30481320-b583-4f8e-a6d4-101b2fffe219 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:50.377473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b22b5e-8684-4197-963c-ab897cfcc2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:50.377473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b22b5e-8684-4197-963c-ab897cfcc2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:50.377473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b22b5e-8684-4197-963c-ab897cfcc2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:50.377473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b22b5e-8684-4197-963c-ab897cfcc2c1 None admin] PATH_INFO: `/v3/users/5a6fde905b86400c94e2354d551244c2` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:50.391423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b22b5e-8684-4197-963c-ab897cfcc2c1 None admin] RBAC: Authorizing `identity:get_user(user_id=5a6fde905b86400c94e2354d551244c2)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:50.392928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b22b5e-8684-4197-963c-ab897cfcc2c1 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:50.395163 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 140/281] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:50 2022] GET /identity/v3/users/5a6fde905b86400c94e2354d551244c2 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:50.396065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b22b5e-8684-4197-963c-ab897cfcc2c1 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:50.499908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 142/282] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:44:50 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:44:50.499908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30481320-b583-4f8e-a6d4-101b2fffe219 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:50.532739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b22b5e-8684-4197-963c-ab897cfcc2c1 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:50.575939 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d43b19-7b1e-4c11-ab71-1625f6dcfd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:50.576778 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d43b19-7b1e-4c11-ab71-1625f6dcfd7c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:50.577132 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d43b19-7b1e-4c11-ab71-1625f6dcfd7c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:50.577524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d43b19-7b1e-4c11-ab71-1625f6dcfd7c None admin] PATH_INFO: `/v3/users/8618971eac114cd8a5dc4a22953f10b5` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:50.579508 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d43b19-7b1e-4c11-ab71-1625f6dcfd7c None admin] RBAC: Authorizing `identity:get_user(user_id=8618971eac114cd8a5dc4a22953f10b5)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:50.581490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d43b19-7b1e-4c11-ab71-1625f6dcfd7c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:50.588684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 141/283] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:50 2022] GET /identity/v3/users/8618971eac114cd8a5dc4a22953f10b5 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:50.590315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d43b19-7b1e-4c11-ab71-1625f6dcfd7c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:50.639412 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30481320-b583-4f8e-a6d4-101b2fffe219 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:50.641128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:50.647798 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:50.683371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a60a46-8c9a-4831-aeb2-294a288dca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:50.684060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a60a46-8c9a-4831-aeb2-294a288dca1a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:50.684451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a60a46-8c9a-4831-aeb2-294a288dca1a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:50.684812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a60a46-8c9a-4831-aeb2-294a288dca1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:50.686082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a60a46-8c9a-4831-aeb2-294a288dca1a None admin] RBAC: Adding query filter params (role.id=d949d82256654aa9b25ca259d33df4c3, user.id=5a6fde905b86400c94e2354d551244c2, scope.system=all) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:50.688200 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a60a46-8c9a-4831-aeb2-294a288dca1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:50.690665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a60a46-8c9a-4831-aeb2-294a288dca1a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:50.700695 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 143/284] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Sep 1 13:44:50 2022] GET /identity/v3/role_assignments?user.id=5a6fde905b86400c94e2354d551244c2&scope.system=all&role.id=d949d82256654aa9b25ca259d33df4c3 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:50.720636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d43b19-7b1e-4c11-ab71-1625f6dcfd7c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:50.764989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d9417-14a9-476d-8e81-8cf5a8955afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:50.765640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d9417-14a9-476d-8e81-8cf5a8955afa None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:50.765923 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d9417-14a9-476d-8e81-8cf5a8955afa None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:50.766196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d9417-14a9-476d-8e81-8cf5a8955afa None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:50.767428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d9417-14a9-476d-8e81-8cf5a8955afa None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:50.768952 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d9417-14a9-476d-8e81-8cf5a8955afa None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:50.770979 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 142/285] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:50 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:50.777073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a60a46-8c9a-4831-aeb2-294a288dca1a None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:50.797646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056f710-2620-47ae-bfa4-52dad09ce9ca None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:50.797929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056f710-2620-47ae-bfa4-52dad09ce9ca None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:50.798206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056f710-2620-47ae-bfa4-52dad09ce9ca None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:50.799572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 143/286] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:44:50.807168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28753d-e8f1-4154-84e3-dec375e16bfb None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:50.807451 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28753d-e8f1-4154-84e3-dec375e16bfb None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:50.807727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28753d-e8f1-4154-84e3-dec375e16bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:50.831118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-0f28753d-e8f1-4154-84e3-dec375e16bfb None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:50.832401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0f28753d-e8f1-4154-84e3-dec375e16bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:50.922153 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a60a46-8c9a-4831-aeb2-294a288dca1a None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:50.932671 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 144/287] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:50.960488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d823b-69c3-46c3-8732-69fee9765251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:50.961165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d823b-69c3-46c3-8732-69fee9765251 None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:50.961446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d823b-69c3-46c3-8732-69fee9765251 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:50.961722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d823b-69c3-46c3-8732-69fee9765251 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2/users/8618971eac114cd8a5dc4a22953f10b5/roles/1166805423244a648aaaf22296ce0f52` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:50.963656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d823b-69c3-46c3-8732-69fee9765251 None admin] RBAC: Authorizing `identity:create_grant(project_id=23177498aced4c369ddf2b5e5acd5ca2, user_id=8618971eac114cd8a5dc4a22953f10b5, role_id=1166805423244a648aaaf22296ce0f52)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:50.965142 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d823b-69c3-46c3-8732-69fee9765251 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:51.046468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 144/288] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:44:50 2022] PUT /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2/users/8618971eac114cd8a5dc4a22953f10b5/roles/1166805423244a648aaaf22296ce0f52 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:44:51.317288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28753d-e8f1-4154-84e3-dec375e16bfb None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:51.369779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:51.436950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28753d-e8f1-4154-84e3-dec375e16bfb None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:51.493940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b7235-3b4e-4c77-9f3d-f0a531fd2a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:51.494588 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b7235-3b4e-4c77-9f3d-f0a531fd2a75 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:51.494871 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b7235-3b4e-4c77-9f3d-f0a531fd2a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:51.495146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b7235-3b4e-4c77-9f3d-f0a531fd2a75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:51.510557 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b7235-3b4e-4c77-9f3d-f0a531fd2a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-bc0b7235-3b4e-4c77-9f3d-f0a531fd2a75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:51.515506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:51.516415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:51.517214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:51.517214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:51.517214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:51.517214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:51.517214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:51.517214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:51.517214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:51.517214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:51.517214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:51.517214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:51.517214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:51.517214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:51.517214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 145/289] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:51.522658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d823b-69c3-46c3-8732-69fee9765251 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:51.581941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:51.701221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d823b-69c3-46c3-8732-69fee9765251 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:51.741725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad7cbe-494c-452c-81ae-89348923512c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:51.742991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad7cbe-494c-452c-81ae-89348923512c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:51.743507 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad7cbe-494c-452c-81ae-89348923512c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:51.744012 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad7cbe-494c-452c-81ae-89348923512c None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:51.745159 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad7cbe-494c-452c-81ae-89348923512c None admin] RBAC: Adding query filter params (name=member) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:51.745676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad7cbe-494c-452c-81ae-89348923512c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:51.747268 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad7cbe-494c-452c-81ae-89348923512c None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:51.757407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 145/290] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:51.764391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b7235-3b4e-4c77-9f3d-f0a531fd2a75 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:51.922074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b7235-3b4e-4c77-9f3d-f0a531fd2a75 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:51.924574 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:51.970495 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48620328-b6d3-4f60-b2ee-73737dc7f8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:51.971082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48620328-b6d3-4f60-b2ee-73737dc7f8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:51.971537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48620328-b6d3-4f60-b2ee-73737dc7f8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:51.971815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48620328-b6d3-4f60-b2ee-73737dc7f8e3 None admin] PATH_INFO: `/v3/users/f39c96aeca3a4794a8d7d370a510f0ec` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:51.974844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48620328-b6d3-4f60-b2ee-73737dc7f8e3 None admin] RBAC: Authorizing `identity:get_user(user_id=f39c96aeca3a4794a8d7d370a510f0ec)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:51.976726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48620328-b6d3-4f60-b2ee-73737dc7f8e3 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:51.978862 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 146/291] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:51 2022] GET /identity/v3/users/f39c96aeca3a4794a8d7d370a510f0ec => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:51.985287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad7cbe-494c-452c-81ae-89348923512c None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:52.127711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:52.142751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad7cbe-494c-452c-81ae-89348923512c None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:52.209604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1972b29-a960-404d-9621-ba130df095cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:52.210250 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1972b29-a960-404d-9621-ba130df095cd None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:52.210608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1972b29-a960-404d-9621-ba130df095cd None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:52.210889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1972b29-a960-404d-9621-ba130df095cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:52.352217 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1972b29-a960-404d-9621-ba130df095cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:52.353836 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1972b29-a960-404d-9621-ba130df095cd None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:52.491085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:52.509790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 146/292] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:52.520469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48620328-b6d3-4f60-b2ee-73737dc7f8e3 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:52.665896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48620328-b6d3-4f60-b2ee-73737dc7f8e3 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:52.725211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6305093-5ee0-42fd-93d6-7154e9f507cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:52.725869 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6305093-5ee0-42fd-93d6-7154e9f507cd None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:52.726149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6305093-5ee0-42fd-93d6-7154e9f507cd None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:52.726422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6305093-5ee0-42fd-93d6-7154e9f507cd None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:52.727645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6305093-5ee0-42fd-93d6-7154e9f507cd None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:52.729178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6305093-5ee0-42fd-93d6-7154e9f507cd None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:52.731847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 147/293] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:52 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:52.738445 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1972b29-a960-404d-9621-ba130df095cd None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:52.900414 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1972b29-a960-404d-9621-ba130df095cd None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:52.951458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747aeed8-30c3-4c15-8bfe-49aad3c01cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:52.952031 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747aeed8-30c3-4c15-8bfe-49aad3c01cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:52.952315 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747aeed8-30c3-4c15-8bfe-49aad3c01cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:52.952590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747aeed8-30c3-4c15-8bfe-49aad3c01cc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:52.953327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747aeed8-30c3-4c15-8bfe-49aad3c01cc3 None admin] RBAC: Adding query filter params (role.id=d949d82256654aa9b25ca259d33df4c3, scope.project.id=23177498aced4c369ddf2b5e5acd5ca2, user.id=f39c96aeca3a4794a8d7d370a510f0ec) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:52.953633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747aeed8-30c3-4c15-8bfe-49aad3c01cc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:52.955068 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747aeed8-30c3-4c15-8bfe-49aad3c01cc3 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:52.961690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 147/294] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:52 2022] GET /identity/v3/role_assignments?user.id=f39c96aeca3a4794a8d7d370a510f0ec&scope.project.id=23177498aced4c369ddf2b5e5acd5ca2&role.id=d949d82256654aa9b25ca259d33df4c3 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:53.089763 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675a322-b173-415c-8c59-0821ccedd004 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:53.090089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675a322-b173-415c-8c59-0821ccedd004 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:53.090311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675a322-b173-415c-8c59-0821ccedd004 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:53.091950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 148/295] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:53.098814 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f3953-c3df-4368-8da6-728a71c35931 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:53.099141 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f3953-c3df-4368-8da6-728a71c35931 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:53.099363 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f3953-c3df-4368-8da6-728a71c35931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:53.138913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-7a6f3953-c3df-4368-8da6-728a71c35931 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:53.140277 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7a6f3953-c3df-4368-8da6-728a71c35931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:53.227328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:53.256482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 148/296] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:53.350943 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebb63a-3e58-4c7d-bae4-d8298e9159c8 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:53.351458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebb63a-3e58-4c7d-bae4-d8298e9159c8 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:53.351934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebb63a-3e58-4c7d-bae4-d8298e9159c8 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:53.353423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 149/297] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:53.358871 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfe292-e0fc-4865-b7bc-6268fecac51b None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:53.359280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfe292-e0fc-4865-b7bc-6268fecac51b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:53.359680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfe292-e0fc-4865-b7bc-6268fecac51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:53.380630 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-42cfe292-e0fc-4865-b7bc-6268fecac51b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:53.381823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-42cfe292-e0fc-4865-b7bc-6268fecac51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:53.474178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268b23f-7968-42e4-80f8-3b4f42da6a6e None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:53.474803 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268b23f-7968-42e4-80f8-3b4f42da6a6e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:53.475267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268b23f-7968-42e4-80f8-3b4f42da6a6e None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:53.476693 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 149/298] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:53.477187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 150/299] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:53.483713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fbfdc-0637-43b0-80f3-d4cc80dc22e4 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:53.483973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fbfdc-0637-43b0-80f3-d4cc80dc22e4 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:53.484395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fbfdc-0637-43b0-80f3-d4cc80dc22e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:53.510390 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-cc3fbfdc-0637-43b0-80f3-d4cc80dc22e4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:53.511597 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-cc3fbfdc-0637-43b0-80f3-d4cc80dc22e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:53.593626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268b23f-7968-42e4-80f8-3b4f42da6a6e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:53.600120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 150/300] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:53.621857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a5cce-56f8-49da-b910-1c252d35d795 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:53.622371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a5cce-56f8-49da-b910-1c252d35d795 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:53.622795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a5cce-56f8-49da-b910-1c252d35d795 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:53.624382 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 151/301] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:44:53.629785 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14a82b-fdaf-40bc-bfcf-04fd8a09ba8d None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:53.630252 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14a82b-fdaf-40bc-bfcf-04fd8a09ba8d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:53.630670 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14a82b-fdaf-40bc-bfcf-04fd8a09ba8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:53.650579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-fc14a82b-fdaf-40bc-bfcf-04fd8a09ba8d None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:53.652139 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-fc14a82b-fdaf-40bc-bfcf-04fd8a09ba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:53.654790 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:53.709213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:53.729812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268b23f-7968-42e4-80f8-3b4f42da6a6e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:53.747136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 152/302] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:44:53.774616 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71a5b7-906e-40ef-98c4-9f4bc6115caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:53.775924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71a5b7-906e-40ef-98c4-9f4bc6115caf None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:53.776613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71a5b7-906e-40ef-98c4-9f4bc6115caf None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:53.777042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71a5b7-906e-40ef-98c4-9f4bc6115caf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:53.790094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71a5b7-906e-40ef-98c4-9f4bc6115caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-4b71a5b7-906e-40ef-98c4-9f4bc6115caf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:53.796269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:53.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:53.799080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:53.799080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:53.799080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:53.799080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:53.799080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:53.799080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:53.799080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:53.799080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:53.799080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:53.799080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:53.799080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:53.799080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:53.801275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 151/303] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:44:53.807653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14a82b-fdaf-40bc-bfcf-04fd8a09ba8d None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:53.863625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71a5b7-906e-40ef-98c4-9f4bc6115caf None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:53.942677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14a82b-fdaf-40bc-bfcf-04fd8a09ba8d None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:53.996040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f47e5-9e45-4494-882e-d7b40ecddb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:53.997084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f47e5-9e45-4494-882e-d7b40ecddb6a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:53.997564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f47e5-9e45-4494-882e-d7b40ecddb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:53.998148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f47e5-9e45-4494-882e-d7b40ecddb6a None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:53.999087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f47e5-9e45-4494-882e-d7b40ecddb6a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:53.999679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f47e5-9e45-4494-882e-d7b40ecddb6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:54.001458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f47e5-9e45-4494-882e-d7b40ecddb6a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:54.014544 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 153/304] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:54.016462 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f47e5-9e45-4494-882e-d7b40ecddb6a None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:54.021566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:54.027382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71a5b7-906e-40ef-98c4-9f4bc6115caf None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:54.068100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:54.076836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d84893-94c5-4317-ae70-24bdd0007477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:54.077474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d84893-94c5-4317-ae70-24bdd0007477 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:54.077747 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d84893-94c5-4317-ae70-24bdd0007477 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:54.078054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d84893-94c5-4317-ae70-24bdd0007477 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:54.079167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d84893-94c5-4317-ae70-24bdd0007477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:54.080637 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d84893-94c5-4317-ae70-24bdd0007477 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:54.083288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 152/305] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:54.084487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d84893-94c5-4317-ae70-24bdd0007477 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:54.150966 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f47e5-9e45-4494-882e-d7b40ecddb6a None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:54.188368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d84893-94c5-4317-ae70-24bdd0007477 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:54.191781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b79d7-8afc-49e6-adc1-cd70d9d0b9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:54.192460 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b79d7-8afc-49e6-adc1-cd70d9d0b9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:54.192743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b79d7-8afc-49e6-adc1-cd70d9d0b9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:54.193082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b79d7-8afc-49e6-adc1-cd70d9d0b9f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:54.204288 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b79d7-8afc-49e6-adc1-cd70d9d0b9f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-7d4b79d7-8afc-49e6-adc1-cd70d9d0b9f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:54.210218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:54.211146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:54.211991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:54.211991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:54.211991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:54.211991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:54.211991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:54.211991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:54.211991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:54.211991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:54.211991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:54.211991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:54.211991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:54.211991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:54.211991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 154/306] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:54.212702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b79d7-8afc-49e6-adc1-cd70d9d0b9f0 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:54.224805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a276ca7-6f4a-4b89-a5de-35b9bed83149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:54.225432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a276ca7-6f4a-4b89-a5de-35b9bed83149 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:54.225712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a276ca7-6f4a-4b89-a5de-35b9bed83149 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:54.225983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a276ca7-6f4a-4b89-a5de-35b9bed83149 None admin] PATH_INFO: `/v3/users/94516e960dd246cb88a3040b9a04e5ef` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:54.241026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a276ca7-6f4a-4b89-a5de-35b9bed83149 None admin] RBAC: Authorizing `identity:get_user(user_id=94516e960dd246cb88a3040b9a04e5ef)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:54.242510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a276ca7-6f4a-4b89-a5de-35b9bed83149 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:54.244184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 153/307] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:54 2022] GET /identity/v3/users/94516e960dd246cb88a3040b9a04e5ef => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:54.247777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a276ca7-6f4a-4b89-a5de-35b9bed83149 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:54.284442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:54.321911 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:54.333188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b79d7-8afc-49e6-adc1-cd70d9d0b9f0 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:54.365820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a276ca7-6f4a-4b89-a5de-35b9bed83149 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:54.381076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0249ec-e395-4620-a7ff-bf80ebd15e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:54.381727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0249ec-e395-4620-a7ff-bf80ebd15e24 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:54.382035 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0249ec-e395-4620-a7ff-bf80ebd15e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:54.382308 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0249ec-e395-4620-a7ff-bf80ebd15e24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:54.397052 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0249ec-e395-4620-a7ff-bf80ebd15e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-1f0249ec-e395-4620-a7ff-bf80ebd15e24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:54.404915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:54.406023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:54.406883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:54.406883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:54.406883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:54.406883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:54.406883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:54.406883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:54.406883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:54.406883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:54.406883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:54.406883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:54.406883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:54.406883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:54.406883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 155/308] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:54.407666 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0249ec-e395-4620-a7ff-bf80ebd15e24 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:54.417934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6732ff0-0ddd-4039-bba6-7e1dd896175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:54.418547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6732ff0-0ddd-4039-bba6-7e1dd896175d None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:54.418836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6732ff0-0ddd-4039-bba6-7e1dd896175d None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:54.419116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6732ff0-0ddd-4039-bba6-7e1dd896175d None admin] PATH_INFO: `/v3/groups` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:54.419753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6732ff0-0ddd-4039-bba6-7e1dd896175d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:54.421236 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6732ff0-0ddd-4039-bba6-7e1dd896175d None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:54.488838 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 154/309] 10.222.0.64 () {60 vars in 1134 bytes} [Thu Sep 1 13:44:54 2022] POST /identity/v3/groups => generated 229 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:44:54.492923 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6732ff0-0ddd-4039-bba6-7e1dd896175d None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:54.521911 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0249ec-e395-4620-a7ff-bf80ebd15e24 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:54.570408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f2cda-ec5e-446a-83b5-e0ef7d408a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:54.571413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f2cda-ec5e-446a-83b5-e0ef7d408a4c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:54.571413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f2cda-ec5e-446a-83b5-e0ef7d408a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:54.571667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f2cda-ec5e-446a-83b5-e0ef7d408a4c None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:54.572333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f2cda-ec5e-446a-83b5-e0ef7d408a4c None admin] RBAC: Adding query filter params (name=member) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:54.572645 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f2cda-ec5e-446a-83b5-e0ef7d408a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:54.574073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f2cda-ec5e-446a-83b5-e0ef7d408a4c None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:54.585392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 156/310] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:54.593296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f2cda-ec5e-446a-83b5-e0ef7d408a4c None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:54.620160 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:54.620373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:54.638686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6732ff0-0ddd-4039-bba6-7e1dd896175d None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:54.691328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51bf26-783d-44cb-a71a-4f91f82771cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:54.692442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51bf26-783d-44cb-a71a-4f91f82771cb None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:54.692800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51bf26-783d-44cb-a71a-4f91f82771cb None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:54.693304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51bf26-783d-44cb-a71a-4f91f82771cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:54.694717 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51bf26-783d-44cb-a71a-4f91f82771cb None admin] RBAC: Adding query filter params (role.id=1166805423244a648aaaf22296ce0f52, user.id=94516e960dd246cb88a3040b9a04e5ef, scope.system=all) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:54.695238 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51bf26-783d-44cb-a71a-4f91f82771cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:54.697865 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51bf26-783d-44cb-a71a-4f91f82771cb None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:54.705288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 155/311] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Sep 1 13:44:54 2022] GET /identity/v3/role_assignments?user.id=94516e960dd246cb88a3040b9a04e5ef&scope.system=all&role.id=1166805423244a648aaaf22296ce0f52 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:54.707430 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51bf26-783d-44cb-a71a-4f91f82771cb None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:54.755897 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f2cda-ec5e-446a-83b5-e0ef7d408a4c None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:54.811684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d05959-9f84-4a25-8cb8-0bafdc91afee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:54.812547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d05959-9f84-4a25-8cb8-0bafdc91afee None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:54.812836 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d05959-9f84-4a25-8cb8-0bafdc91afee None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:54.813115 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d05959-9f84-4a25-8cb8-0bafdc91afee None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:54.813866 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d05959-9f84-4a25-8cb8-0bafdc91afee None admin] RBAC: Adding query filter params (name=reader) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:54.815198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d05959-9f84-4a25-8cb8-0bafdc91afee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:54.817207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d05959-9f84-4a25-8cb8-0bafdc91afee None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:54.830536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 157/312] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:54.837110 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d05959-9f84-4a25-8cb8-0bafdc91afee None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:54.877514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51bf26-783d-44cb-a71a-4f91f82771cb None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:54.933156 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1872080-e864-4184-b8b9-1bb25f8c0e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:54.933794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1872080-e864-4184-b8b9-1bb25f8c0e49 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:54.934072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1872080-e864-4184-b8b9-1bb25f8c0e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:54.934343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1872080-e864-4184-b8b9-1bb25f8c0e49 None admin] PATH_INFO: `/v3/users/5a6fde905b86400c94e2354d551244c2` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:54.935703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1872080-e864-4184-b8b9-1bb25f8c0e49 None admin] RBAC: Authorizing `identity:get_user(user_id=5a6fde905b86400c94e2354d551244c2)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:54.936954 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1872080-e864-4184-b8b9-1bb25f8c0e49 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:54.938866 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 156/313] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:54 2022] GET /identity/v3/users/5a6fde905b86400c94e2354d551244c2 => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:54.947504 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:54.948656 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1872080-e864-4184-b8b9-1bb25f8c0e49 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:54.974825 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:54.976325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d05959-9f84-4a25-8cb8-0bafdc91afee None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:55.024664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cb455-32c2-45ff-918c-6bd5acb9519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:55.025419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cb455-32c2-45ff-918c-6bd5acb9519e None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:55.025775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cb455-32c2-45ff-918c-6bd5acb9519e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:55.026125 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cb455-32c2-45ff-918c-6bd5acb9519e None admin] PATH_INFO: `/v3/users/8618971eac114cd8a5dc4a22953f10b5` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:55.027894 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cb455-32c2-45ff-918c-6bd5acb9519e None admin] RBAC: Authorizing `identity:get_user(user_id=8618971eac114cd8a5dc4a22953f10b5)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:55.030238 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cb455-32c2-45ff-918c-6bd5acb9519e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:55.031959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 158/314] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:54 2022] GET /identity/v3/users/8618971eac114cd8a5dc4a22953f10b5 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:55.037659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cb455-32c2-45ff-918c-6bd5acb9519e None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:55.122287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1872080-e864-4184-b8b9-1bb25f8c0e49 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:55.164571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179be039-ce03-4c57-8e22-a361be79ad3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:55.165232 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179be039-ce03-4c57-8e22-a361be79ad3e None admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:55.165515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179be039-ce03-4c57-8e22-a361be79ad3e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:55.165794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179be039-ce03-4c57-8e22-a361be79ad3e None admin] PATH_INFO: `/v3/system/users/5a6fde905b86400c94e2354d551244c2/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:55.169727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179be039-ce03-4c57-8e22-a361be79ad3e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5a6fde905b86400c94e2354d551244c2, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:55.169727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179be039-ce03-4c57-8e22-a361be79ad3e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:55.192251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cb455-32c2-45ff-918c-6bd5acb9519e None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:55.227602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b648500-2863-496c-9ca6-bcfa4491792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:55.228271 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648500-2863-496c-9ca6-bcfa4491792b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:55.228554 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648500-2863-496c-9ca6-bcfa4491792b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:55.228828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648500-2863-496c-9ca6-bcfa4491792b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:55.250752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:55.268649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 157/315] 10.222.0.64 () {58 vars in 1334 bytes} [Thu Sep 1 13:44:54 2022] PUT /identity/v3/system/users/5a6fde905b86400c94e2354d551244c2/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:44:55.322476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b648500-2863-496c-9ca6-bcfa4491792b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:55.325214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b648500-2863-496c-9ca6-bcfa4491792b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:55.497753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 159/316] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:44:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:44:55.503242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179be039-ce03-4c57-8e22-a361be79ad3e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:55.590636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:55.610039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179be039-ce03-4c57-8e22-a361be79ad3e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:55.645038 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ade2b8-54e2-433c-b5d9-b5b0192e47d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:55.645666 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ade2b8-54e2-433c-b5d9-b5b0192e47d3 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:55.645936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ade2b8-54e2-433c-b5d9-b5b0192e47d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:55.646210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ade2b8-54e2-433c-b5d9-b5b0192e47d3 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:55.647332 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ade2b8-54e2-433c-b5d9-b5b0192e47d3 None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:55.649031 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ade2b8-54e2-433c-b5d9-b5b0192e47d3 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:55.651134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 158/317] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:44:55 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:55.656481 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b648500-2863-496c-9ca6-bcfa4491792b None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:55.708473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:55.767535 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b648500-2863-496c-9ca6-bcfa4491792b None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:55.809576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7c4c2-bf20-46ee-9bfd-d8ecbbedcb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:55.810196 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7c4c2-bf20-46ee-9bfd-d8ecbbedcb4d None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:55.810479 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7c4c2-bf20-46ee-9bfd-d8ecbbedcb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:55.810782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7c4c2-bf20-46ee-9bfd-d8ecbbedcb4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:55.811473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7c4c2-bf20-46ee-9bfd-d8ecbbedcb4d None admin] RBAC: Adding query filter params (role.id=1166805423244a648aaaf22296ce0f52, scope.project.id=23177498aced4c369ddf2b5e5acd5ca2, user.id=8618971eac114cd8a5dc4a22953f10b5) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:55.811782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7c4c2-bf20-46ee-9bfd-d8ecbbedcb4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:55.813244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7c4c2-bf20-46ee-9bfd-d8ecbbedcb4d None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:55.820890 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 160/318] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:44:55 2022] GET /identity/v3/role_assignments?user.id=8618971eac114cd8a5dc4a22953f10b5&scope.project.id=23177498aced4c369ddf2b5e5acd5ca2&role.id=1166805423244a648aaaf22296ce0f52 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:56.545629 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a2ae2-6490-4da0-8149-35f697cc7c14 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:56.546013 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a2ae2-6490-4da0-8149-35f697cc7c14 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:56.546191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a2ae2-6490-4da0-8149-35f697cc7c14 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:56.547670 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 159/319] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:56.552741 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96a86-b89f-41dd-99f4-2952b87ab7e5 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:56.553033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96a86-b89f-41dd-99f4-2952b87ab7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:56.553304 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96a86-b89f-41dd-99f4-2952b87ab7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:56.571308 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-5ab96a86-b89f-41dd-99f4-2952b87ab7e5 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:56.572513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-5ab96a86-b89f-41dd-99f4-2952b87ab7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:56.642717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 161/320] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:56.816805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbdb16-f8cb-408a-ac12-45efa32aabf1 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:56.817295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbdb16-f8cb-408a-ac12-45efa32aabf1 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:56.817295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbdb16-f8cb-408a-ac12-45efa32aabf1 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:56.818700 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 160/321] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:56.823952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f059b2-8051-42a5-80d4-1036d143ceb3 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:56.824379 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f059b2-8051-42a5-80d4-1036d143ceb3 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:56.824578 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f059b2-8051-42a5-80d4-1036d143ceb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:56.843220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-c8f059b2-8051-42a5-80d4-1036d143ceb3 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:56.844422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c8f059b2-8051-42a5-80d4-1036d143ceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:56.880881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:56.914222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 162/322] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:44:56.921383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbdb16-f8cb-408a-ac12-45efa32aabf1 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:57.026403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbdb16-f8cb-408a-ac12-45efa32aabf1 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:57.063151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf76ee-8222-480a-bce8-6d69ec928960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:57.064240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf76ee-8222-480a-bce8-6d69ec928960 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:57.064752 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf76ee-8222-480a-bce8-6d69ec928960 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:57.065251 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf76ee-8222-480a-bce8-6d69ec928960 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:57.067234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf76ee-8222-480a-bce8-6d69ec928960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:57.068821 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf76ee-8222-480a-bce8-6d69ec928960 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:57.072227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 161/323] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:44:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:57.079949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f059b2-8051-42a5-80d4-1036d143ceb3 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:57.181199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf76ee-8222-480a-bce8-6d69ec928960 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:57.194823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f059b2-8051-42a5-80d4-1036d143ceb3 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:57.201215 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:57.233811 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd1527-2292-4766-a3eb-e3079f567fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:57.234655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd1527-2292-4766-a3eb-e3079f567fc9 None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:57.234942 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd1527-2292-4766-a3eb-e3079f567fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:57.235523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd1527-2292-4766-a3eb-e3079f567fc9 None admin] PATH_INFO: `/v3/groups` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:57.236205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd1527-2292-4766-a3eb-e3079f567fc9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:57.237687 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd1527-2292-4766-a3eb-e3079f567fc9 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:57.286861 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf76ee-8222-480a-bce8-6d69ec928960 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:57.378666 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 163/324] 10.222.0.64 () {60 vars in 1134 bytes} [Thu Sep 1 13:44:57 2022] POST /identity/v3/groups => generated 226 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:44:57.378666 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f52a3-aef4-4b26-89ad-18f7ccf6a190 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:57.378666 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f52a3-aef4-4b26-89ad-18f7ccf6a190 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:57.378666 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f52a3-aef4-4b26-89ad-18f7ccf6a190 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:57.379097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cfaa7-c808-4998-bdf1-317d497ccde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:57.379199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 164/325] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:57.379292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cfaa7-c808-4998-bdf1-317d497ccde6 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:57.379292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cfaa7-c808-4998-bdf1-317d497ccde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:57.379292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cfaa7-c808-4998-bdf1-317d497ccde6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:57.379502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdd17a-5d9c-4507-8bc4-4aed44a61c04 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:57.379502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdd17a-5d9c-4507-8bc4-4aed44a61c04 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:57.379502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdd17a-5d9c-4507-8bc4-4aed44a61c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:57.390985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cfaa7-c808-4998-bdf1-317d497ccde6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-d52cfaa7-c808-4998-bdf1-317d497ccde6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:57.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:57.398242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:57.399062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:57.399062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:57.399062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:57.399062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:57.399062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:57.399062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:57.399062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:57.399062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:57.399062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:57.399062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:57.399062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:44:57.399062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:44:57.402661 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 162/326] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:57.404652 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cfaa7-c808-4998-bdf1-317d497ccde6 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:57.416920 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-1dcdd17a-5d9c-4507-8bc4-4aed44a61c04 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:57.419171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1dcdd17a-5d9c-4507-8bc4-4aed44a61c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:57.463991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:57.504281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:57.520804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 165/327] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:44:57.537578 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cfaa7-c808-4998-bdf1-317d497ccde6 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:57.576540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5db55-98c3-44b8-92ee-297c513c42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:57.577493 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5db55-98c3-44b8-92ee-297c513c42db None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:57.577493 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5db55-98c3-44b8-92ee-297c513c42db None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:57.577658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5db55-98c3-44b8-92ee-297c513c42db None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:57.578311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5db55-98c3-44b8-92ee-297c513c42db None admin] RBAC: Adding query filter params (name=reader) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:57.578612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5db55-98c3-44b8-92ee-297c513c42db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:57.580078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5db55-98c3-44b8-92ee-297c513c42db None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:57.591816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 163/328] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:57.597606 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdd17a-5d9c-4507-8bc4-4aed44a61c04 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:57.708197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdd17a-5d9c-4507-8bc4-4aed44a61c04 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:57.745965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4dd1-3244-4361-92a4-f8fad6755772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:57.746610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4dd1-3244-4361-92a4-f8fad6755772 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:57.746891 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4dd1-3244-4361-92a4-f8fad6755772 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:57.747167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4dd1-3244-4361-92a4-f8fad6755772 None admin] PATH_INFO: `/v3/users/94516e960dd246cb88a3040b9a04e5ef` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:57.748811 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c4dd1-3244-4361-92a4-f8fad6755772 None admin] RBAC: Authorizing `identity:get_user(user_id=94516e960dd246cb88a3040b9a04e5ef)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:57.749764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c4dd1-3244-4361-92a4-f8fad6755772 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:57.751898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 166/329] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:57 2022] GET /identity/v3/users/94516e960dd246cb88a3040b9a04e5ef => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:57.757160 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5db55-98c3-44b8-92ee-297c513c42db None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:57.791327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4dd1-3244-4361-92a4-f8fad6755772 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:57.830831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:57.901898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5db55-98c3-44b8-92ee-297c513c42db None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:57.932314 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4dd1-3244-4361-92a4-f8fad6755772 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:57.940596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea86d95-dd5d-4c10-9f7b-5308b91adb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:57.941286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea86d95-dd5d-4c10-9f7b-5308b91adb99 None admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:57.941563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea86d95-dd5d-4c10-9f7b-5308b91adb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:57.941836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea86d95-dd5d-4c10-9f7b-5308b91adb99 None admin] PATH_INFO: `/v3/system/users/94516e960dd246cb88a3040b9a04e5ef/roles/1166805423244a648aaaf22296ce0f52` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:57.944017 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea86d95-dd5d-4c10-9f7b-5308b91adb99 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=94516e960dd246cb88a3040b9a04e5ef, role_id=1166805423244a648aaaf22296ce0f52)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:57.945399 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea86d95-dd5d-4c10-9f7b-5308b91adb99 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:57.978127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5d3cd-0d97-4cfd-b7a7-5a1f590ec6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:57.978726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5d3cd-0d97-4cfd-b7a7-5a1f590ec6ca None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:57.979004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5d3cd-0d97-4cfd-b7a7-5a1f590ec6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:57.979272 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5d3cd-0d97-4cfd-b7a7-5a1f590ec6ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:57.991116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5d3cd-0d97-4cfd-b7a7-5a1f590ec6ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-7bf5d3cd-0d97-4cfd-b7a7-5a1f590ec6ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:44:57.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:44:57.997136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:44:57.998053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:44:57.998053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:44:57.998053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:44:57.998053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:44:57.998053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:44:57.998053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:44:57.998053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:44:57.998053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:44:57.998053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:44:57.998053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:44:57.998053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:44:57.998053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:44:57.998053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 167/330] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:44:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:44:58.002726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5d3cd-0d97-4cfd-b7a7-5a1f590ec6ca None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:58.007814 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 164/331] 10.222.0.64 () {58 vars in 1334 bytes} [Thu Sep 1 13:44:57 2022] PUT /identity/v3/system/users/94516e960dd246cb88a3040b9a04e5ef/roles/1166805423244a648aaaf22296ce0f52 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:44:58.112530 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:58.128797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5d3cd-0d97-4cfd-b7a7-5a1f590ec6ca None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:58.178103 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f9fad-c0f2-4004-a8d3-b1ec2a0850f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:58.178838 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f9fad-c0f2-4004-a8d3-b1ec2a0850f6 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:58.179121 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f9fad-c0f2-4004-a8d3-b1ec2a0850f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:58.179392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f9fad-c0f2-4004-a8d3-b1ec2a0850f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:58.180173 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f9fad-c0f2-4004-a8d3-b1ec2a0850f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:58.180476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f9fad-c0f2-4004-a8d3-b1ec2a0850f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:58.181868 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f9fad-c0f2-4004-a8d3-b1ec2a0850f6 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:58.191604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 168/332] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:44:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:44:58.197265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea86d95-dd5d-4c10-9f7b-5308b91adb99 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:58.203285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:58.319677 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea86d95-dd5d-4c10-9f7b-5308b91adb99 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:58.356434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b09fdd-d137-4b24-b235-1680cee851f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:58.357079 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b09fdd-d137-4b24-b235-1680cee851f8 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:58.357362 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b09fdd-d137-4b24-b235-1680cee851f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:58.357704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b09fdd-d137-4b24-b235-1680cee851f8 None admin] PATH_INFO: `/v3/users/5a6fde905b86400c94e2354d551244c2` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:58.358847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b09fdd-d137-4b24-b235-1680cee851f8 None admin] RBAC: Authorizing `identity:get_user(user_id=5a6fde905b86400c94e2354d551244c2)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:58.360338 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b09fdd-d137-4b24-b235-1680cee851f8 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:58.364286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 165/333] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:44:58 2022] GET /identity/v3/users/5a6fde905b86400c94e2354d551244c2 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:58.368352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f9fad-c0f2-4004-a8d3-b1ec2a0850f6 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:44:58.506425 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f9fad-c0f2-4004-a8d3-b1ec2a0850f6 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:44:58.542195 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae40d5a-efeb-4748-a8c1-c48375402a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:44:58.542806 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae40d5a-efeb-4748-a8c1-c48375402a3e None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:58.543084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae40d5a-efeb-4748-a8c1-c48375402a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:58.543354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae40d5a-efeb-4748-a8c1-c48375402a3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:58.544100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae40d5a-efeb-4748-a8c1-c48375402a3e None admin] RBAC: Adding query filter params (role.id=d949d82256654aa9b25ca259d33df4c3, user.id=5a6fde905b86400c94e2354d551244c2, scope.system=all) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:44:58.544407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae40d5a-efeb-4748-a8c1-c48375402a3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:44:58.545846 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae40d5a-efeb-4748-a8c1-c48375402a3e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:44:58.559077 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 169/334] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Sep 1 13:44:58 2022] GET /identity/v3/role_assignments?user.id=5a6fde905b86400c94e2354d551244c2&scope.system=all&role.id=d949d82256654aa9b25ca259d33df4c3 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:44:59.881372 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79a9fe-ad3e-4e27-b902-3bc453d8e55e None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:59.882167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79a9fe-ad3e-4e27-b902-3bc453d8e55e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:59.882167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79a9fe-ad3e-4e27-b902-3bc453d8e55e None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:59.883786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 166/335] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:59.898305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb6cb0-739c-46cf-8b6e-77896231ca7e None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:59.898937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb6cb0-739c-46cf-8b6e-77896231ca7e None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:59.898937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb6cb0-739c-46cf-8b6e-77896231ca7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:59.922650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-2feb6cb0-739c-46cf-8b6e-77896231ca7e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:44:59.923847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2feb6cb0-739c-46cf-8b6e-77896231ca7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:44:59.926086 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:44:59.966210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad432e3c-e353-47ae-abf0-d3fac9e602c7 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:59.966587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad432e3c-e353-47ae-abf0-d3fac9e602c7 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:59.966773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad432e3c-e353-47ae-abf0-d3fac9e602c7 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:44:59.968114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 167/336] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:44:59.973418 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153efa6-651d-4c2a-92fa-2da76ccd73c0 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:44:59.973707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153efa6-651d-4c2a-92fa-2da76ccd73c0 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:44:59.973991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153efa6-651d-4c2a-92fa-2da76ccd73c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:00.009162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-c153efa6-651d-4c2a-92fa-2da76ccd73c0 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:00.010391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c153efa6-651d-4c2a-92fa-2da76ccd73c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:00.031148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 170/337] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:00.119589 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 168/338] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:45:00.403139 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142983b5-2d26-4809-bdb0-06442302f21a None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:00.403547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142983b5-2d26-4809-bdb0-06442302f21a None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:00.403724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142983b5-2d26-4809-bdb0-06442302f21a None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:00.405296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 171/339] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:00.412724 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ca01b-4fc6-43f3-b21c-6e51a544b2e5 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:00.413018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ca01b-4fc6-43f3-b21c-6e51a544b2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:00.413276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ca01b-4fc6-43f3-b21c-6e51a544b2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:00.420512 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:00.436862 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-fc0ca01b-4fc6-43f3-b21c-6e51a544b2e5 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:00.455723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fc0ca01b-4fc6-43f3-b21c-6e51a544b2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:00.543950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 169/340] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:00.546545 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142983b5-2d26-4809-bdb0-06442302f21a None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:00.657116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142983b5-2d26-4809-bdb0-06442302f21a None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:00.693057 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee66c7-d21c-45c2-8e6c-a9c00e5dc4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:00.693613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee66c7-d21c-45c2-8e6c-a9c00e5dc4bd None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:00.693890 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee66c7-d21c-45c2-8e6c-a9c00e5dc4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:00.694156 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee66c7-d21c-45c2-8e6c-a9c00e5dc4bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:00.701197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:00.705436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee66c7-d21c-45c2-8e6c-a9c00e5dc4bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-9aee66c7-d21c-45c2-8e6c-a9c00e5dc4bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:00.711399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:00.717690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:00.719701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:00.719701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:00.719701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:00.719701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:00.719701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:00.719701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:00.719701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:00.719701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:00.719701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:00.719701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:00.719701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:45:00.719701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:00.719701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 172/341] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:00.721453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ca01b-4fc6-43f3-b21c-6e51a544b2e5 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:00.820225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee66c7-d21c-45c2-8e6c-a9c00e5dc4bd None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:00.870813 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ca01b-4fc6-43f3-b21c-6e51a544b2e5 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:00.941032 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:00.955073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece0627-99f3-4b40-860b-b64f251395a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:00.955627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece0627-99f3-4b40-860b-b64f251395a2 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:00.955931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece0627-99f3-4b40-860b-b64f251395a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:00.956722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece0627-99f3-4b40-860b-b64f251395a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:00.957403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece0627-99f3-4b40-860b-b64f251395a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:00.957797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece0627-99f3-4b40-860b-b64f251395a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:00.959183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece0627-99f3-4b40-860b-b64f251395a2 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:00.975058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 170/342] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:45:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:00.976268 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee66c7-d21c-45c2-8e6c-a9c00e5dc4bd None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:00.997563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece0627-99f3-4b40-860b-b64f251395a2 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:01.021368 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e8c18-4dab-4763-bdbe-08bf6ea8b674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:01.022011 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e8c18-4dab-4763-bdbe-08bf6ea8b674 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:01.022286 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e8c18-4dab-4763-bdbe-08bf6ea8b674 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:01.022555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e8c18-4dab-4763-bdbe-08bf6ea8b674 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:01.033973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e8c18-4dab-4763-bdbe-08bf6ea8b674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-ed6e8c18-4dab-4763-bdbe-08bf6ea8b674 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:01.039921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:01.042152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:01.044258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:01.044258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:01.044258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:01.044258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:01.044258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:01.044258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:01.044258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:01.044258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:01.044258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:01.044258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:01.044258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:45:01.044258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:01.044258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 173/343] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:45:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:01.051675 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e8c18-4dab-4763-bdbe-08bf6ea8b674 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:01.139702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:01.153710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece0627-99f3-4b40-860b-b64f251395a2 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:01.189168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fc274-258a-4e61-af9b-e6235794e478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:01.189783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fc274-258a-4e61-af9b-e6235794e478 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:01.190062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fc274-258a-4e61-af9b-e6235794e478 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:01.190334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fc274-258a-4e61-af9b-e6235794e478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:01.248699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e8c18-4dab-4763-bdbe-08bf6ea8b674 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:01.265984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fc274-258a-4e61-af9b-e6235794e478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:01.265984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fc274-258a-4e61-af9b-e6235794e478 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:01.272082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:01.333162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d05a89-c0eb-425b-8cee-e4be7235410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:01.334077 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d05a89-c0eb-425b-8cee-e4be7235410a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:01.334516 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d05a89-c0eb-425b-8cee-e4be7235410a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:01.335005 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d05a89-c0eb-425b-8cee-e4be7235410a None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:01.335830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d05a89-c0eb-425b-8cee-e4be7235410a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:01.336342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d05a89-c0eb-425b-8cee-e4be7235410a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:01.337950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d05a89-c0eb-425b-8cee-e4be7235410a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:01.355265 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 174/344] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:01.356429 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d05a89-c0eb-425b-8cee-e4be7235410a None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:01.377467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 171/345] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:01.378955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fc274-258a-4e61-af9b-e6235794e478 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:01.476578 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:01.484173 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fc274-258a-4e61-af9b-e6235794e478 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:01.522082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87115aad-83a9-4bb1-9a22-61fc0a08066a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:01.522785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87115aad-83a9-4bb1-9a22-61fc0a08066a None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:01.523167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87115aad-83a9-4bb1-9a22-61fc0a08066a None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:01.523511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87115aad-83a9-4bb1-9a22-61fc0a08066a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:01.569841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d05a89-c0eb-425b-8cee-e4be7235410a None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:01.602543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87115aad-83a9-4bb1-9a22-61fc0a08066a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:01.604294 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87115aad-83a9-4bb1-9a22-61fc0a08066a None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:01.608049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:01.625632 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823b691-ee1f-465e-8fb0-67ad8ac95e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:01.626588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823b691-ee1f-465e-8fb0-67ad8ac95e88 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:01.627102 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823b691-ee1f-465e-8fb0-67ad8ac95e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:01.627610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823b691-ee1f-465e-8fb0-67ad8ac95e88 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:01.640661 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823b691-ee1f-465e-8fb0-67ad8ac95e88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-2823b691-ee1f-465e-8fb0-67ad8ac95e88 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:01.647048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:01.648071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:01.648881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:01.648881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:01.648881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:01.648881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:01.648881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:01.648881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:01.648881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:01.648881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:01.648881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:01.648881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:01.648881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 13:45:01.648881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:01.651219 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 175/346] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:01.652206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823b691-ee1f-465e-8fb0-67ad8ac95e88 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:01.729702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:01.740943 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 172/347] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:01.746652 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c8858-62e9-4dc7-8634-9d19ad72568e None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:01.746936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c8858-62e9-4dc7-8634-9d19ad72568e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:01.747219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c8858-62e9-4dc7-8634-9d19ad72568e None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:01.748800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 173/348] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:01.749327 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c8858-62e9-4dc7-8634-9d19ad72568e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:01.787899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823b691-ee1f-465e-8fb0-67ad8ac95e88 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:01.840198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f5f9a-5b2f-431b-a3dc-09f771ae6f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:01.841216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f5f9a-5b2f-431b-a3dc-09f771ae6f52 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:01.841689 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f5f9a-5b2f-431b-a3dc-09f771ae6f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:01.842150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f5f9a-5b2f-431b-a3dc-09f771ae6f52 None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:01.843451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f5f9a-5b2f-431b-a3dc-09f771ae6f52 None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:01.847203 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f5f9a-5b2f-431b-a3dc-09f771ae6f52 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:01.849310 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 176/349] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:45:01 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:01.850693 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277cc65-8f36-4fd1-b311-5db07e0d9ebe None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:01.851165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277cc65-8f36-4fd1-b311-5db07e0d9ebe None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:01.851620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277cc65-8f36-4fd1-b311-5db07e0d9ebe None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:01.853313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 177/350] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:01.854199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277cc65-8f36-4fd1-b311-5db07e0d9ebe None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:01.884235 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c8858-62e9-4dc7-8634-9d19ad72568e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:01.927652 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4849c-468a-413e-9610-54d2196158e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:01.928453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4849c-468a-413e-9610-54d2196158e2 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:01.928776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4849c-468a-413e-9610-54d2196158e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:01.929052 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4849c-468a-413e-9610-54d2196158e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:01.929510 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:01.930417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4849c-468a-413e-9610-54d2196158e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:01.930731 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4849c-468a-413e-9610-54d2196158e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:01.932153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4849c-468a-413e-9610-54d2196158e2 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:01.941765 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 174/351] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:45:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:01.943311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654fbe1-37a6-4ca2-82c9-db4fa266010b None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:01.943598 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654fbe1-37a6-4ca2-82c9-db4fa266010b None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:01.943931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654fbe1-37a6-4ca2-82c9-db4fa266010b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:01.965794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-2654fbe1-37a6-4ca2-82c9-db4fa266010b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:01.967033 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2654fbe1-37a6-4ca2-82c9-db4fa266010b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:02.002193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277cc65-8f36-4fd1-b311-5db07e0d9ebe None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:02.025879 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:02.045144 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133d909-5e6d-4c8c-b1dd-41898767d852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:02.045437 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 175/352] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:02.045704 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133d909-5e6d-4c8c-b1dd-41898767d852 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:02.046042 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133d909-5e6d-4c8c-b1dd-41898767d852 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:02.046354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133d909-5e6d-4c8c-b1dd-41898767d852 None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:02.046986 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654fbe1-37a6-4ca2-82c9-db4fa266010b None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:02.047560 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133d909-5e6d-4c8c-b1dd-41898767d852 None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:02.049001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133d909-5e6d-4c8c-b1dd-41898767d852 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:02.055514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 178/353] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:45:01 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:02.055514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a88dc-5c71-40cb-978b-c81504896ab2 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:02.055514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a88dc-5c71-40cb-978b-c81504896ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:02.055514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a88dc-5c71-40cb-978b-c81504896ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:02.076731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-043a88dc-5c71-40cb-978b-c81504896ab2 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:02.078173 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-043a88dc-5c71-40cb-978b-c81504896ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:02.155912 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 179/354] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:02.156973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a88dc-5c71-40cb-978b-c81504896ab2 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:02.186536 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654fbe1-37a6-4ca2-82c9-db4fa266010b None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:02.228821 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9df32-e0ec-464a-b2fd-07d086d3bf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:02.230713 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9df32-e0ec-464a-b2fd-07d086d3bf18 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:02.231208 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9df32-e0ec-464a-b2fd-07d086d3bf18 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:02.231733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9df32-e0ec-464a-b2fd-07d086d3bf18 None admin] PATH_INFO: `/v3/groups/c3d994041fe74ac8b2794987468f6989` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:02.240088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9df32-e0ec-464a-b2fd-07d086d3bf18 None admin] RBAC: Authorizing `identity:get_group(group_id=c3d994041fe74ac8b2794987468f6989)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:02.242216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9df32-e0ec-464a-b2fd-07d086d3bf18 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:02.244940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:02.246100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 176/355] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 13:45:02 2022] GET /identity/v3/groups/c3d994041fe74ac8b2794987468f6989 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:02.247371 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9df32-e0ec-464a-b2fd-07d086d3bf18 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:02.316122 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a88dc-5c71-40cb-978b-c81504896ab2 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:02.316984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:02.362251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0b391-2845-48d6-a81d-9f6bc4956384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:02.362931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0b391-2845-48d6-a81d-9f6bc4956384 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:02.363447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0b391-2845-48d6-a81d-9f6bc4956384 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:02.363652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0b391-2845-48d6-a81d-9f6bc4956384 None admin] PATH_INFO: `/v3/users/94516e960dd246cb88a3040b9a04e5ef` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:02.364931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0b391-2845-48d6-a81d-9f6bc4956384 None admin] RBAC: Authorizing `identity:get_user(user_id=94516e960dd246cb88a3040b9a04e5ef)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:02.366535 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0b391-2845-48d6-a81d-9f6bc4956384 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:02.368502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 180/356] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:45:02 2022] GET /identity/v3/users/94516e960dd246cb88a3040b9a04e5ef => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:02.369773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b59c-45f0-4416-9895-13429d0791ec None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:02.370058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b59c-45f0-4416-9895-13429d0791ec None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:02.370385 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b59c-45f0-4416-9895-13429d0791ec None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:02.371748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 181/357] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:02.372486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02b59c-45f0-4416-9895-13429d0791ec None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:02.388335 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9df32-e0ec-464a-b2fd-07d086d3bf18 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:02.437322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef3fef-df8c-464a-8365-9f184a5bd944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:02.437959 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef3fef-df8c-464a-8365-9f184a5bd944 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:02.438236 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef3fef-df8c-464a-8365-9f184a5bd944 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:02.438529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef3fef-df8c-464a-8365-9f184a5bd944 None admin] PATH_INFO: `/v3/groups/c3d994041fe74ac8b2794987468f6989` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:02.441265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef3fef-df8c-464a-8365-9f184a5bd944 None admin] RBAC: Authorizing `identity:get_group(group_id=c3d994041fe74ac8b2794987468f6989)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:02.442087 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef3fef-df8c-464a-8365-9f184a5bd944 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:02.443854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 177/358] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 13:45:02 2022] GET /identity/v3/groups/c3d994041fe74ac8b2794987468f6989 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:02.448622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef3fef-df8c-464a-8365-9f184a5bd944 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:02.509401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02b59c-45f0-4416-9895-13429d0791ec None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:02.525156 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:02.555028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd542fa-6e58-4331-8d44-2f44620b9029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:02.555028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd542fa-6e58-4331-8d44-2f44620b9029 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:02.555028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd542fa-6e58-4331-8d44-2f44620b9029 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:02.555028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd542fa-6e58-4331-8d44-2f44620b9029 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:02.555426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd542fa-6e58-4331-8d44-2f44620b9029 None admin] RBAC: Adding query filter params (group.id=c3d994041fe74ac8b2794987468f6989, role.id=d949d82256654aa9b25ca259d33df4c3, scope.project.id=1a0e34213bab467880b704e894812e37) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:02.555426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd542fa-6e58-4331-8d44-2f44620b9029 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:02.556972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd542fa-6e58-4331-8d44-2f44620b9029 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:02.562980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 182/359] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 13:45:02 2022] GET /identity/v3/role_assignments?group.id=c3d994041fe74ac8b2794987468f6989&scope.project.id=1a0e34213bab467880b704e894812e37&role.id=d949d82256654aa9b25ca259d33df4c3 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:02.564232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85224177-e643-4b80-ad70-6afac0467fb5 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:02.564515 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85224177-e643-4b80-ad70-6afac0467fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:02.564782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85224177-e643-4b80-ad70-6afac0467fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:02.579935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef3fef-df8c-464a-8365-9f184a5bd944 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:02.593847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-85224177-e643-4b80-ad70-6afac0467fb5 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:02.595089 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-85224177-e643-4b80-ad70-6afac0467fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:02.608948 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:02.635836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b22dd9-8f12-4f36-bd98-0f089697b839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:02.636524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b22dd9-8f12-4f36-bd98-0f089697b839 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:02.636800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b22dd9-8f12-4f36-bd98-0f089697b839 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:02.637073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b22dd9-8f12-4f36-bd98-0f089697b839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:02.637829 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b22dd9-8f12-4f36-bd98-0f089697b839 None admin] RBAC: Adding query filter params (role.id=1166805423244a648aaaf22296ce0f52, user.id=94516e960dd246cb88a3040b9a04e5ef, scope.system=all) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:02.638142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b22dd9-8f12-4f36-bd98-0f089697b839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:02.639603 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b22dd9-8f12-4f36-bd98-0f089697b839 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:02.655614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 178/360] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Sep 1 13:45:02 2022] GET /identity/v3/role_assignments?user.id=94516e960dd246cb88a3040b9a04e5ef&scope.system=all&role.id=1166805423244a648aaaf22296ce0f52 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:02.657166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b22dd9-8f12-4f36-bd98-0f089697b839 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:02.706255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 183/361] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:02.707585 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85224177-e643-4b80-ad70-6afac0467fb5 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:02.822904 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b22dd9-8f12-4f36-bd98-0f089697b839 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:02.848099 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85224177-e643-4b80-ad70-6afac0467fb5 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:02.859001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:02.864465 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a133324-c749-4902-9c94-c19a4b016c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:02.865420 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a133324-c749-4902-9c94-c19a4b016c29 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:02.865903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a133324-c749-4902-9c94-c19a4b016c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:02.867068 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a133324-c749-4902-9c94-c19a4b016c29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:02.878841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a133324-c749-4902-9c94-c19a4b016c29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-7a133324-c749-4902-9c94-c19a4b016c29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:02.885427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:02.886319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:02.887120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:02.887120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:02.887120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:02.887120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:02.887120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:02.887120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:02.887120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:02.887120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:02.887120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:02.887120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:02.887120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:45:02.887120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:02.890131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 179/362] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:45:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:02.891345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a133324-c749-4902-9c94-c19a4b016c29 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:02.892377 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27119c-d159-4451-85c5-223a8ac6ffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:02.893461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27119c-d159-4451-85c5-223a8ac6ffbf None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:02.894033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27119c-d159-4451-85c5-223a8ac6ffbf None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:02.894486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27119c-d159-4451-85c5-223a8ac6ffbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:02.895112 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27119c-d159-4451-85c5-223a8ac6ffbf None admin] RBAC: Adding query filter params (group.id=c3d994041fe74ac8b2794987468f6989, role.id=af21992d300b4bb3acb7b7f5f5b04252, scope.project.id=1a0e34213bab467880b704e894812e37) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:02.896803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27119c-d159-4451-85c5-223a8ac6ffbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:02.898267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27119c-d159-4451-85c5-223a8ac6ffbf None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:02.904499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 184/363] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 13:45:02 2022] GET /identity/v3/role_assignments?group.id=c3d994041fe74ac8b2794987468f6989&scope.project.id=1a0e34213bab467880b704e894812e37&role.id=af21992d300b4bb3acb7b7f5f5b04252 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:02.905464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27119c-d159-4451-85c5-223a8ac6ffbf None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:02.947958 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:03.051346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a133324-c749-4902-9c94-c19a4b016c29 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:03.102881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27119c-d159-4451-85c5-223a8ac6ffbf None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:03.104760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5071de-2cad-41d1-b624-3929a4ba8152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:03.105580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5071de-2cad-41d1-b624-3929a4ba8152 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:03.105865 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5071de-2cad-41d1-b624-3929a4ba8152 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:03.106136 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5071de-2cad-41d1-b624-3929a4ba8152 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:03.123842 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5071de-2cad-41d1-b624-3929a4ba8152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-9b5071de-2cad-41d1-b624-3929a4ba8152 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:03.128892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:03.129880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:03.136266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:03.136266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:03.136266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:03.136266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:03.136266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:03.136266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:03.136266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:03.136266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:03.136266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:03.136266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:03.136266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:45:03.136266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:03.136266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 180/364] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:03.152290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5071de-2cad-41d1-b624-3929a4ba8152 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:03.156018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed83904-b525-4629-9a9f-c6398761fda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:03.156894 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed83904-b525-4629-9a9f-c6398761fda0 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:03.157391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed83904-b525-4629-9a9f-c6398761fda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:03.157888 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed83904-b525-4629-9a9f-c6398761fda0 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:03.158790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed83904-b525-4629-9a9f-c6398761fda0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:03.159100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed83904-b525-4629-9a9f-c6398761fda0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:03.161073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed83904-b525-4629-9a9f-c6398761fda0 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:03.171897 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 185/365] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:03.180944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed83904-b525-4629-9a9f-c6398761fda0 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:03.233905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:03.312337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:03.314165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed83904-b525-4629-9a9f-c6398761fda0 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:03.319841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5071de-2cad-41d1-b624-3929a4ba8152 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:03.355652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e779b8-8838-4000-b5c0-e65323b839c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:03.356227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e779b8-8838-4000-b5c0-e65323b839c0 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:03.356602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e779b8-8838-4000-b5c0-e65323b839c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:03.356873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e779b8-8838-4000-b5c0-e65323b839c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:03.365414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbce378-158c-432d-a276-076bc6116192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:03.366575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbce378-158c-432d-a276-076bc6116192 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:03.366871 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbce378-158c-432d-a276-076bc6116192 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:03.367149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbce378-158c-432d-a276-076bc6116192 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:03.367829 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbce378-158c-432d-a276-076bc6116192 None admin] RBAC: Adding query filter params (name=member) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:03.368170 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbce378-158c-432d-a276-076bc6116192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:03.370469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbce378-158c-432d-a276-076bc6116192 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:03.385689 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 181/366] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:45:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:03.386564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbce378-158c-432d-a276-076bc6116192 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:03.447046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e779b8-8838-4000-b5c0-e65323b839c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:03.448790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e779b8-8838-4000-b5c0-e65323b839c0 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:03.498050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:03.510824 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbce378-158c-432d-a276-076bc6116192 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:03.558788 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afda7db-4d1b-4a83-8549-2d6d6480acb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:03.559427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afda7db-4d1b-4a83-8549-2d6d6480acb6 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:03.559713 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afda7db-4d1b-4a83-8549-2d6d6480acb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:03.560019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afda7db-4d1b-4a83-8549-2d6d6480acb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:03.571840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afda7db-4d1b-4a83-8549-2d6d6480acb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-5afda7db-4d1b-4a83-8549-2d6d6480acb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:03.577336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:03.578220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:03.579183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:03.579183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:03.579183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:03.579183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:03.579183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:03.579183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:03.579183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:03.579183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:03.579183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:03.579183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:03.579183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:03.579183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:03.579183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 182/367] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:45:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:03.580043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afda7db-4d1b-4a83-8549-2d6d6480acb6 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:03.591058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 186/368] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:03.592191 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e779b8-8838-4000-b5c0-e65323b839c0 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:03.617925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:03.720365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afda7db-4d1b-4a83-8549-2d6d6480acb6 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:03.739954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e779b8-8838-4000-b5c0-e65323b839c0 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:03.764005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e67b6-9fb2-4c08-a45e-0e26fc5f9ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:03.764620 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e67b6-9fb2-4c08-a45e-0e26fc5f9ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:03.764908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e67b6-9fb2-4c08-a45e-0e26fc5f9ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:03.765183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e67b6-9fb2-4c08-a45e-0e26fc5f9ae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:03.785844 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a2590-d842-4bf6-a6ba-bfa3a184a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:03.787129 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a2590-d842-4bf6-a6ba-bfa3a184a7ca None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:03.787630 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a2590-d842-4bf6-a6ba-bfa3a184a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:03.788138 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a2590-d842-4bf6-a6ba-bfa3a184a7ca None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:03.789008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a2590-d842-4bf6-a6ba-bfa3a184a7ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:03.789969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a2590-d842-4bf6-a6ba-bfa3a184a7ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:03.791834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a2590-d842-4bf6-a6ba-bfa3a184a7ca None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:03.794327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:03.804834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 187/369] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:03.805764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a2590-d842-4bf6-a6ba-bfa3a184a7ca None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:03.854029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e67b6-9fb2-4c08-a45e-0e26fc5f9ae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:03.855818 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e67b6-9fb2-4c08-a45e-0e26fc5f9ae1 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:03.885381 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:03.945448 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a2590-d842-4bf6-a6ba-bfa3a184a7ca None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:03.990528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fca54a-e555-4979-8803-d787cdea746a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:03.991239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fca54a-e555-4979-8803-d787cdea746a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:03.991527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fca54a-e555-4979-8803-d787cdea746a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:03.991802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fca54a-e555-4979-8803-d787cdea746a None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:03.993016 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fca54a-e555-4979-8803-d787cdea746a None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:03.993792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 183/370] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:03.994575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fca54a-e555-4979-8803-d787cdea746a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:03.995337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e67b6-9fb2-4c08-a45e-0e26fc5f9ae1 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:03.997483 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 188/371] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:45:03 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:04.000841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fca54a-e555-4979-8803-d787cdea746a None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:04.079377 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:04.135972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e67b6-9fb2-4c08-a45e-0e26fc5f9ae1 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:04.136295 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fca54a-e555-4979-8803-d787cdea746a None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:04.163128 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:04.184205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16a632-ca37-45ac-a1eb-1f63f7da4790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:04.184753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16a632-ca37-45ac-a1eb-1f63f7da4790 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:04.185040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16a632-ca37-45ac-a1eb-1f63f7da4790 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:04.185317 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16a632-ca37-45ac-a1eb-1f63f7da4790 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:04.186497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16a632-ca37-45ac-a1eb-1f63f7da4790 None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:04.189443 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16a632-ca37-45ac-a1eb-1f63f7da4790 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:04.191258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 189/372] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:45:03 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:04.193325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d16711-a198-416a-bc51-088a59f63307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:04.194265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d16711-a198-416a-bc51-088a59f63307 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:04.194764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d16711-a198-416a-bc51-088a59f63307 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:04.195216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16a632-ca37-45ac-a1eb-1f63f7da4790 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:04.195744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d16711-a198-416a-bc51-088a59f63307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:04.277737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d16711-a198-416a-bc51-088a59f63307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:04.279711 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d16711-a198-416a-bc51-088a59f63307 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:04.321272 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16a632-ca37-45ac-a1eb-1f63f7da4790 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:04.362647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:04.368426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a509d-9347-46b8-8e7a-bc565000c7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:04.369022 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a509d-9347-46b8-8e7a-bc565000c7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:04.369308 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a509d-9347-46b8-8e7a-bc565000c7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:04.369587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a509d-9347-46b8-8e7a-bc565000c7e4 None admin] PATH_INFO: `/v3/groups/c3d994041fe74ac8b2794987468f6989` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:04.370904 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a509d-9347-46b8-8e7a-bc565000c7e4 None admin] RBAC: Authorizing `identity:get_group(group_id=c3d994041fe74ac8b2794987468f6989)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:04.372480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a509d-9347-46b8-8e7a-bc565000c7e4 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:04.374414 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 190/373] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 13:45:04 2022] GET /identity/v3/groups/c3d994041fe74ac8b2794987468f6989 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:04.375017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a509d-9347-46b8-8e7a-bc565000c7e4 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:04.395975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 184/374] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:04.397136 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d16711-a198-416a-bc51-088a59f63307 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:04.417989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:04.518818 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a509d-9347-46b8-8e7a-bc565000c7e4 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:04.525204 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d16711-a198-416a-bc51-088a59f63307 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:04.574700 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205cb89-190e-4292-885e-6e4422f4fada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:04.575698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205cb89-190e-4292-885e-6e4422f4fada None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:04.576197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205cb89-190e-4292-885e-6e4422f4fada None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:04.576327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e34ec-ffae-46fa-b150-6316d26750ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:04.576744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205cb89-190e-4292-885e-6e4422f4fada None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:04.577168 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e34ec-ffae-46fa-b150-6316d26750ae None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:04.577613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e34ec-ffae-46fa-b150-6316d26750ae None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:04.577862 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205cb89-190e-4292-885e-6e4422f4fada None admin] RBAC: Adding query filter params (group.id=c3d994041fe74ac8b2794987468f6989, role.id=af21992d300b4bb3acb7b7f5f5b04252, scope.project.id=23177498aced4c369ddf2b5e5acd5ca2) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:04.578200 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e34ec-ffae-46fa-b150-6316d26750ae None admin] PATH_INFO: `/v3/groups/c3d994041fe74ac8b2794987468f6989` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:04.578320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205cb89-190e-4292-885e-6e4422f4fada None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:04.579589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e34ec-ffae-46fa-b150-6316d26750ae None admin] RBAC: Authorizing `identity:get_group(group_id=c3d994041fe74ac8b2794987468f6989)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:04.580635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205cb89-190e-4292-885e-6e4422f4fada None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:04.581777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e34ec-ffae-46fa-b150-6316d26750ae None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:04.590825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 191/375] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 13:45:04 2022] GET /identity/v3/groups/c3d994041fe74ac8b2794987468f6989 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:04.590825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e34ec-ffae-46fa-b150-6316d26750ae None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:04.593044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 185/376] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 13:45:04 2022] GET /identity/v3/role_assignments?group.id=c3d994041fe74ac8b2794987468f6989&scope.project.id=23177498aced4c369ddf2b5e5acd5ca2&role.id=af21992d300b4bb3acb7b7f5f5b04252 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:04.594487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205cb89-190e-4292-885e-6e4422f4fada None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:04.739940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:04.749991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:04.787758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205cb89-190e-4292-885e-6e4422f4fada None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:04.816268 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e34ec-ffae-46fa-b150-6316d26750ae None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:04.856232 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06de48e-23c0-4536-b079-89db59207967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:04.857490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06de48e-23c0-4536-b079-89db59207967 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:04.858373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06de48e-23c0-4536-b079-89db59207967 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:04.859124 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06de48e-23c0-4536-b079-89db59207967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:04.860354 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06de48e-23c0-4536-b079-89db59207967 None admin] RBAC: Adding query filter params (group.id=c3d994041fe74ac8b2794987468f6989, role.id=d949d82256654aa9b25ca259d33df4c3, scope.project.id=23177498aced4c369ddf2b5e5acd5ca2) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:04.861293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06de48e-23c0-4536-b079-89db59207967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:04.863595 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06de48e-23c0-4536-b079-89db59207967 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:04.870697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 186/377] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 13:45:04 2022] GET /identity/v3/role_assignments?group.id=c3d994041fe74ac8b2794987468f6989&scope.project.id=23177498aced4c369ddf2b5e5acd5ca2&role.id=d949d82256654aa9b25ca259d33df4c3 => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:04.870886 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab2786-5677-48ff-8ec0-3c84d8a88af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:04.875724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab2786-5677-48ff-8ec0-3c84d8a88af5 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:04.875724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab2786-5677-48ff-8ec0-3c84d8a88af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:04.875724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab2786-5677-48ff-8ec0-3c84d8a88af5 None admin] PATH_INFO: `/v3/projects/0fc2f50aab224fc68a4db65bf6dd738c` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:04.875724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab2786-5677-48ff-8ec0-3c84d8a88af5 None admin] RBAC: Authorizing `identity:get_project(project_id=0fc2f50aab224fc68a4db65bf6dd738c)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:04.875724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab2786-5677-48ff-8ec0-3c84d8a88af5 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:04.876783 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 192/378] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:45:04 2022] GET /identity/v3/projects/0fc2f50aab224fc68a4db65bf6dd738c => generated 344 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:04.882487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06de48e-23c0-4536-b079-89db59207967 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:04.987940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d64b4-f68b-4db0-9e39-37eedd42fa0d None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:04.988271 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d64b4-f68b-4db0-9e39-37eedd42fa0d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:04.988449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d64b4-f68b-4db0-9e39-37eedd42fa0d None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:04.990038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 193/379] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:04.996441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4661bb-2152-4b8e-bbeb-fca806c0f583 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:04.996441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4661bb-2152-4b8e-bbeb-fca806c0f583 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:04.996441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4661bb-2152-4b8e-bbeb-fca806c0f583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:05.019740 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-4e4661bb-2152-4b8e-bbeb-fca806c0f583 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:05.020950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06de48e-23c0-4536-b079-89db59207967 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:05.021398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4e4661bb-2152-4b8e-bbeb-fca806c0f583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:05.066009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd897dcc-765f-4180-a7ed-78d77d7c0390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:05.067078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd897dcc-765f-4180-a7ed-78d77d7c0390 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:05.067556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd897dcc-765f-4180-a7ed-78d77d7c0390 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:05.068083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd897dcc-765f-4180-a7ed-78d77d7c0390 None admin] PATH_INFO: `/v3/groups/8fc47130a8c54592bb887cc90f1332f1` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:05.074824 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd897dcc-765f-4180-a7ed-78d77d7c0390 None admin] RBAC: Authorizing `identity:get_group(group_id=8fc47130a8c54592bb887cc90f1332f1)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:05.076872 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd897dcc-765f-4180-a7ed-78d77d7c0390 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:05.079815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 187/380] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 13:45:04 2022] GET /identity/v3/groups/8fc47130a8c54592bb887cc90f1332f1 => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:05.085882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd897dcc-765f-4180-a7ed-78d77d7c0390 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:05.100445 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:05.105748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 194/381] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:45:05.193472 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd897dcc-765f-4180-a7ed-78d77d7c0390 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:05.228565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5ce8c-467a-4d23-af7e-db4ee248007e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:05.229177 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5ce8c-467a-4d23-af7e-db4ee248007e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:05.229455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5ce8c-467a-4d23-af7e-db4ee248007e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:05.229728 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5ce8c-467a-4d23-af7e-db4ee248007e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:05.230451 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5ce8c-467a-4d23-af7e-db4ee248007e None admin] RBAC: Adding query filter params (group.id=8fc47130a8c54592bb887cc90f1332f1, role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=0fc2f50aab224fc68a4db65bf6dd738c) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:05.230762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5ce8c-467a-4d23-af7e-db4ee248007e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:05.232221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5ce8c-467a-4d23-af7e-db4ee248007e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:05.238816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 188/382] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 13:45:05 2022] GET /identity/v3/role_assignments?group.id=8fc47130a8c54592bb887cc90f1332f1&scope.project.id=0fc2f50aab224fc68a4db65bf6dd738c&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:05.339143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81181a-3230-4e57-889b-dd0b4590f476 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:05.339669 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81181a-3230-4e57-889b-dd0b4590f476 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:05.339669 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81181a-3230-4e57-889b-dd0b4590f476 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:05.341537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 195/383] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:05.348100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bbaf4-6520-4fd6-88f3-d7c2021dfa9f None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:05.348917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bbaf4-6520-4fd6-88f3-d7c2021dfa9f None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:05.348917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bbaf4-6520-4fd6-88f3-d7c2021dfa9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:05.369671 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-445bbaf4-6520-4fd6-88f3-d7c2021dfa9f None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:05.371272 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-445bbaf4-6520-4fd6-88f3-d7c2021dfa9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:05.431059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81181a-3230-4e57-889b-dd0b4590f476 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:05.457384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 189/384] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:05.521386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:05.559696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81181a-3230-4e57-889b-dd0b4590f476 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:05.597575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed728fbc-b4af-4b24-b080-60af8fa142d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:05.598561 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed728fbc-b4af-4b24-b080-60af8fa142d5 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:05.599063 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed728fbc-b4af-4b24-b080-60af8fa142d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:05.599538 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed728fbc-b4af-4b24-b080-60af8fa142d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:05.610923 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed728fbc-b4af-4b24-b080-60af8fa142d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-ed728fbc-b4af-4b24-b080-60af8fa142d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:05.617381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:05.618333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:05.619127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:05.619127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:05.619127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:05.619127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:05.619127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:05.619127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:05.619127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:05.619127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:05.619127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:05.619127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:05.619127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:45:05.619127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:05.621815 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 196/385] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:45:05.627139 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bbaf4-6520-4fd6-88f3-d7c2021dfa9f None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:05.632209 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:05.757968 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bbaf4-6520-4fd6-88f3-d7c2021dfa9f None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:05.773233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed728fbc-b4af-4b24-b080-60af8fa142d5 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:05.825732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60998a52-1d5e-4328-ad22-92926c79ec46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:05.827273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998a52-1d5e-4328-ad22-92926c79ec46 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:05.827934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998a52-1d5e-4328-ad22-92926c79ec46 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:05.830264 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998a52-1d5e-4328-ad22-92926c79ec46 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:05.831691 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60998a52-1d5e-4328-ad22-92926c79ec46 None admin] RBAC: Adding query filter params (name=member) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:05.832421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60998a52-1d5e-4328-ad22-92926c79ec46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:05.834807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60998a52-1d5e-4328-ad22-92926c79ec46 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:05.853886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 190/386] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:45:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:05.861219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60998a52-1d5e-4328-ad22-92926c79ec46 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:05.942492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:05.980907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60998a52-1d5e-4328-ad22-92926c79ec46 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:05.995553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed728fbc-b4af-4b24-b080-60af8fa142d5 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:06.023390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59aab8-7e5d-431a-8c64-590919c9c96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:06.024888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59aab8-7e5d-431a-8c64-590919c9c96f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:06.026841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59aab8-7e5d-431a-8c64-590919c9c96f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:06.028270 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59aab8-7e5d-431a-8c64-590919c9c96f None admin] PATH_INFO: `/v3/groups/c3d994041fe74ac8b2794987468f6989` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:06.032398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59aab8-7e5d-431a-8c64-590919c9c96f None admin] RBAC: Authorizing `identity:get_group(group_id=c3d994041fe74ac8b2794987468f6989)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:06.034283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59aab8-7e5d-431a-8c64-590919c9c96f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:06.037325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 191/387] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 13:45:05 2022] GET /identity/v3/groups/c3d994041fe74ac8b2794987468f6989 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:06.044842 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59aab8-7e5d-431a-8c64-590919c9c96f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:06.047998 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:06.067951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920c117-cb14-40e9-b378-55f74dcc784c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:06.068995 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920c117-cb14-40e9-b378-55f74dcc784c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:06.069991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920c117-cb14-40e9-b378-55f74dcc784c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:06.071155 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920c117-cb14-40e9-b378-55f74dcc784c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:06.089631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920c117-cb14-40e9-b378-55f74dcc784c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-f920c117-cb14-40e9-b378-55f74dcc784c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:06.094764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:06.095667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:06.102161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:06.102161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:06.102161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:06.102161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:06.102161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:06.102161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:06.102161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:06.102161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:06.102161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:06.102161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:06.102161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:45:06.102161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:06.102161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 197/388] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:45:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:45:06.102161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920c117-cb14-40e9-b378-55f74dcc784c None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:06.271946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59aab8-7e5d-431a-8c64-590919c9c96f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:06.306360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920c117-cb14-40e9-b378-55f74dcc784c None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:06.328964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd473f9-4a8c-4a85-a127-98406f6e8056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:06.329715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd473f9-4a8c-4a85-a127-98406f6e8056 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:06.330064 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd473f9-4a8c-4a85-a127-98406f6e8056 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:06.330444 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd473f9-4a8c-4a85-a127-98406f6e8056 None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:06.333279 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd473f9-4a8c-4a85-a127-98406f6e8056 None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:06.334839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd473f9-4a8c-4a85-a127-98406f6e8056 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:06.336766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 192/389] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:45:06 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:06.342863 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd473f9-4a8c-4a85-a127-98406f6e8056 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:06.346391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48935aa1-f56f-48d9-9d44-421340ba17a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:06.347634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48935aa1-f56f-48d9-9d44-421340ba17a9 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:06.348226 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48935aa1-f56f-48d9-9d44-421340ba17a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:06.348726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48935aa1-f56f-48d9-9d44-421340ba17a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:06.349537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:06.349793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48935aa1-f56f-48d9-9d44-421340ba17a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:06.350468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48935aa1-f56f-48d9-9d44-421340ba17a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:06.352167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48935aa1-f56f-48d9-9d44-421340ba17a9 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:06.365203 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 198/390] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:06.371091 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48935aa1-f56f-48d9-9d44-421340ba17a9 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:06.447685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:06.539962 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd473f9-4a8c-4a85-a127-98406f6e8056 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:06.543815 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48935aa1-f56f-48d9-9d44-421340ba17a9 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:06.599457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1736f4-727d-4c71-a089-cce014a0e82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:06.600159 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1736f4-727d-4c71-a089-cce014a0e82b None admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:06.600438 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1736f4-727d-4c71-a089-cce014a0e82b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:06.600712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1736f4-727d-4c71-a089-cce014a0e82b None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37/groups/c3d994041fe74ac8b2794987468f6989/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:06.603784 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1736f4-727d-4c71-a089-cce014a0e82b None admin] RBAC: Authorizing `identity:create_grant(project_id=1a0e34213bab467880b704e894812e37, group_id=c3d994041fe74ac8b2794987468f6989, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:06.605268 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1736f4-727d-4c71-a089-cce014a0e82b None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:06.608692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196470c-aabf-4e0e-86c4-f47948b4608e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:06.609345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196470c-aabf-4e0e-86c4-f47948b4608e None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:06.609618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196470c-aabf-4e0e-86c4-f47948b4608e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:06.609884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196470c-aabf-4e0e-86c4-f47948b4608e None admin] PATH_INFO: `/v3/groups/c3d994041fe74ac8b2794987468f6989` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:06.611734 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196470c-aabf-4e0e-86c4-f47948b4608e None admin] RBAC: Authorizing `identity:get_group(group_id=c3d994041fe74ac8b2794987468f6989)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:06.613241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196470c-aabf-4e0e-86c4-f47948b4608e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:06.617043 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 199/391] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 13:45:06 2022] GET /identity/v3/groups/c3d994041fe74ac8b2794987468f6989 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:06.623255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196470c-aabf-4e0e-86c4-f47948b4608e None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:06.694040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 193/392] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Sep 1 13:45:06 2022] PUT /identity/v3/projects/1a0e34213bab467880b704e894812e37/groups/c3d994041fe74ac8b2794987468f6989/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:45:06.764499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196470c-aabf-4e0e-86c4-f47948b4608e None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:06.785070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:06.804259 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b891e40-8c8a-4f5a-b628-cd126bdb2bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:06.804910 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b891e40-8c8a-4f5a-b628-cd126bdb2bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:06.805251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b891e40-8c8a-4f5a-b628-cd126bdb2bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:06.805529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b891e40-8c8a-4f5a-b628-cd126bdb2bb6 None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:06.809201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b891e40-8c8a-4f5a-b628-cd126bdb2bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:06.810687 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b891e40-8c8a-4f5a-b628-cd126bdb2bb6 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:06.812775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 200/393] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:45:06 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:06.818928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1736f4-727d-4c71-a089-cce014a0e82b None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:06.896113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:06.938964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1736f4-727d-4c71-a089-cce014a0e82b None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:06.982594 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babed66-9d8a-4125-93cd-a7875003d070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:06.983334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babed66-9d8a-4125-93cd-a7875003d070 None admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:06.983622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babed66-9d8a-4125-93cd-a7875003d070 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:06.983925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babed66-9d8a-4125-93cd-a7875003d070 None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37/groups/c3d994041fe74ac8b2794987468f6989/roles/af21992d300b4bb3acb7b7f5f5b04252` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:06.986143 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babed66-9d8a-4125-93cd-a7875003d070 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a0e34213bab467880b704e894812e37, group_id=c3d994041fe74ac8b2794987468f6989, role_id=af21992d300b4bb3acb7b7f5f5b04252)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:06.988217 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babed66-9d8a-4125-93cd-a7875003d070 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:07.059278 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 194/394] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Sep 1 13:45:06 2022] PUT /identity/v3/projects/1a0e34213bab467880b704e894812e37/groups/c3d994041fe74ac8b2794987468f6989/roles/af21992d300b4bb3acb7b7f5f5b04252 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:45:07.387337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a46da-4245-43e7-91f8-a5eabb62b354 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:07.387826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a46da-4245-43e7-91f8-a5eabb62b354 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:07.387826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a46da-4245-43e7-91f8-a5eabb62b354 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:07.389335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 201/395] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:07.396424 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a34f-5c14-453d-936a-720fdfa4b69e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:07.396713 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a34f-5c14-453d-936a-720fdfa4b69e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:07.402456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a34f-5c14-453d-936a-720fdfa4b69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:07.418314 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-b957a34f-5c14-453d-936a-720fdfa4b69e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:07.419524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b957a34f-5c14-453d-936a-720fdfa4b69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:07.460066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca532-9078-4c80-b7db-63b07224a912 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:07.460483 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca532-9078-4c80-b7db-63b07224a912 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:07.460830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ca532-9078-4c80-b7db-63b07224a912 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:07.462506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 202/396] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:07.467635 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21961a-0191-4283-860e-592394fbae1f None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:07.467951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21961a-0191-4283-860e-592394fbae1f None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:07.468233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21961a-0191-4283-860e-592394fbae1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:07.488956 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-ee21961a-0191-4283-860e-592394fbae1f None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:07.490711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ee21961a-0191-4283-860e-592394fbae1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:07.508840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 195/397] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:07.575094 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 203/398] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:45:07.697617 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe03fd1-366e-4cfb-902f-482c75680591 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:07.697801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe03fd1-366e-4cfb-902f-482c75680591 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:07.698076 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe03fd1-366e-4cfb-902f-482c75680591 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:07.699654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 196/399] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:07.704746 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7930551-7867-4c16-8779-23f7a3d37593 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:07.705030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7930551-7867-4c16-8779-23f7a3d37593 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:07.705301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7930551-7867-4c16-8779-23f7a3d37593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:07.725361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-f7930551-7867-4c16-8779-23f7a3d37593 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:07.726540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f7930551-7867-4c16-8779-23f7a3d37593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:07.807627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 204/400] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:07.916446 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe03fd1-366e-4cfb-902f-482c75680591 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:07.992411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:08.017050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7930551-7867-4c16-8779-23f7a3d37593 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:08.046982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe03fd1-366e-4cfb-902f-482c75680591 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:08.084362 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f0b47-500f-425a-a651-1c2561e86fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:08.084980 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f0b47-500f-425a-a651-1c2561e86fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:08.085273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f0b47-500f-425a-a651-1c2561e86fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:08.085554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f0b47-500f-425a-a651-1c2561e86fa8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:08.096520 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f0b47-500f-425a-a651-1c2561e86fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-387f0b47-500f-425a-a651-1c2561e86fa8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:08.105638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:08.106875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:08.107676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:08.107676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:08.107676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:08.107676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:08.107676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:08.107676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:08.107676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:08.107676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:08.107676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:08.107676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:08.107676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:45:08.107676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:08.107676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 197/401] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:08.120233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:08.121093 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f0b47-500f-425a-a651-1c2561e86fa8 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:08.192327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7930551-7867-4c16-8779-23f7a3d37593 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:08.230557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce36da0-fdf6-45a0-b954-3ced1c7517e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:08.231221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce36da0-fdf6-45a0-b954-3ced1c7517e2 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:08.231509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce36da0-fdf6-45a0-b954-3ced1c7517e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:08.231782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce36da0-fdf6-45a0-b954-3ced1c7517e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:08.245885 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce36da0-fdf6-45a0-b954-3ced1c7517e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-1ce36da0-fdf6-45a0-b954-3ced1c7517e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:08.248771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:08.249861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:08.250857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:08.250857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:08.250857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:08.250857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:08.250857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:08.250857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:08.250857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:08.250857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:08.250857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:08.250857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:08.250857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:45:08.250857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:08.250857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 205/402] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:45:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:08.251575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce36da0-fdf6-45a0-b954-3ced1c7517e2 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:08.253650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f0b47-500f-425a-a651-1c2561e86fa8 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:08.268057 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:08.290194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e324da-a266-469b-b61e-7d0a7ac9a645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:08.290996 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e324da-a266-469b-b61e-7d0a7ac9a645 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:08.291445 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e324da-a266-469b-b61e-7d0a7ac9a645 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:08.291955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e324da-a266-469b-b61e-7d0a7ac9a645 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:08.292786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e324da-a266-469b-b61e-7d0a7ac9a645 None admin] RBAC: Adding query filter params (name=member) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:08.293232 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e324da-a266-469b-b61e-7d0a7ac9a645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:08.294800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e324da-a266-469b-b61e-7d0a7ac9a645 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:08.308438 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 198/403] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:45:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:08.309476 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e324da-a266-469b-b61e-7d0a7ac9a645 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:08.360407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce36da0-fdf6-45a0-b954-3ced1c7517e2 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:08.372603 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:08.397708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73df382-d5e2-4113-8532-ed3441092bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:08.398445 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73df382-d5e2-4113-8532-ed3441092bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:08.398855 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73df382-d5e2-4113-8532-ed3441092bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:08.399194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73df382-d5e2-4113-8532-ed3441092bc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:08.410840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73df382-d5e2-4113-8532-ed3441092bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-d73df382-d5e2-4113-8532-ed3441092bc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:08.416172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:08.417264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:08.418249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:08.418249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:08.418249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:08.418249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:08.418249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:08.418249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:08.418249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:08.418249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:08.418249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:08.418249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:08.418249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:08.418249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:08.419371 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e324da-a266-469b-b61e-7d0a7ac9a645 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:08.424104 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 206/404] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:45:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:08.425708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73df382-d5e2-4113-8532-ed3441092bc4 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:08.455206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f4d81-38d6-45a5-9103-1a7bde508203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:08.456701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f4d81-38d6-45a5-9103-1a7bde508203 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:08.457182 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f4d81-38d6-45a5-9103-1a7bde508203 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:08.457623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f4d81-38d6-45a5-9103-1a7bde508203 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:08.458456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f4d81-38d6-45a5-9103-1a7bde508203 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:08.458931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f4d81-38d6-45a5-9103-1a7bde508203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:08.460509 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f4d81-38d6-45a5-9103-1a7bde508203 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:08.469417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 199/405] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:08.470532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f4d81-38d6-45a5-9103-1a7bde508203 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:08.509450 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:08.541073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73df382-d5e2-4113-8532-ed3441092bc4 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:08.579368 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8badf0-26eb-4286-86ec-a55a3014cf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:08.580531 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8badf0-26eb-4286-86ec-a55a3014cf94 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:08.581043 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8badf0-26eb-4286-86ec-a55a3014cf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:08.581498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8badf0-26eb-4286-86ec-a55a3014cf94 None admin] PATH_INFO: `/v3/groups/c3d994041fe74ac8b2794987468f6989` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:08.582940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8badf0-26eb-4286-86ec-a55a3014cf94 None admin] RBAC: Authorizing `identity:get_group(group_id=c3d994041fe74ac8b2794987468f6989)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:08.584888 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8badf0-26eb-4286-86ec-a55a3014cf94 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:08.591583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 207/406] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 13:45:08 2022] GET /identity/v3/groups/c3d994041fe74ac8b2794987468f6989 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:08.592707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8badf0-26eb-4286-86ec-a55a3014cf94 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:08.593744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f4d81-38d6-45a5-9103-1a7bde508203 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:08.644850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab13a3-0825-4547-b822-7aa8a51919b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:08.645996 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab13a3-0825-4547-b822-7aa8a51919b8 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:08.646288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab13a3-0825-4547-b822-7aa8a51919b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:08.646565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab13a3-0825-4547-b822-7aa8a51919b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:08.647473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab13a3-0825-4547-b822-7aa8a51919b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:08.647784 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab13a3-0825-4547-b822-7aa8a51919b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:08.649591 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab13a3-0825-4547-b822-7aa8a51919b8 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:08.656364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:08.663942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 200/407] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:08.665026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab13a3-0825-4547-b822-7aa8a51919b8 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:08.708003 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8badf0-26eb-4286-86ec-a55a3014cf94 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:08.746477 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac35b7-b4d4-404e-8a97-75004131b5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:08.747525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac35b7-b4d4-404e-8a97-75004131b5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:08.748032 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac35b7-b4d4-404e-8a97-75004131b5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:08.748517 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac35b7-b4d4-404e-8a97-75004131b5a2 None admin] PATH_INFO: `/v3/groups/c3d994041fe74ac8b2794987468f6989` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:08.750060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac35b7-b4d4-404e-8a97-75004131b5a2 None admin] RBAC: Authorizing `identity:get_group(group_id=c3d994041fe74ac8b2794987468f6989)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:08.751816 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac35b7-b4d4-404e-8a97-75004131b5a2 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:08.754409 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 208/408] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 13:45:08 2022] GET /identity/v3/groups/c3d994041fe74ac8b2794987468f6989 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:08.755491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac35b7-b4d4-404e-8a97-75004131b5a2 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:08.792809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:08.796395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab13a3-0825-4547-b822-7aa8a51919b8 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:08.839446 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cc717-e985-478d-9c4a-6ffb57ded017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:08.840488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cc717-e985-478d-9c4a-6ffb57ded017 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:08.840784 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cc717-e985-478d-9c4a-6ffb57ded017 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:08.841063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cc717-e985-478d-9c4a-6ffb57ded017 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:08.842471 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2cc717-e985-478d-9c4a-6ffb57ded017 None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:08.844266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2cc717-e985-478d-9c4a-6ffb57ded017 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:08.851260 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 201/409] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:45:08 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:08.851260 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cc717-e985-478d-9c4a-6ffb57ded017 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:08.871025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac35b7-b4d4-404e-8a97-75004131b5a2 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:08.884282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:08.913427 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638c58b-8f41-43c8-b3ce-86e67d6625cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:08.914211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638c58b-8f41-43c8-b3ce-86e67d6625cc None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:08.914605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638c58b-8f41-43c8-b3ce-86e67d6625cc None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:08.914886 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638c58b-8f41-43c8-b3ce-86e67d6625cc None admin] PATH_INFO: `/v3/groups/8fc47130a8c54592bb887cc90f1332f1` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:08.916184 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638c58b-8f41-43c8-b3ce-86e67d6625cc None admin] RBAC: Authorizing `identity:get_group(group_id=8fc47130a8c54592bb887cc90f1332f1)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:08.918228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638c58b-8f41-43c8-b3ce-86e67d6625cc None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:08.920146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 209/410] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 13:45:08 2022] GET /identity/v3/groups/8fc47130a8c54592bb887cc90f1332f1 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:08.923940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638c58b-8f41-43c8-b3ce-86e67d6625cc None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:08.965763 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cc717-e985-478d-9c4a-6ffb57ded017 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:09.001791 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89441f-f01b-4bbb-ac9b-d81267f3b1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:09.003425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89441f-f01b-4bbb-ac9b-d81267f3b1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:09.003951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89441f-f01b-4bbb-ac9b-d81267f3b1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:09.004457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89441f-f01b-4bbb-ac9b-d81267f3b1d9 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:09.005802 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89441f-f01b-4bbb-ac9b-d81267f3b1d9 None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:09.007436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89441f-f01b-4bbb-ac9b-d81267f3b1d9 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:09.010134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 202/411] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:45:08 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:09.011194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89441f-f01b-4bbb-ac9b-d81267f3b1d9 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:09.052379 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638c58b-8f41-43c8-b3ce-86e67d6625cc None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:09.061675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:09.092489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112576ed-951f-4334-9897-e6f0f462451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:09.093158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112576ed-951f-4334-9897-e6f0f462451b None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:09.093437 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112576ed-951f-4334-9897-e6f0f462451b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:09.093708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112576ed-951f-4334-9897-e6f0f462451b None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2/groups/c3d994041fe74ac8b2794987468f6989/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:09.095656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112576ed-951f-4334-9897-e6f0f462451b None admin] RBAC: Authorizing `identity:create_grant(project_id=23177498aced4c369ddf2b5e5acd5ca2, group_id=c3d994041fe74ac8b2794987468f6989, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:09.097161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112576ed-951f-4334-9897-e6f0f462451b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:09.129331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89441f-f01b-4bbb-ac9b-d81267f3b1d9 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:09.163133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176d716-e319-4fed-ad9b-0000320c57b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:09.163767 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176d716-e319-4fed-ad9b-0000320c57b4 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:09.164091 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176d716-e319-4fed-ad9b-0000320c57b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:09.164412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176d716-e319-4fed-ad9b-0000320c57b4 None admin] PATH_INFO: `/v3/projects/0fc2f50aab224fc68a4db65bf6dd738c` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:09.165492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176d716-e319-4fed-ad9b-0000320c57b4 None admin] RBAC: Authorizing `identity:get_project(project_id=0fc2f50aab224fc68a4db65bf6dd738c)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:09.166943 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176d716-e319-4fed-ad9b-0000320c57b4 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:09.169358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 203/412] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:45:09 2022] GET /identity/v3/projects/0fc2f50aab224fc68a4db65bf6dd738c => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:09.169358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176d716-e319-4fed-ad9b-0000320c57b4 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:09.235813 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 210/413] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Sep 1 13:45:08 2022] PUT /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2/groups/c3d994041fe74ac8b2794987468f6989/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:45:09.237984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5dad8-7229-46de-8000-fcc23c7548a8 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:09.238511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5dad8-7229-46de-8000-fcc23c7548a8 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:09.238991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5dad8-7229-46de-8000-fcc23c7548a8 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:09.240650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 211/414] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:09.241631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5dad8-7229-46de-8000-fcc23c7548a8 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:09.280712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:09.325843 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176d716-e319-4fed-ad9b-0000320c57b4 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:09.327590 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:09.367432 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5dad8-7229-46de-8000-fcc23c7548a8 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:09.372210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af158a0-c28e-4fe6-b4a7-1df552997cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:09.373061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af158a0-c28e-4fe6-b4a7-1df552997cdf None admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:09.373348 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af158a0-c28e-4fe6-b4a7-1df552997cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:09.373671 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af158a0-c28e-4fe6-b4a7-1df552997cdf None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2/groups/c3d994041fe74ac8b2794987468f6989/roles/af21992d300b4bb3acb7b7f5f5b04252` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:09.376117 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af158a0-c28e-4fe6-b4a7-1df552997cdf None admin] RBAC: Authorizing `identity:create_grant(project_id=23177498aced4c369ddf2b5e5acd5ca2, group_id=c3d994041fe74ac8b2794987468f6989, role_id=af21992d300b4bb3acb7b7f5f5b04252)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:09.377598 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af158a0-c28e-4fe6-b4a7-1df552997cdf None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:09.411655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217f781-b130-41de-943c-e91084082802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:09.412906 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217f781-b130-41de-943c-e91084082802 None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:09.412906 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217f781-b130-41de-943c-e91084082802 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:09.413072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217f781-b130-41de-943c-e91084082802 None admin] PATH_INFO: `/v3/projects/0fc2f50aab224fc68a4db65bf6dd738c/groups/8fc47130a8c54592bb887cc90f1332f1/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:09.414898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217f781-b130-41de-943c-e91084082802 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc2f50aab224fc68a4db65bf6dd738c, group_id=8fc47130a8c54592bb887cc90f1332f1, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:09.416392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217f781-b130-41de-943c-e91084082802 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:09.537984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 204/415] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Sep 1 13:45:09 2022] PUT /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2/groups/c3d994041fe74ac8b2794987468f6989/roles/af21992d300b4bb3acb7b7f5f5b04252 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:45:09.539277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f03421-2e8c-46a6-a2a1-e5b933f386a5 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:09.539570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f03421-2e8c-46a6-a2a1-e5b933f386a5 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:09.539846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f03421-2e8c-46a6-a2a1-e5b933f386a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:09.560926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-c4f03421-2e8c-46a6-a2a1-e5b933f386a5 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:09.562148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c4f03421-2e8c-46a6-a2a1-e5b933f386a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:09.564627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 212/416] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Sep 1 13:45:09 2022] PUT /identity/v3/projects/0fc2f50aab224fc68a4db65bf6dd738c/groups/8fc47130a8c54592bb887cc90f1332f1/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:45:09.567851 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e05b0-6e6e-4c38-b3d9-305347297ecd None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:09.568816 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e05b0-6e6e-4c38-b3d9-305347297ecd None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:09.569595 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e05b0-6e6e-4c38-b3d9-305347297ecd None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:09.572829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 213/417] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:09.584035 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf551157-46b5-40ec-afde-6008828febbd None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:09.584739 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf551157-46b5-40ec-afde-6008828febbd None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:09.585342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf551157-46b5-40ec-afde-6008828febbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:09.628938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-cf551157-46b5-40ec-afde-6008828febbd None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:09.631789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-cf551157-46b5-40ec-afde-6008828febbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:09.735802 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 205/418] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:09.747902 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 214/419] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:10.024399 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f03421-2e8c-46a6-a2a1-e5b933f386a5 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:10.109346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf551157-46b5-40ec-afde-6008828febbd None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:10.142062 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:10.148614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:10.161472 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f03421-2e8c-46a6-a2a1-e5b933f386a5 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:10.228495 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325a98e-c7b2-4e16-b93c-3d9b93f6e6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:10.229144 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325a98e-c7b2-4e16-b93c-3d9b93f6e6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:10.229431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325a98e-c7b2-4e16-b93c-3d9b93f6e6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:10.229705 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325a98e-c7b2-4e16-b93c-3d9b93f6e6e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:10.254064 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325a98e-c7b2-4e16-b93c-3d9b93f6e6e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-2325a98e-c7b2-4e16-b93c-3d9b93f6e6e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:10.260812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:10.261781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:10.263307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:10.263307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:10.263307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:10.263307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:10.263307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:10.263307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:10.263307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:10.263307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:10.263307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:10.263307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:10.263307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:45:10.263307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:10.266928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 206/420] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:45:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:10.273754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325a98e-c7b2-4e16-b93c-3d9b93f6e6e6 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:10.316444 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf551157-46b5-40ec-afde-6008828febbd None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:10.376832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024add6-c376-4083-9d47-ad27e17da226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:10.377983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024add6-c376-4083-9d47-ad27e17da226 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:10.378480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024add6-c376-4083-9d47-ad27e17da226 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:10.378953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024add6-c376-4083-9d47-ad27e17da226 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:10.407532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024add6-c376-4083-9d47-ad27e17da226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-5024add6-c376-4083-9d47-ad27e17da226 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:10.413087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:10.414417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:10.415205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:10.415205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:10.415205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:10.415205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:10.415205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:10.415205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:10.415205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:10.415205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:10.415205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:10.415205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:10.415205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:45:10.415205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:10.424359 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 215/421] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:10.427146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325a98e-c7b2-4e16-b93c-3d9b93f6e6e6 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:10.430379 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024add6-c376-4083-9d47-ad27e17da226 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:10.510195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f338e4-fd5e-45b7-9156-8210072a725f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:10.510820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f338e4-fd5e-45b7-9156-8210072a725f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:10.511103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f338e4-fd5e-45b7-9156-8210072a725f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:10.511379 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f338e4-fd5e-45b7-9156-8210072a725f None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:10.512088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f338e4-fd5e-45b7-9156-8210072a725f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:10.512405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f338e4-fd5e-45b7-9156-8210072a725f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:10.513778 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f338e4-fd5e-45b7-9156-8210072a725f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:10.533766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 207/422] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:10.537764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f338e4-fd5e-45b7-9156-8210072a725f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:10.572653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:10.608248 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:10.616456 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024add6-c376-4083-9d47-ad27e17da226 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:10.671396 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75dd1a-0d55-43b5-98fd-042e80e67697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:10.672048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75dd1a-0d55-43b5-98fd-042e80e67697 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:10.672332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75dd1a-0d55-43b5-98fd-042e80e67697 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:10.672584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75dd1a-0d55-43b5-98fd-042e80e67697 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:10.673249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75dd1a-0d55-43b5-98fd-042e80e67697 None admin] RBAC: Adding query filter params (name=member) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:10.673548 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75dd1a-0d55-43b5-98fd-042e80e67697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:10.675558 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c75dd1a-0d55-43b5-98fd-042e80e67697 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:10.699833 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 216/423] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:45:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:10.708881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75dd1a-0d55-43b5-98fd-042e80e67697 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:10.730659 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f338e4-fd5e-45b7-9156-8210072a725f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:10.769833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283941f8-6060-4fe7-babb-122dd374a51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:10.770681 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283941f8-6060-4fe7-babb-122dd374a51f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:10.770964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283941f8-6060-4fe7-babb-122dd374a51f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:10.771235 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283941f8-6060-4fe7-babb-122dd374a51f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:10.844604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283941f8-6060-4fe7-babb-122dd374a51f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:10.846136 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283941f8-6060-4fe7-babb-122dd374a51f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:10.869854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:10.949219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 208/424] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:10.957146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283941f8-6060-4fe7-babb-122dd374a51f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:10.972735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75dd1a-0d55-43b5-98fd-042e80e67697 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:11.042289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328a0b4-61b4-45c5-a5a9-13b832e029cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:11.042931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328a0b4-61b4-45c5-a5a9-13b832e029cb None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:11.043254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328a0b4-61b4-45c5-a5a9-13b832e029cb None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:11.043529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328a0b4-61b4-45c5-a5a9-13b832e029cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:11.063290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:11.150619 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283941f8-6060-4fe7-babb-122dd374a51f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:11.185615 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328a0b4-61b4-45c5-a5a9-13b832e029cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:11.187067 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328a0b4-61b4-45c5-a5a9-13b832e029cb None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:11.188262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:11.219092 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6e51d-e81f-4f2e-a478-df8d701f8a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:11.219725 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6e51d-e81f-4f2e-a478-df8d701f8a8f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:11.220028 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6e51d-e81f-4f2e-a478-df8d701f8a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:11.220297 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6e51d-e81f-4f2e-a478-df8d701f8a8f None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:11.222759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6e51d-e81f-4f2e-a478-df8d701f8a8f None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:11.224221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6e51d-e81f-4f2e-a478-df8d701f8a8f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:11.230365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 209/425] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:45:10 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:11.234230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6e51d-e81f-4f2e-a478-df8d701f8a8f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:11.375232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 217/426] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:11.381996 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328a0b4-61b4-45c5-a5a9-13b832e029cb None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:11.399474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6e51d-e81f-4f2e-a478-df8d701f8a8f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:11.460091 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:11.469035 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb52f3-48ee-4b56-ab0a-c63cc954a641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:11.475267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb52f3-48ee-4b56-ab0a-c63cc954a641 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:11.475267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb52f3-48ee-4b56-ab0a-c63cc954a641 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:11.475267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb52f3-48ee-4b56-ab0a-c63cc954a641 None admin] PATH_INFO: `/v3/groups/c3d994041fe74ac8b2794987468f6989` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:11.475267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb52f3-48ee-4b56-ab0a-c63cc954a641 None admin] RBAC: Authorizing `identity:get_group(group_id=c3d994041fe74ac8b2794987468f6989)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:11.475267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb52f3-48ee-4b56-ab0a-c63cc954a641 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:11.476556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 210/427] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 13:45:11 2022] GET /identity/v3/groups/c3d994041fe74ac8b2794987468f6989 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:11.482199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafceaa-3ce3-4ed9-b2b4-b853fc97bfc9 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:11.482820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafceaa-3ce3-4ed9-b2b4-b853fc97bfc9 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:11.483096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafceaa-3ce3-4ed9-b2b4-b853fc97bfc9 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:11.484732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 211/428] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:45:11.485428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafceaa-3ce3-4ed9-b2b4-b853fc97bfc9 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:11.542364 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:11.548448 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328a0b4-61b4-45c5-a5a9-13b832e029cb None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:11.594261 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930e8cb-9783-4de4-a3aa-dce67dc3d24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:11.595436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930e8cb-9783-4de4-a3aa-dce67dc3d24c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:11.595996 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930e8cb-9783-4de4-a3aa-dce67dc3d24c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:11.596536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930e8cb-9783-4de4-a3aa-dce67dc3d24c None admin] PATH_INFO: `/v3/projects/1a0e34213bab467880b704e894812e37` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:11.597142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafceaa-3ce3-4ed9-b2b4-b853fc97bfc9 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:11.598496 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930e8cb-9783-4de4-a3aa-dce67dc3d24c None admin] RBAC: Authorizing `identity:get_project(project_id=1a0e34213bab467880b704e894812e37)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:11.601370 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930e8cb-9783-4de4-a3aa-dce67dc3d24c None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:11.603563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 218/429] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:45:11 2022] GET /identity/v3/projects/1a0e34213bab467880b704e894812e37 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:11.605097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab393107-bbeb-4a04-aafb-e9e7de4a6b02 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:11.605564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab393107-bbeb-4a04-aafb-e9e7de4a6b02 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:11.606527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab393107-bbeb-4a04-aafb-e9e7de4a6b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:11.631553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-ab393107-bbeb-4a04-aafb-e9e7de4a6b02 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:11.632841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ab393107-bbeb-4a04-aafb-e9e7de4a6b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:11.634121 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7047920-4deb-4e28-b6af-d6bcd11d2198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:11.634729 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7047920-4deb-4e28-b6af-d6bcd11d2198 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:11.635002 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7047920-4deb-4e28-b6af-d6bcd11d2198 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:11.635271 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7047920-4deb-4e28-b6af-d6bcd11d2198 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:11.636133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7047920-4deb-4e28-b6af-d6bcd11d2198 None admin] RBAC: Adding query filter params (group.id=c3d994041fe74ac8b2794987468f6989, role.id=af21992d300b4bb3acb7b7f5f5b04252, scope.project.id=1a0e34213bab467880b704e894812e37) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:11.636340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7047920-4deb-4e28-b6af-d6bcd11d2198 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:11.637744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7047920-4deb-4e28-b6af-d6bcd11d2198 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:11.645254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 212/430] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 13:45:11 2022] GET /identity/v3/role_assignments?group.id=c3d994041fe74ac8b2794987468f6989&scope.project.id=1a0e34213bab467880b704e894812e37&role.id=af21992d300b4bb3acb7b7f5f5b04252 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:11.647923 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7047920-4deb-4e28-b6af-d6bcd11d2198 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:11.727972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 219/431] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:11.727972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431408b-f0f4-40e6-a536-aeb208f91c56 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:11.727972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431408b-f0f4-40e6-a536-aeb208f91c56 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:11.727972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431408b-f0f4-40e6-a536-aeb208f91c56 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:11.727972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 220/432] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:11.731073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44363fa2-39e2-4737-83d7-e8215954c3d9 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:11.731356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44363fa2-39e2-4737-83d7-e8215954c3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:11.733139 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44363fa2-39e2-4737-83d7-e8215954c3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:11.770055 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-44363fa2-39e2-4737-83d7-e8215954c3d9 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:11.771473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-44363fa2-39e2-4737-83d7-e8215954c3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:11.818244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:11.821948 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7047920-4deb-4e28-b6af-d6bcd11d2198 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:11.839409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:11.865364 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddfd2c-79f5-4315-829a-ffad3417695d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:11.866066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddfd2c-79f5-4315-829a-ffad3417695d None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:11.866345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddfd2c-79f5-4315-829a-ffad3417695d None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:11.866618 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddfd2c-79f5-4315-829a-ffad3417695d None admin] PATH_INFO: `/v3/groups/c3d994041fe74ac8b2794987468f6989` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:11.869560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddfd2c-79f5-4315-829a-ffad3417695d None admin] RBAC: Authorizing `identity:get_group(group_id=c3d994041fe74ac8b2794987468f6989)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:11.871007 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddfd2c-79f5-4315-829a-ffad3417695d None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:11.872023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 221/433] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:11.874014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 213/434] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 13:45:11 2022] GET /identity/v3/groups/c3d994041fe74ac8b2794987468f6989 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:11.880253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44363fa2-39e2-4737-83d7-e8215954c3d9 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:11.994552 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44363fa2-39e2-4737-83d7-e8215954c3d9 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:12.017117 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a7227-ebc5-41e9-a7c6-41338526233a None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:12.017505 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a7227-ebc5-41e9-a7c6-41338526233a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:12.017797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a7227-ebc5-41e9-a7c6-41338526233a None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:12.020095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 214/435] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:12.025887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361b2b6-ffda-46c4-b63b-63b4c134e0c8 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:12.026176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361b2b6-ffda-46c4-b63b-63b4c134e0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:12.026455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361b2b6-ffda-46c4-b63b-63b4c134e0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:12.036526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288ba1c-d977-4a81-9671-7f09d2a4e3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:12.037144 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288ba1c-d977-4a81-9671-7f09d2a4e3f3 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:12.037426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288ba1c-d977-4a81-9671-7f09d2a4e3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:12.037695 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288ba1c-d977-4a81-9671-7f09d2a4e3f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:12.038419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288ba1c-d977-4a81-9671-7f09d2a4e3f3 None admin] RBAC: Adding query filter params (group.id=c3d994041fe74ac8b2794987468f6989, role.id=d949d82256654aa9b25ca259d33df4c3, scope.project.id=1a0e34213bab467880b704e894812e37) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:12.038729 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288ba1c-d977-4a81-9671-7f09d2a4e3f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:12.040186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288ba1c-d977-4a81-9671-7f09d2a4e3f3 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:12.046598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 222/436] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 13:45:11 2022] GET /identity/v3/role_assignments?group.id=c3d994041fe74ac8b2794987468f6989&scope.project.id=1a0e34213bab467880b704e894812e37&role.id=d949d82256654aa9b25ca259d33df4c3 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:12.050376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288ba1c-d977-4a81-9671-7f09d2a4e3f3 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:12.056707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-b361b2b6-ffda-46c4-b63b-63b4c134e0c8 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:12.057938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b361b2b6-ffda-46c4-b63b-63b4c134e0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:12.100253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:12.141027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 215/437] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:12.190096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288ba1c-d977-4a81-9671-7f09d2a4e3f3 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:12.209226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361b2b6-ffda-46c4-b63b-63b4c134e0c8 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:12.231880 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e08a4-d204-4120-976b-e79da741618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:12.232555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e08a4-d204-4120-976b-e79da741618c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:12.232840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e08a4-d204-4120-976b-e79da741618c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:12.233119 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e08a4-d204-4120-976b-e79da741618c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:12.249136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e08a4-d204-4120-976b-e79da741618c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-aa4e08a4-d204-4120-976b-e79da741618c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:12.250889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:12.251792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:12.252694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:12.252694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:12.252694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:12.252694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:12.252694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:12.252694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:12.252694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:12.252694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:12.252694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:12.252694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:12.252694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 13:45:12.252694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:12.252694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 223/438] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:12.259192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e08a4-d204-4120-976b-e79da741618c None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:12.344440 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361b2b6-ffda-46c4-b63b-63b4c134e0c8 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:12.361456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:12.381308 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:12.388745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1ab63-d5d7-4036-aa5b-09c5050fc9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:12.389484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1ab63-d5d7-4036-aa5b-09c5050fc9aa None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:12.389843 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1ab63-d5d7-4036-aa5b-09c5050fc9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:12.390234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1ab63-d5d7-4036-aa5b-09c5050fc9aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:12.397779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e08a4-d204-4120-976b-e79da741618c None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:12.412442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1ab63-d5d7-4036-aa5b-09c5050fc9aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-62d1ab63-d5d7-4036-aa5b-09c5050fc9aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:12.417604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:12.418492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:12.419680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:12.419680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:12.419680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:12.419680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:12.419680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:12.419680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:12.419680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:12.419680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:12.419680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:12.419680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:12.419680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:45:12.419680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:12.419680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 216/439] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:45:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:45:12.424508 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1ab63-d5d7-4036-aa5b-09c5050fc9aa None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:12.446884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c7110-6168-4ab2-95bd-3f6610764d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:12.447494 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c7110-6168-4ab2-95bd-3f6610764d94 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:12.447772 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c7110-6168-4ab2-95bd-3f6610764d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:12.448073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c7110-6168-4ab2-95bd-3f6610764d94 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:12.448735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c7110-6168-4ab2-95bd-3f6610764d94 None admin] RBAC: Adding query filter params (name=member) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:12.449040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c7110-6168-4ab2-95bd-3f6610764d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:12.450410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c7110-6168-4ab2-95bd-3f6610764d94 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:12.459951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 224/440] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:45:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:12.460558 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c7110-6168-4ab2-95bd-3f6610764d94 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:12.553167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1ab63-d5d7-4036-aa5b-09c5050fc9aa None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:12.574701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c7110-6168-4ab2-95bd-3f6610764d94 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:12.592153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0de410-7f8e-4258-bd69-be75b6a59334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:12.593149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0de410-7f8e-4258-bd69-be75b6a59334 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:12.593863 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0de410-7f8e-4258-bd69-be75b6a59334 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:12.594295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0de410-7f8e-4258-bd69-be75b6a59334 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:12.594969 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0de410-7f8e-4258-bd69-be75b6a59334 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:12.595277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0de410-7f8e-4258-bd69-be75b6a59334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:12.597633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0de410-7f8e-4258-bd69-be75b6a59334 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:12.608098 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 217/441] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:12.608950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0de410-7f8e-4258-bd69-be75b6a59334 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:12.614004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca0dbf-2deb-4541-8624-1494ae943a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:12.614497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca0dbf-2deb-4541-8624-1494ae943a2d None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:12.615333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca0dbf-2deb-4541-8624-1494ae943a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:12.615333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca0dbf-2deb-4541-8624-1494ae943a2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:12.627556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca0dbf-2deb-4541-8624-1494ae943a2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-b0ca0dbf-2deb-4541-8624-1494ae943a2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:12.633463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:12.634451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:12.635464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:12.635464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:12.635464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:12.635464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:12.635464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:12.635464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:12.635464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:12.635464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:12.635464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:12.635464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:12.635464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:12.635464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:12.635464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 225/442] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:12.636466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca0dbf-2deb-4541-8624-1494ae943a2d None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:12.658128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:12.666934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:12.739888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0de410-7f8e-4258-bd69-be75b6a59334 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:12.754709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca0dbf-2deb-4541-8624-1494ae943a2d None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:12.773304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdcb25-5fc6-4286-9eef-f2705c7e1cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:12.773923 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdcb25-5fc6-4286-9eef-f2705c7e1cdc None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:12.774206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdcb25-5fc6-4286-9eef-f2705c7e1cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:12.774485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdcb25-5fc6-4286-9eef-f2705c7e1cdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:12.788420 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd425a07-583b-40d3-a645-4cc51b3b7aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:12.789022 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd425a07-583b-40d3-a645-4cc51b3b7aff None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:12.789300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd425a07-583b-40d3-a645-4cc51b3b7aff None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:12.789577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd425a07-583b-40d3-a645-4cc51b3b7aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:12.842121 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdcb25-5fc6-4286-9eef-f2705c7e1cdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:12.843500 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdcb25-5fc6-4286-9eef-f2705c7e1cdc None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:12.855402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd425a07-583b-40d3-a645-4cc51b3b7aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:12.856893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd425a07-583b-40d3-a645-4cc51b3b7aff None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:12.871799 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:12.876511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:12.940672 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 218/443] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:12.941508 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdcb25-5fc6-4286-9eef-f2705c7e1cdc None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:12.959560 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 226/444] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:12.959560 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd425a07-583b-40d3-a645-4cc51b3b7aff None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:13.062243 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdcb25-5fc6-4286-9eef-f2705c7e1cdc None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:13.070949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd425a07-583b-40d3-a645-4cc51b3b7aff None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:13.084766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:13.097018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97faec-f139-4646-b151-70ab160b9c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:13.097271 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97faec-f139-4646-b151-70ab160b9c5e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:13.097553 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97faec-f139-4646-b151-70ab160b9c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:13.097827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97faec-f139-4646-b151-70ab160b9c5e None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:13.098478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97faec-f139-4646-b151-70ab160b9c5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:13.098779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97faec-f139-4646-b151-70ab160b9c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:13.100175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97faec-f139-4646-b151-70ab160b9c5e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:13.101497 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:13.104188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752de66e-fe49-460a-83c5-88bb3534b84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:13.104807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752de66e-fe49-460a-83c5-88bb3534b84f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:13.105083 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752de66e-fe49-460a-83c5-88bb3534b84f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:13.105349 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752de66e-fe49-460a-83c5-88bb3534b84f None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:13.106457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752de66e-fe49-460a-83c5-88bb3534b84f None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:13.107858 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752de66e-fe49-460a-83c5-88bb3534b84f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:13.108607 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 219/445] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:13.109390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97faec-f139-4646-b151-70ab160b9c5e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:13.112529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 227/446] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:45:12 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:13.114997 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752de66e-fe49-460a-83c5-88bb3534b84f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:13.210690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97faec-f139-4646-b151-70ab160b9c5e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:13.218227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752de66e-fe49-460a-83c5-88bb3534b84f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:13.244576 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cea87-dd86-4575-9471-b0aa8c580d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:13.245404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cea87-dd86-4575-9471-b0aa8c580d77 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:13.245685 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cea87-dd86-4575-9471-b0aa8c580d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:13.245956 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cea87-dd86-4575-9471-b0aa8c580d77 None admin] PATH_INFO: `/v3/projects/23177498aced4c369ddf2b5e5acd5ca2` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:13.247136 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cea87-dd86-4575-9471-b0aa8c580d77 None admin] RBAC: Authorizing `identity:get_project(project_id=23177498aced4c369ddf2b5e5acd5ca2)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:13.248604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cea87-dd86-4575-9471-b0aa8c580d77 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:13.250229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 220/447] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:45:13 2022] GET /identity/v3/projects/23177498aced4c369ddf2b5e5acd5ca2 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:13.250987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cea87-dd86-4575-9471-b0aa8c580d77 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:13.251983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74e94d-bd9c-41ed-b859-43a4e9249106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:13.252595 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74e94d-bd9c-41ed-b859-43a4e9249106 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:13.253433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74e94d-bd9c-41ed-b859-43a4e9249106 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:13.253709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74e94d-bd9c-41ed-b859-43a4e9249106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:13.303980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:13.321173 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:13.324467 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74e94d-bd9c-41ed-b859-43a4e9249106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:13.326049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74e94d-bd9c-41ed-b859-43a4e9249106 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:13.359483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cea87-dd86-4575-9471-b0aa8c580d77 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:13.408351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21fa8e-dfd4-4910-a508-54de966ac1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:13.409512 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21fa8e-dfd4-4910-a508-54de966ac1cb None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:13.409794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21fa8e-dfd4-4910-a508-54de966ac1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:13.410068 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21fa8e-dfd4-4910-a508-54de966ac1cb None admin] PATH_INFO: `/v3/groups/c3d994041fe74ac8b2794987468f6989` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:13.411184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21fa8e-dfd4-4910-a508-54de966ac1cb None admin] RBAC: Authorizing `identity:get_group(group_id=c3d994041fe74ac8b2794987468f6989)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:13.412646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21fa8e-dfd4-4910-a508-54de966ac1cb None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:13.414202 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 221/448] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 13:45:13 2022] GET /identity/v3/groups/c3d994041fe74ac8b2794987468f6989 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:13.414952 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21fa8e-dfd4-4910-a508-54de966ac1cb None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:13.432920 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 228/449] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 13:45:13.434095 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74e94d-bd9c-41ed-b859-43a4e9249106 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:13.514307 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:13.519977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21fa8e-dfd4-4910-a508-54de966ac1cb None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:13.532512 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74e94d-bd9c-41ed-b859-43a4e9249106 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:13.549461 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:13.554634 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e593d-7548-4aba-9851-0d24082e16b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:13.555270 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e593d-7548-4aba-9851-0d24082e16b1 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:13.555553 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e593d-7548-4aba-9851-0d24082e16b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:13.559811 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e593d-7548-4aba-9851-0d24082e16b1 None admin] PATH_INFO: `/v3/groups/c3d994041fe74ac8b2794987468f6989` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:13.559811 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e593d-7548-4aba-9851-0d24082e16b1 None admin] RBAC: Authorizing `identity:get_group(group_id=c3d994041fe74ac8b2794987468f6989)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:13.559811 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e593d-7548-4aba-9851-0d24082e16b1 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:13.564839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 222/450] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 13:45:13 2022] GET /identity/v3/groups/c3d994041fe74ac8b2794987468f6989 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:13.566277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e593d-7548-4aba-9851-0d24082e16b1 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:13.568939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d136eb-608d-4a7d-ab7e-9c45e73f5344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:13.569538 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d136eb-608d-4a7d-ab7e-9c45e73f5344 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:13.569810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d136eb-608d-4a7d-ab7e-9c45e73f5344 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:13.570075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d136eb-608d-4a7d-ab7e-9c45e73f5344 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:13.570793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d136eb-608d-4a7d-ab7e-9c45e73f5344 None admin] RBAC: Adding query filter params (group.id=c3d994041fe74ac8b2794987468f6989, role.id=d949d82256654aa9b25ca259d33df4c3, scope.project.id=23177498aced4c369ddf2b5e5acd5ca2) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:13.571101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d136eb-608d-4a7d-ab7e-9c45e73f5344 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:13.572675 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d136eb-608d-4a7d-ab7e-9c45e73f5344 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:13.578595 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 229/451] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 13:45:13 2022] GET /identity/v3/role_assignments?group.id=c3d994041fe74ac8b2794987468f6989&scope.project.id=23177498aced4c369ddf2b5e5acd5ca2&role.id=d949d82256654aa9b25ca259d33df4c3 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:13.579179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d136eb-608d-4a7d-ab7e-9c45e73f5344 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:13.702746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e593d-7548-4aba-9851-0d24082e16b1 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:13.705126 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d136eb-608d-4a7d-ab7e-9c45e73f5344 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:13.743652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced898b9-c867-40db-9858-ac5986dcd7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:13.744404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced898b9-c867-40db-9858-ac5986dcd7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:13.744688 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced898b9-c867-40db-9858-ac5986dcd7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:13.744956 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced898b9-c867-40db-9858-ac5986dcd7f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:13.745691 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced898b9-c867-40db-9858-ac5986dcd7f0 None admin] RBAC: Adding query filter params (group.id=c3d994041fe74ac8b2794987468f6989, role.id=af21992d300b4bb3acb7b7f5f5b04252, scope.project.id=23177498aced4c369ddf2b5e5acd5ca2) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:13.746004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced898b9-c867-40db-9858-ac5986dcd7f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:13.747457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced898b9-c867-40db-9858-ac5986dcd7f0 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:13.747564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db146730-03c1-47e4-9bb0-7a0f9d50ae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:13.748215 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146730-03c1-47e4-9bb0-7a0f9d50ae08 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:13.748502 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146730-03c1-47e4-9bb0-7a0f9d50ae08 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:13.748777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146730-03c1-47e4-9bb0-7a0f9d50ae08 None admin] PATH_INFO: `/v3/projects/0fc2f50aab224fc68a4db65bf6dd738c` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:13.750003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db146730-03c1-47e4-9bb0-7a0f9d50ae08 None admin] RBAC: Authorizing `identity:get_project(project_id=0fc2f50aab224fc68a4db65bf6dd738c)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:13.751436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db146730-03c1-47e4-9bb0-7a0f9d50ae08 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:13.755206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 223/452] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:45:13 2022] GET /identity/v3/projects/0fc2f50aab224fc68a4db65bf6dd738c => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:13.757859 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 230/453] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 13:45:13 2022] GET /identity/v3/role_assignments?group.id=c3d994041fe74ac8b2794987468f6989&scope.project.id=23177498aced4c369ddf2b5e5acd5ca2&role.id=af21992d300b4bb3acb7b7f5f5b04252 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:13.765243 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db146730-03c1-47e4-9bb0-7a0f9d50ae08 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:13.848302 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:13.886842 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db146730-03c1-47e4-9bb0-7a0f9d50ae08 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:13.923789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea9a2c-b2b4-412d-9f5a-2f922e9cefe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:13.924819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea9a2c-b2b4-412d-9f5a-2f922e9cefe6 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:13.925258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea9a2c-b2b4-412d-9f5a-2f922e9cefe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:13.926122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea9a2c-b2b4-412d-9f5a-2f922e9cefe6 None admin] PATH_INFO: `/v3/groups/8fc47130a8c54592bb887cc90f1332f1` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:13.927320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea9a2c-b2b4-412d-9f5a-2f922e9cefe6 None admin] RBAC: Authorizing `identity:get_group(group_id=8fc47130a8c54592bb887cc90f1332f1)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:13.928840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea9a2c-b2b4-412d-9f5a-2f922e9cefe6 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:13.931453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 224/454] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Sep 1 13:45:13 2022] GET /identity/v3/groups/8fc47130a8c54592bb887cc90f1332f1 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:13.937513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced898b9-c867-40db-9858-ac5986dcd7f0 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:13.951035 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:14.042315 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced898b9-c867-40db-9858-ac5986dcd7f0 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:14.082223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c6918-c80d-4caf-b48a-96f3a4acb579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:14.082979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c6918-c80d-4caf-b48a-96f3a4acb579 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:14.083123 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c6918-c80d-4caf-b48a-96f3a4acb579 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:14.083377 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c6918-c80d-4caf-b48a-96f3a4acb579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:14.084145 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c6918-c80d-4caf-b48a-96f3a4acb579 None admin] RBAC: Adding query filter params (group.id=8fc47130a8c54592bb887cc90f1332f1, role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=0fc2f50aab224fc68a4db65bf6dd738c) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:14.084469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c6918-c80d-4caf-b48a-96f3a4acb579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:14.085937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c6918-c80d-4caf-b48a-96f3a4acb579 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:14.091897 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 231/455] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Sep 1 13:45:13 2022] GET /identity/v3/role_assignments?group.id=8fc47130a8c54592bb887cc90f1332f1&scope.project.id=0fc2f50aab224fc68a4db65bf6dd738c&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:16.392350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac29f-df14-4e77-a753-996a0672d8e4 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:16.392862 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac29f-df14-4e77-a753-996a0672d8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:16.392964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac29f-df14-4e77-a753-996a0672d8e4 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:16.394528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 225/456] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:16.400184 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed2000-3f23-4d18-b1a4-53f866bcd0e6 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:16.401000 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed2000-3f23-4d18-b1a4-53f866bcd0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:16.401501 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed2000-3f23-4d18-b1a4-53f866bcd0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:16.420737 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-1aed2000-3f23-4d18-b1a4-53f866bcd0e6 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:16.422241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1aed2000-3f23-4d18-b1a4-53f866bcd0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:16.505228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 232/457] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:16.555140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b7256-2f65-4e3b-ad87-e4a9f7f482ee None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:16.555829 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b7256-2f65-4e3b-ad87-e4a9f7f482ee None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:16.556338 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b7256-2f65-4e3b-ad87-e4a9f7f482ee None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:16.557890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 226/458] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:16.563038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a493b7-848b-4833-ac86-ab4a2c69e417 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:16.563555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a493b7-848b-4833-ac86-ab4a2c69e417 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:16.564080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a493b7-848b-4833-ac86-ab4a2c69e417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:16.576343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:16.592136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-f5a493b7-848b-4833-ac86-ab4a2c69e417 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:16.593320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f5a493b7-848b-4833-ac86-ab4a2c69e417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:16.690288 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 233/459] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:16.983738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8735f-4533-472c-9c25-899e48348dd3 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:16.984093 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8735f-4533-472c-9c25-899e48348dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:16.984269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8735f-4533-472c-9c25-899e48348dd3 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:16.985921 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 227/460] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:16.987592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a493b7-848b-4833-ac86-ab4a2c69e417 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:16.991547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666eccb-1d28-46f8-b658-72f4f893cd01 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:16.991890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666eccb-1d28-46f8-b658-72f4f893cd01 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:16.992185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666eccb-1d28-46f8-b658-72f4f893cd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:17.022955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-0666eccb-1d28-46f8-b658-72f4f893cd01 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:17.027033 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0666eccb-1d28-46f8-b658-72f4f893cd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:17.152162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 228/461] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:17.154044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666eccb-1d28-46f8-b658-72f4f893cd01 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:17.164690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a493b7-848b-4833-ac86-ab4a2c69e417 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:17.227162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d10829-dff6-4dc2-89ea-03fd88098456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:17.227815 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d10829-dff6-4dc2-89ea-03fd88098456 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:17.228126 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d10829-dff6-4dc2-89ea-03fd88098456 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:17.228401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d10829-dff6-4dc2-89ea-03fd88098456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:17.230529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:17.240133 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d10829-dff6-4dc2-89ea-03fd88098456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:17.241508 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d10829-dff6-4dc2-89ea-03fd88098456 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:17.242655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-94d10829-dff6-4dc2-89ea-03fd88098456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:17.257658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:17.258882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:17.259748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:17.259748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:17.259748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:17.259748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 234/462] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:17.260654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45362-5ea3-4429-a667-423a078ae8b7 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:17.260654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45362-5ea3-4429-a667-423a078ae8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:17.260825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45362-5ea3-4429-a667-423a078ae8b7 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:17.266080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 235/463] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:17.266849 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa45362-5ea3-4429-a667-423a078ae8b7 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:17.289170 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666eccb-1d28-46f8-b658-72f4f893cd01 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:17.334819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e030a1-3a81-47ba-a749-c1a5e967d328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:17.335448 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e030a1-3a81-47ba-a749-c1a5e967d328 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:17.335774 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e030a1-3a81-47ba-a749-c1a5e967d328 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:17.336090 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e030a1-3a81-47ba-a749-c1a5e967d328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:17.346856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e030a1-3a81-47ba-a749-c1a5e967d328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:17.348530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e030a1-3a81-47ba-a749-c1a5e967d328 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-e6e030a1-3a81-47ba-a749-c1a5e967d328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:17.370358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:17.371281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:17.372166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:17.372166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:17.372166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:17.373414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 229/464] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:17.374711 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812a7a0-47d0-40b0-ab59-36c9b58ee4dc None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:17.374996 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812a7a0-47d0-40b0-ab59-36c9b58ee4dc None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:17.375266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812a7a0-47d0-40b0-ab59-36c9b58ee4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:17.394048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa45362-5ea3-4429-a667-423a078ae8b7 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:17.395569 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-5812a7a0-47d0-40b0-ab59-36c9b58ee4dc None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:17.396875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-5812a7a0-47d0-40b0-ab59-36c9b58ee4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:17.436194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e15d3-3dae-4284-8583-27868d1ae148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:17.437481 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e15d3-3dae-4284-8583-27868d1ae148 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:17.438013 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e15d3-3dae-4284-8583-27868d1ae148 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:17.438504 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e15d3-3dae-4284-8583-27868d1ae148 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:17.439425 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e15d3-3dae-4284-8583-27868d1ae148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:17.440654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e15d3-3dae-4284-8583-27868d1ae148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:17.442263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e15d3-3dae-4284-8583-27868d1ae148 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:17.456224 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 236/465] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:17.457601 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e15d3-3dae-4284-8583-27868d1ae148 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:17.478470 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 230/466] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:17.479795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812a7a0-47d0-40b0-ab59-36c9b58ee4dc None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:17.516973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:17.543694 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:17.575313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e15d3-3dae-4284-8583-27868d1ae148 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:17.599404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812a7a0-47d0-40b0-ab59-36c9b58ee4dc None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:17.612763 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35924a35-6690-4327-847f-5c9201bd93e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:17.613598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35924a35-6690-4327-847f-5c9201bd93e1 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:17.614023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35924a35-6690-4327-847f-5c9201bd93e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:17.614434 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35924a35-6690-4327-847f-5c9201bd93e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:17.615315 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35924a35-6690-4327-847f-5c9201bd93e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:17.615981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35924a35-6690-4327-847f-5c9201bd93e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:17.617481 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35924a35-6690-4327-847f-5c9201bd93e1 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:17.630804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 237/467] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:17.632022 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35924a35-6690-4327-847f-5c9201bd93e1 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:17.638363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644886b-c26f-4d84-a162-1d66ebc2ac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:17.639248 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644886b-c26f-4d84-a162-1d66ebc2ac9d None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:17.639715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644886b-c26f-4d84-a162-1d66ebc2ac9d None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:17.640161 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644886b-c26f-4d84-a162-1d66ebc2ac9d None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:17.641006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644886b-c26f-4d84-a162-1d66ebc2ac9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:17.642761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644886b-c26f-4d84-a162-1d66ebc2ac9d None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:17.736489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35924a35-6690-4327-847f-5c9201bd93e1 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:17.744412 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:17.766559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 231/468] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:45:17 2022] POST /identity/v3/users => generated 246 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:45:17.768034 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644886b-c26f-4d84-a162-1d66ebc2ac9d None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:17.775620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b32420-68eb-4fba-9cbe-1117021e296a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:17.776327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b32420-68eb-4fba-9cbe-1117021e296a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:17.776628 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b32420-68eb-4fba-9cbe-1117021e296a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:17.776902 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b32420-68eb-4fba-9cbe-1117021e296a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:17.791973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b32420-68eb-4fba-9cbe-1117021e296a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:17.794449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b32420-68eb-4fba-9cbe-1117021e296a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-93b32420-68eb-4fba-9cbe-1117021e296a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:17.815572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:17.816828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:17.817896 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:17.817896 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:17.817896 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:17.826639 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 238/469] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:17.827471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b32420-68eb-4fba-9cbe-1117021e296a None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:17.902571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644886b-c26f-4d84-a162-1d66ebc2ac9d None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:17.905083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:17.942651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2e064-456e-43fb-ba3a-1a0ea5a82162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:17.943270 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2e064-456e-43fb-ba3a-1a0ea5a82162 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:17.943554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2e064-456e-43fb-ba3a-1a0ea5a82162 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:17.943830 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2e064-456e-43fb-ba3a-1a0ea5a82162 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:17.944522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2e064-456e-43fb-ba3a-1a0ea5a82162 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:17.946118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2e064-456e-43fb-ba3a-1a0ea5a82162 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:17.950272 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b32420-68eb-4fba-9cbe-1117021e296a None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:17.988119 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b888f2-9a34-4a48-a389-7e9b1ce006e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:17.988757 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b888f2-9a34-4a48-a389-7e9b1ce006e7 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:17.989041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b888f2-9a34-4a48-a389-7e9b1ce006e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:17.989321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b888f2-9a34-4a48-a389-7e9b1ce006e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:18.000471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b888f2-9a34-4a48-a389-7e9b1ce006e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:18.001938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b888f2-9a34-4a48-a389-7e9b1ce006e7 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-a4b888f2-9a34-4a48-a389-7e9b1ce006e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:18.016547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:18.017676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:18.018657 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:18.018657 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:18.018657 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:18.018657 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 239/470] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:18.018657 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b888f2-9a34-4a48-a389-7e9b1ce006e7 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:18.030758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:18.050678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 232/471] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:45:17 2022] POST /identity/v3/users => generated 248 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:45:18.052029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b5b43-fde6-4160-b920-0152051d812e None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:18.052323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b5b43-fde6-4160-b920-0152051d812e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:18.052602 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b5b43-fde6-4160-b920-0152051d812e None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:18.053997 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 233/472] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:18.058360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b5b43-fde6-4160-b920-0152051d812e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:18.155004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b888f2-9a34-4a48-a389-7e9b1ce006e7 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:18.200693 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b308f6-c7f3-4935-b3e0-fdd5cc28bb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:18.201512 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b308f6-c7f3-4935-b3e0-fdd5cc28bb7d None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:18.201885 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b308f6-c7f3-4935-b3e0-fdd5cc28bb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:18.202230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b308f6-c7f3-4935-b3e0-fdd5cc28bb7d None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:18.203057 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b308f6-c7f3-4935-b3e0-fdd5cc28bb7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:18.203434 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b308f6-c7f3-4935-b3e0-fdd5cc28bb7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:18.205089 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b308f6-c7f3-4935-b3e0-fdd5cc28bb7d None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:18.219230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b5b43-fde6-4160-b920-0152051d812e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:18.220484 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 240/473] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:18.222464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378f938-a2f7-4700-8f83-2ee067f6f2ae None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:18.222767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378f938-a2f7-4700-8f83-2ee067f6f2ae None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:18.223768 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378f938-a2f7-4700-8f83-2ee067f6f2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:18.241420 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-3378f938-a2f7-4700-8f83-2ee067f6f2ae None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:18.242692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-3378f938-a2f7-4700-8f83-2ee067f6f2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:18.259695 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0034901-ed86-40fd-a83b-6cdab0dda21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:18.260346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0034901-ed86-40fd-a83b-6cdab0dda21d None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:18.260626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0034901-ed86-40fd-a83b-6cdab0dda21d None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:18.260899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0034901-ed86-40fd-a83b-6cdab0dda21d None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:18.261546 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0034901-ed86-40fd-a83b-6cdab0dda21d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:18.261867 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0034901-ed86-40fd-a83b-6cdab0dda21d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:18.263216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0034901-ed86-40fd-a83b-6cdab0dda21d None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:18.279623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 234/474] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:18.280421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0034901-ed86-40fd-a83b-6cdab0dda21d None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:18.310952 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:18.344943 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:18.355901 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 241/475] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:18.355901 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378f938-a2f7-4700-8f83-2ee067f6f2ae None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:18.435645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0034901-ed86-40fd-a83b-6cdab0dda21d None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:18.471368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe08f4b-e258-41a5-97f9-c9db4d2ba330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:18.471983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe08f4b-e258-41a5-97f9-c9db4d2ba330 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:18.473474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe08f4b-e258-41a5-97f9-c9db4d2ba330 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:18.474742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe08f4b-e258-41a5-97f9-c9db4d2ba330 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:18.475400 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe08f4b-e258-41a5-97f9-c9db4d2ba330 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:18.476861 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe08f4b-e258-41a5-97f9-c9db4d2ba330 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:18.523709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378f938-a2f7-4700-8f83-2ee067f6f2ae None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:18.559382 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d15e8-62cb-4dcc-9f75-5c3db981bfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:18.560282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d15e8-62cb-4dcc-9f75-5c3db981bfca None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:18.560559 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d15e8-62cb-4dcc-9f75-5c3db981bfca None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:18.560826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d15e8-62cb-4dcc-9f75-5c3db981bfca None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:18.561465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d15e8-62cb-4dcc-9f75-5c3db981bfca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:18.562879 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d15e8-62cb-4dcc-9f75-5c3db981bfca None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:18.607505 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 235/476] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:45:18 2022] POST /identity/v3/users => generated 248 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:45:18.649252 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe08f4b-e258-41a5-97f9-c9db4d2ba330 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:18.682761 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 242/477] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:45:18 2022] POST /identity/v3/users => generated 249 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:45:18.770729 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:18.802799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe08f4b-e258-41a5-97f9-c9db4d2ba330 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:18.853518 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d365b-ec66-4c8d-9f07-16b36a978d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:18.854062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d365b-ec66-4c8d-9f07-16b36a978d71 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:18.854348 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d365b-ec66-4c8d-9f07-16b36a978d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:18.854627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d365b-ec66-4c8d-9f07-16b36a978d71 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:18.855316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d365b-ec66-4c8d-9f07-16b36a978d71 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:18.856807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d365b-ec66-4c8d-9f07-16b36a978d71 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:18.892600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.sql.core [None req-0a4d365b-ec66-4c8d-9f07-16b36a978d71 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 13:45:18.892600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 13:45:18.892600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [parameters: {'id': 'a116c64b831d4a0ebd2e33b08b0efc4a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 13:45:18.892600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81700) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 13:45:18.910214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-0a4d365b-ec66-4c8d-9f07-16b36a978d71 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 13:45:18.910214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:18.910214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 13:45:18.910214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 13:45:18.910214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 13:45:18.910214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 13:45:18.910214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 13:45:18.910214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 13:45:18.910214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 13:45:18.910214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application conn.query(q) Sep 01 13:45:18.910214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 13:45:18.910214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 13:45:18.910214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 13:45:18.910214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application result.read() Sep 01 13:45:18.910214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 13:45:18.911164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application next(self.gen) Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application yield resource Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application next(self.gen) Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise self.value Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application session.commit() Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 13:45:18.912203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self.session.flush() Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application compat.raise_( Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 13:45:18.913058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 13:45:18.913917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application conn.query(q) Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application result.read() Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 13:45:18.914737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [parameters: {'id': 'a116c64b831d4a0ebd2e33b08b0efc4a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:18.915530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 13:45:18.917994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:18.919238 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 236/478] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Sep 1 13:45:18 2022] POST /identity/v3/roles => generated 144 bytes in 263 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:45:18.919359 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d15e8-62cb-4dcc-9f75-5c3db981bfca None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:18.984819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:19.033679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d15e8-62cb-4dcc-9f75-5c3db981bfca None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:19.071828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc9f01-fca4-4da0-bb25-1d27a1f649ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:19.072870 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc9f01-fca4-4da0-bb25-1d27a1f649ff None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:19.073402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc9f01-fca4-4da0-bb25-1d27a1f649ff None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:19.073877 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc9f01-fca4-4da0-bb25-1d27a1f649ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:19.085285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc9f01-fca4-4da0-bb25-1d27a1f649ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-69fc9f01-fca4-4da0-bb25-1d27a1f649ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:19.091019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:19.091937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:19.092781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:19.092781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:19.092781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:19.092781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:19.092781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:19.092781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:19.092781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:19.092781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:19.092781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:19.092781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:19.092781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 13:45:19.092781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:19.098073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 243/479] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:45:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:19.101665 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d365b-ec66-4c8d-9f07-16b36a978d71 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:19.214214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d365b-ec66-4c8d-9f07-16b36a978d71 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:19.251602 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fc8b0-e17e-41b6-b0ae-5d4fc15e6c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:19.252423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fc8b0-e17e-41b6-b0ae-5d4fc15e6c91 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:19.253346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fc8b0-e17e-41b6-b0ae-5d4fc15e6c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:19.253724 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fc8b0-e17e-41b6-b0ae-5d4fc15e6c91 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:19.254490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fc8b0-e17e-41b6-b0ae-5d4fc15e6c91 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:19.254982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fc8b0-e17e-41b6-b0ae-5d4fc15e6c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:19.256587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fc8b0-e17e-41b6-b0ae-5d4fc15e6c91 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:19.270285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 237/480] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:20.008793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0c13b-053d-45df-9e04-52405795ad2b None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:20.009831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0c13b-053d-45df-9e04-52405795ad2b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:20.010313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0c13b-053d-45df-9e04-52405795ad2b None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:20.012137 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 244/481] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:20.016952 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde54c4b-f636-49be-87e1-9d9e906cc939 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:20.017742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde54c4b-f636-49be-87e1-9d9e906cc939 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:20.018752 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde54c4b-f636-49be-87e1-9d9e906cc939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:20.027784 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:20.045460 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-fde54c4b-f636-49be-87e1-9d9e906cc939 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:20.046707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fde54c4b-f636-49be-87e1-9d9e906cc939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:20.128918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 238/482] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:20.347790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4f0b8-24b1-49a0-b761-ac878d2cf681 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:20.348185 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4f0b8-24b1-49a0-b761-ac878d2cf681 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:20.348379 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4f0b8-24b1-49a0-b761-ac878d2cf681 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:20.350042 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 245/483] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:20.354927 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc80cbd-972d-4607-93e0-6268f8f4c9d9 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:20.355223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc80cbd-972d-4607-93e0-6268f8f4c9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:20.355504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc80cbd-972d-4607-93e0-6268f8f4c9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:20.374513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-3cc80cbd-972d-4607-93e0-6268f8f4c9d9 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:20.375697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3cc80cbd-972d-4607-93e0-6268f8f4c9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:20.462174 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 239/484] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:20.532318 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4f0b8-24b1-49a0-b761-ac878d2cf681 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:20.668576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4f0b8-24b1-49a0-b761-ac878d2cf681 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:20.685771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:20.715223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc72592-011d-412b-9a11-53aadee7bba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:20.715857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc72592-011d-412b-9a11-53aadee7bba1 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:20.716160 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc72592-011d-412b-9a11-53aadee7bba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:20.716433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc72592-011d-412b-9a11-53aadee7bba1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:20.737532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc72592-011d-412b-9a11-53aadee7bba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-6dc72592-011d-412b-9a11-53aadee7bba1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:20.742577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:20.743520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:20.744964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:20.744964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:20.744964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:20.744964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:20.744964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:20.744964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:20.744964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:20.744964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:20.744964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:20.744964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:20.744964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:20.744964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:20.744964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 246/485] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:20.749525 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc80cbd-972d-4607-93e0-6268f8f4c9d9 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:20.840632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:20.882005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc80cbd-972d-4607-93e0-6268f8f4c9d9 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:20.924742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded6b80-a859-4441-ab90-d74faeb12eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:20.925271 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded6b80-a859-4441-ab90-d74faeb12eab None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:20.925549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded6b80-a859-4441-ab90-d74faeb12eab None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:20.925897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded6b80-a859-4441-ab90-d74faeb12eab None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:20.926565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded6b80-a859-4441-ab90-d74faeb12eab None admin] RBAC: Adding query filter params (name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:20.926866 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded6b80-a859-4441-ab90-d74faeb12eab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:20.928247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded6b80-a859-4441-ab90-d74faeb12eab None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:20.934940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc72592-011d-412b-9a11-53aadee7bba1 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:20.939406 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 240/486] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:20.945380 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded6b80-a859-4441-ab90-d74faeb12eab None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:21.115043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded6b80-a859-4441-ab90-d74faeb12eab None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:21.129273 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc72592-011d-412b-9a11-53aadee7bba1 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:21.164461 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:21.171210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e663c38-90e1-4c96-8e35-9a6aa8fbdca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:21.174802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e663c38-90e1-4c96-8e35-9a6aa8fbdca5 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:21.174802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e663c38-90e1-4c96-8e35-9a6aa8fbdca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:21.174802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e663c38-90e1-4c96-8e35-9a6aa8fbdca5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:21.176463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2657f-8155-4637-b448-7a4d617ccc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:21.177106 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2657f-8155-4637-b448-7a4d617ccc97 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:21.177392 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2657f-8155-4637-b448-7a4d617ccc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:21.177672 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2657f-8155-4637-b448-7a4d617ccc97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:21.183711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e663c38-90e1-4c96-8e35-9a6aa8fbdca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-4e663c38-90e1-4c96-8e35-9a6aa8fbdca5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:21.188928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:21.191480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:21.193478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:21.193478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:21.193478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:21.193478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:21.193478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:21.193478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:21.193478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:21.193478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:21.193478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:21.193478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:21.193478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:21.193478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:21.196297 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2657f-8155-4637-b448-7a4d617ccc97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:21.196446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 247/487] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:21.196586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2657f-8155-4637-b448-7a4d617ccc97 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:21.196726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f32a1-1185-4db1-9b83-d030ae6a48a2 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:21.196726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f32a1-1185-4db1-9b83-d030ae6a48a2 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:21.196726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f32a1-1185-4db1-9b83-d030ae6a48a2 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:21.196726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 248/488] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:21.196726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f32a1-1185-4db1-9b83-d030ae6a48a2 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-4bd2657f-8155-4637-b448-7a4d617ccc97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:21.216981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:21.219240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:21.221478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:21.221478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:21.221478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:21.221478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 241/489] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:45:21.221478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03646fd6-fb1b-4f0e-b78c-774a39d17544 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:21.221478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03646fd6-fb1b-4f0e-b78c-774a39d17544 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:21.221478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03646fd6-fb1b-4f0e-b78c-774a39d17544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:21.245150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:21.248674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-03646fd6-fb1b-4f0e-b78c-774a39d17544 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:21.248674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-03646fd6-fb1b-4f0e-b78c-774a39d17544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:21.324321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f32a1-1185-4db1-9b83-d030ae6a48a2 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:21.324794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 242/490] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:21.325722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03646fd6-fb1b-4f0e-b78c-774a39d17544 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:21.374421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fb105-ac8a-4608-bb10-178cdca588fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:21.375800 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fb105-ac8a-4608-bb10-178cdca588fc None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:21.376297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fb105-ac8a-4608-bb10-178cdca588fc None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:21.376812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fb105-ac8a-4608-bb10-178cdca588fc None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:21.378920 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fb105-ac8a-4608-bb10-178cdca588fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:21.379441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fb105-ac8a-4608-bb10-178cdca588fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:21.381775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fb105-ac8a-4608-bb10-178cdca588fc None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:21.399912 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 249/491] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:21.399912 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a377574-6f9d-448b-86b9-d7d8cef935eb None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:21.399912 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a377574-6f9d-448b-86b9-d7d8cef935eb None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:21.399912 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a377574-6f9d-448b-86b9-d7d8cef935eb None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:21.402228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 250/492] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:21.403910 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fb028-d90e-4659-867c-41d793d8e1ea None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:21.404195 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fb028-d90e-4659-867c-41d793d8e1ea None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:21.404478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fb028-d90e-4659-867c-41d793d8e1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:21.425165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-bf3fb028-d90e-4659-867c-41d793d8e1ea None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:21.426275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bf3fb028-d90e-4659-867c-41d793d8e1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:21.459528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03646fd6-fb1b-4f0e-b78c-774a39d17544 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:21.469552 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:21.497867 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 251/493] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:21.503566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fb028-d90e-4659-867c-41d793d8e1ea None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:21.505900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec654bd-c7e4-45ce-8322-6c7eae53f8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:21.506692 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec654bd-c7e4-45ce-8322-6c7eae53f8df None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:21.507120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec654bd-c7e4-45ce-8322-6c7eae53f8df None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:21.507539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec654bd-c7e4-45ce-8322-6c7eae53f8df None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:21.508642 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec654bd-c7e4-45ce-8322-6c7eae53f8df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:21.509103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec654bd-c7e4-45ce-8322-6c7eae53f8df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:21.510621 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec654bd-c7e4-45ce-8322-6c7eae53f8df None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:21.524795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 243/494] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:21.532339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec654bd-c7e4-45ce-8322-6c7eae53f8df None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:21.563110 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:21.672829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fb028-d90e-4659-867c-41d793d8e1ea None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:21.673184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec654bd-c7e4-45ce-8322-6c7eae53f8df None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:21.707498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9364ed6-fb53-4c1d-995c-9af8c20862f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:21.708073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9364ed6-fb53-4c1d-995c-9af8c20862f4 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:21.708357 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9364ed6-fb53-4c1d-995c-9af8c20862f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:21.708631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9364ed6-fb53-4c1d-995c-9af8c20862f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:21.715610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c47ff-304e-4a8b-876e-66dfb80e6427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:21.716408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c47ff-304e-4a8b-876e-66dfb80e6427 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:21.716683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c47ff-304e-4a8b-876e-66dfb80e6427 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:21.716975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c47ff-304e-4a8b-876e-66dfb80e6427 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:21.723126 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9364ed6-fb53-4c1d-995c-9af8c20862f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:21.724794 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9364ed6-fb53-4c1d-995c-9af8c20862f4 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:21.730989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c47ff-304e-4a8b-876e-66dfb80e6427 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:21.732912 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c47ff-304e-4a8b-876e-66dfb80e6427 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-c9364ed6-fb53-4c1d-995c-9af8c20862f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:21.739599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:21.740536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:21.741386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:21.741386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:21.741386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:21.741386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 252/495] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:21.742020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9364ed6-fb53-4c1d-995c-9af8c20862f4 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-531c47ff-304e-4a8b-876e-66dfb80e6427 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:21.754060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:21.754983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:21.756011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:21.756011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:21.756011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:21.756011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:21.756011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:21.756011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:21.756011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:21.756011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:21.756011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:45:21.756011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:21.756011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 244/496] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 13:45:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:21.757103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c47ff-304e-4a8b-876e-66dfb80e6427 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:21.793372 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:21.838803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:21.857697 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9364ed6-fb53-4c1d-995c-9af8c20862f4 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:21.868747 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c47ff-304e-4a8b-876e-66dfb80e6427 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:21.891953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adef79f-33df-4b5c-b122-8e2eb606dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:21.892584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adef79f-33df-4b5c-b122-8e2eb606dd5f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:21.892864 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adef79f-33df-4b5c-b122-8e2eb606dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:21.893723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adef79f-33df-4b5c-b122-8e2eb606dd5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:21.903901 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adef79f-33df-4b5c-b122-8e2eb606dd5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:21.904687 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d3142-bd15-490c-9d85-4f092e65fbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:21.905287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d3142-bd15-490c-9d85-4f092e65fbea None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:21.905573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d3142-bd15-490c-9d85-4f092e65fbea None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:21.905847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d3142-bd15-490c-9d85-4f092e65fbea None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:21.906481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d3142-bd15-490c-9d85-4f092e65fbea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:21.906786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d3142-bd15-490c-9d85-4f092e65fbea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:21.908183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d3142-bd15-490c-9d85-4f092e65fbea None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-7adef79f-33df-4b5c-b122-8e2eb606dd5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:21.910097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:21.910951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:21.911779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:21.911779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:21.911779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:21.911779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:21.911779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:21.911779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:21.911779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:21.911779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:21.911779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:21.911779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:21.911779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:21.911779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:21.911779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 253/497] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:21.912962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adef79f-33df-4b5c-b122-8e2eb606dd5f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:21.926115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 245/498] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:21.926115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d3142-bd15-490c-9d85-4f092e65fbea None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:22.006580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:22.013285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adef79f-33df-4b5c-b122-8e2eb606dd5f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:22.021672 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d3142-bd15-490c-9d85-4f092e65fbea None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:22.047119 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631865d-d302-46c3-bb8f-33aa74dc327a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:22.047722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631865d-d302-46c3-bb8f-33aa74dc327a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:22.048033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631865d-d302-46c3-bb8f-33aa74dc327a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:22.048305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631865d-d302-46c3-bb8f-33aa74dc327a None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:22.049030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631865d-d302-46c3-bb8f-33aa74dc327a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:22.049862 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631865d-d302-46c3-bb8f-33aa74dc327a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:22.051407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631865d-d302-46c3-bb8f-33aa74dc327a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:22.056531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc90391-035a-41d0-b8cd-e6f3fbbc48b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:22.057159 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc90391-035a-41d0-b8cd-e6f3fbbc48b7 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:22.057443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc90391-035a-41d0-b8cd-e6f3fbbc48b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:22.057716 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc90391-035a-41d0-b8cd-e6f3fbbc48b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:22.067780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc90391-035a-41d0-b8cd-e6f3fbbc48b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-8bc90391-035a-41d0-b8cd-e6f3fbbc48b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:22.072697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:22.073772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:22.074573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:22.074573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:22.074573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:22.074573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:22.074573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:22.074573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:22.074573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:22.074573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:22.074573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:22.074573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:22.074573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:22.074573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:22.074573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 246/499] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:22.075248 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739953-c33c-4cb5-be66-508223f57a71 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:22.075248 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739953-c33c-4cb5-be66-508223f57a71 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:22.075444 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e739953-c33c-4cb5-be66-508223f57a71 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:22.075737 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:22.076808 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 247/500] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:22.077375 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e739953-c33c-4cb5-be66-508223f57a71 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:22.097437 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 254/501] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 13:45:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:22.097437 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631865d-d302-46c3-bb8f-33aa74dc327a None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:22.185627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e739953-c33c-4cb5-be66-508223f57a71 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:22.197663 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631865d-d302-46c3-bb8f-33aa74dc327a None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:22.219666 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67313e67-82a1-405a-97e3-897d8ed2fe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:22.220310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67313e67-82a1-405a-97e3-897d8ed2fe98 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:22.220593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67313e67-82a1-405a-97e3-897d8ed2fe98 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:22.220873 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67313e67-82a1-405a-97e3-897d8ed2fe98 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:22.222119 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67313e67-82a1-405a-97e3-897d8ed2fe98 None admin] RBAC: Adding query filter params (name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:22.222490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67313e67-82a1-405a-97e3-897d8ed2fe98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:22.223793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67313e67-82a1-405a-97e3-897d8ed2fe98 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:22.231499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 248/502] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:22.231680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17596a5a-87e9-4dc9-a210-206cbddf327e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:22.232313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67313e67-82a1-405a-97e3-897d8ed2fe98 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:22.232426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17596a5a-87e9-4dc9-a210-206cbddf327e None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:22.232703 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17596a5a-87e9-4dc9-a210-206cbddf327e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:22.232865 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17596a5a-87e9-4dc9-a210-206cbddf327e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:22.240342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17596a5a-87e9-4dc9-a210-206cbddf327e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:22.241820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17596a5a-87e9-4dc9-a210-206cbddf327e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:22.246814 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-17596a5a-87e9-4dc9-a210-206cbddf327e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:22.255267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:22.256306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:22.257323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:22.257323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:22.257323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:22.257323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:22.257323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:22.257323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:22.257323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:22.257323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:22.257323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 13:45:22.257323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:22.257323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 255/503] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:22.258656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0cee3-cfe8-4881-b7ef-82fc8559e5ac None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:22.258656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0cee3-cfe8-4881-b7ef-82fc8559e5ac None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:22.258656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0cee3-cfe8-4881-b7ef-82fc8559e5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:22.276481 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-30a0cee3-cfe8-4881-b7ef-82fc8559e5ac None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:22.277668 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-30a0cee3-cfe8-4881-b7ef-82fc8559e5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:22.332457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:22.339963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67313e67-82a1-405a-97e3-897d8ed2fe98 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:22.345864 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 256/504] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:22.346720 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0cee3-cfe8-4881-b7ef-82fc8559e5ac None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:22.376724 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd614f-7ab9-4e4a-85f3-106e30f5dc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:22.378183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd614f-7ab9-4e4a-85f3-106e30f5dc62 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:22.378936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd614f-7ab9-4e4a-85f3-106e30f5dc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:22.379695 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd614f-7ab9-4e4a-85f3-106e30f5dc62 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:22.384020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd614f-7ab9-4e4a-85f3-106e30f5dc62 None admin] RBAC: Adding query filter params (name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:22.384342 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd614f-7ab9-4e4a-85f3-106e30f5dc62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:22.386578 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd614f-7ab9-4e4a-85f3-106e30f5dc62 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:22.395712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 249/505] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:22.396558 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd614f-7ab9-4e4a-85f3-106e30f5dc62 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:22.459446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0cee3-cfe8-4881-b7ef-82fc8559e5ac None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:22.468824 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:22.495723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2b07c-053f-4dd3-9cd2-ce9b1e0a61f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:22.496376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2b07c-053f-4dd3-9cd2-ce9b1e0a61f9 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:22.496655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2b07c-053f-4dd3-9cd2-ce9b1e0a61f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:22.496932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2b07c-053f-4dd3-9cd2-ce9b1e0a61f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:22.499011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd614f-7ab9-4e4a-85f3-106e30f5dc62 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:22.535152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedaeb66-2505-4f48-8396-5fae0a41e319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:22.535694 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedaeb66-2505-4f48-8396-5fae0a41e319 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:22.536016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedaeb66-2505-4f48-8396-5fae0a41e319 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:22.536289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedaeb66-2505-4f48-8396-5fae0a41e319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:22.546716 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedaeb66-2505-4f48-8396-5fae0a41e319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:22.548183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedaeb66-2505-4f48-8396-5fae0a41e319 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:22.558874 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-cedaeb66-2505-4f48-8396-5fae0a41e319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:22.562404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:22.563482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:22.564441 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:22.564441 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:22.564441 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:22.564441 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 250/506] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:22.564654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedaeb66-2505-4f48-8396-5fae0a41e319 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:22.579011 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2b07c-053f-4dd3-9cd2-ce9b1e0a61f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:22.581555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2b07c-053f-4dd3-9cd2-ce9b1e0a61f9 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:22.668554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedaeb66-2505-4f48-8396-5fae0a41e319 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:22.687952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 257/507] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:22.688970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2b07c-053f-4dd3-9cd2-ce9b1e0a61f9 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:22.696395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:22.707625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c43490-58a9-4a4b-ba52-5fd53035f916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:22.708293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c43490-58a9-4a4b-ba52-5fd53035f916 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:22.708572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c43490-58a9-4a4b-ba52-5fd53035f916 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:22.708844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c43490-58a9-4a4b-ba52-5fd53035f916 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:22.709565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c43490-58a9-4a4b-ba52-5fd53035f916 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:22.713162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c43490-58a9-4a4b-ba52-5fd53035f916 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:22.713162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c43490-58a9-4a4b-ba52-5fd53035f916 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:22.748103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 251/508] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Sep 1 13:45:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:22.748931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c43490-58a9-4a4b-ba52-5fd53035f916 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:22.775452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:22.791534 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2b07c-053f-4dd3-9cd2-ce9b1e0a61f9 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:22.826081 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb1403-b4df-4446-8bad-847f4bd1a7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:22.826719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb1403-b4df-4446-8bad-847f4bd1a7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:22.826997 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb1403-b4df-4446-8bad-847f4bd1a7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:22.827270 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb1403-b4df-4446-8bad-847f4bd1a7a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:22.837709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb1403-b4df-4446-8bad-847f4bd1a7a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:22.839179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb1403-b4df-4446-8bad-847f4bd1a7a5 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:22.851402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c43490-58a9-4a4b-ba52-5fd53035f916 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-a4fb1403-b4df-4446-8bad-847f4bd1a7a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:22.853721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:22.854679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:22.855523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:22.855523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:22.855523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:22.855523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 258/509] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:22.855759 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb1403-b4df-4446-8bad-847f4bd1a7a5 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:22.887170 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1d31e-5fc0-455c-a8c2-05c0b55f3159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:22.887775 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1d31e-5fc0-455c-a8c2-05c0b55f3159 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:22.888096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1d31e-5fc0-455c-a8c2-05c0b55f3159 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:22.888375 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1d31e-5fc0-455c-a8c2-05c0b55f3159 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:22.889012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1d31e-5fc0-455c-a8c2-05c0b55f3159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:22.889322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1d31e-5fc0-455c-a8c2-05c0b55f3159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:22.890698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1d31e-5fc0-455c-a8c2-05c0b55f3159 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:22.902472 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 252/510] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:22.903309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1d31e-5fc0-455c-a8c2-05c0b55f3159 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:22.945967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:22.954243 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb1403-b4df-4446-8bad-847f4bd1a7a5 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:22.989125 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac90c8-44b3-4f08-af97-30cd7fb347a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:22.989960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac90c8-44b3-4f08-af97-30cd7fb347a8 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:22.990244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac90c8-44b3-4f08-af97-30cd7fb347a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:22.990514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac90c8-44b3-4f08-af97-30cd7fb347a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:22.999213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:23.001335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac90c8-44b3-4f08-af97-30cd7fb347a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:23.002861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac90c8-44b3-4f08-af97-30cd7fb347a8 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:23.006018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1d31e-5fc0-455c-a8c2-05c0b55f3159 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-d0ac90c8-44b3-4f08-af97-30cd7fb347a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:23.017049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:23.018503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:23.019361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:23.019361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:23.019361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:23.019361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 259/511] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:23.019582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac90c8-44b3-4f08-af97-30cd7fb347a8 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:23.044357 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b428bfa-52b6-412c-a925-d69bee587a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:23.044908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b428bfa-52b6-412c-a925-d69bee587a8c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:23.045187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b428bfa-52b6-412c-a925-d69bee587a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:23.045451 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b428bfa-52b6-412c-a925-d69bee587a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:23.056343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b428bfa-52b6-412c-a925-d69bee587a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:23.057792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b428bfa-52b6-412c-a925-d69bee587a8c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-0b428bfa-52b6-412c-a925-d69bee587a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:23.072370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:23.073341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:23.074568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:23.074568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:23.074568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:23.074568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 253/512] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:23.074568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b428bfa-52b6-412c-a925-d69bee587a8c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:23.123161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac90c8-44b3-4f08-af97-30cd7fb347a8 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:23.156059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae6a8f-c0b7-4168-9a9d-8aaff64f5ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:23.156671 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae6a8f-c0b7-4168-9a9d-8aaff64f5ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:23.156957 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae6a8f-c0b7-4168-9a9d-8aaff64f5ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:23.157233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae6a8f-c0b7-4168-9a9d-8aaff64f5ca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:23.167265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:23.179789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b428bfa-52b6-412c-a925-d69bee587a8c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:23.224809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea21c5-0aa3-4da0-837a-04201ca3a1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:23.225429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea21c5-0aa3-4da0-837a-04201ca3a1ec None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:23.225688 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea21c5-0aa3-4da0-837a-04201ca3a1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:23.225965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea21c5-0aa3-4da0-837a-04201ca3a1ec None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:23.226611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea21c5-0aa3-4da0-837a-04201ca3a1ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:23.226904 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea21c5-0aa3-4da0-837a-04201ca3a1ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:23.228312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea21c5-0aa3-4da0-837a-04201ca3a1ec None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:23.231308 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:23.240768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 254/513] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:23.241314 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae6a8f-c0b7-4168-9a9d-8aaff64f5ca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:23.241579 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea21c5-0aa3-4da0-837a-04201ca3a1ec None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:23.242787 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae6a8f-c0b7-4168-9a9d-8aaff64f5ca2 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:23.342850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 260/514] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:23.343609 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae6a8f-c0b7-4168-9a9d-8aaff64f5ca2 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:23.377635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea21c5-0aa3-4da0-837a-04201ca3a1ec None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:23.418334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9909a79-27bf-4c54-80c7-970e7a0abd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:23.418965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9909a79-27bf-4c54-80c7-970e7a0abd1d None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:23.419240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9909a79-27bf-4c54-80c7-970e7a0abd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:23.419508 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9909a79-27bf-4c54-80c7-970e7a0abd1d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:23.427436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9909a79-27bf-4c54-80c7-970e7a0abd1d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:23.428890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9909a79-27bf-4c54-80c7-970e7a0abd1d None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-d9909a79-27bf-4c54-80c7-970e7a0abd1d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:23.440206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:23.441140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:23.442265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:23.442265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:23.442265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:23.442265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:23.442265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:23.442265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:23.442265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:23.442265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:23.442265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 13:45:23.442265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:23.442265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 255/515] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:23.442265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9909a79-27bf-4c54-80c7-970e7a0abd1d None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:23.454320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:23.457434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:23.463795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae6a8f-c0b7-4168-9a9d-8aaff64f5ca2 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:23.498489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dd40f-1119-4623-a7dc-aafa664043dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:23.499095 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dd40f-1119-4623-a7dc-aafa664043dc None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:23.499377 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dd40f-1119-4623-a7dc-aafa664043dc None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:23.499648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dd40f-1119-4623-a7dc-aafa664043dc None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:23.500315 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dd40f-1119-4623-a7dc-aafa664043dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:23.500620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dd40f-1119-4623-a7dc-aafa664043dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:23.501993 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dd40f-1119-4623-a7dc-aafa664043dc None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:23.513789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 261/516] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:23.514660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dd40f-1119-4623-a7dc-aafa664043dc None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:23.546095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9909a79-27bf-4c54-80c7-970e7a0abd1d None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:23.579347 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea74220-7135-403d-bc33-21265bfb30af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:23.579980 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea74220-7135-403d-bc33-21265bfb30af None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:23.580262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea74220-7135-403d-bc33-21265bfb30af None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:23.581086 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea74220-7135-403d-bc33-21265bfb30af None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:23.581723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea74220-7135-403d-bc33-21265bfb30af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:23.582025 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea74220-7135-403d-bc33-21265bfb30af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:23.583407 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea74220-7135-403d-bc33-21265bfb30af None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:23.594877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 256/517] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:23.595594 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea74220-7135-403d-bc33-21265bfb30af None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:23.615388 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dd40f-1119-4623-a7dc-aafa664043dc None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:23.649454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c76d85-dec3-4ad8-ae45-30e3d10e7b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:23.650083 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c76d85-dec3-4ad8-ae45-30e3d10e7b86 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:23.650425 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c76d85-dec3-4ad8-ae45-30e3d10e7b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:23.650705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c76d85-dec3-4ad8-ae45-30e3d10e7b86 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:23.658098 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c76d85-dec3-4ad8-ae45-30e3d10e7b86 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:23.659530 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c76d85-dec3-4ad8-ae45-30e3d10e7b86 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:23.666254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-13c76d85-dec3-4ad8-ae45-30e3d10e7b86 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:23.670672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:23.671744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:23.672882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:23.672882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:23.672882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:23.672882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:23.672882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:23.672882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:23.672882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:23.672882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:23.672882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:45:23.672882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:23.672882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 262/518] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:23.672882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c76d85-dec3-4ad8-ae45-30e3d10e7b86 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:23.691743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:23.697593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea74220-7135-403d-bc33-21265bfb30af None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:23.731240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042b0ff-2c3e-4c96-804a-2df8e3c216bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:23.731887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042b0ff-2c3e-4c96-804a-2df8e3c216bb None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:23.732187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042b0ff-2c3e-4c96-804a-2df8e3c216bb None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:23.732463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042b0ff-2c3e-4c96-804a-2df8e3c216bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:23.743452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042b0ff-2c3e-4c96-804a-2df8e3c216bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:23.744971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042b0ff-2c3e-4c96-804a-2df8e3c216bb None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-0042b0ff-2c3e-4c96-804a-2df8e3c216bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:23.760018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:23.760963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:23.762083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:23.762083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:23.762083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:23.762083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 257/519] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:23.762670 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042b0ff-2c3e-4c96-804a-2df8e3c216bb None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:23.783582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c76d85-dec3-4ad8-ae45-30e3d10e7b86 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:23.817641 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22222fc9-84f4-43f3-b735-157254538099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:23.818241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222fc9-84f4-43f3-b735-157254538099 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:23.818524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222fc9-84f4-43f3-b735-157254538099 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:23.818791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222fc9-84f4-43f3-b735-157254538099 None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:23.819518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22222fc9-84f4-43f3-b735-157254538099 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:23.819824 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22222fc9-84f4-43f3-b735-157254538099 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:23.821274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22222fc9-84f4-43f3-b735-157254538099 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:23.838450 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 263/520] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Sep 1 13:45:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:23.839246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22222fc9-84f4-43f3-b735-157254538099 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:23.865363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042b0ff-2c3e-4c96-804a-2df8e3c216bb None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:23.888202 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:23.898916 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895657a7-13c2-449c-a071-d7f5d2a31bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:23.899636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895657a7-13c2-449c-a071-d7f5d2a31bcd None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:23.899809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895657a7-13c2-449c-a071-d7f5d2a31bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:23.907283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895657a7-13c2-449c-a071-d7f5d2a31bcd None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:23.907283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895657a7-13c2-449c-a071-d7f5d2a31bcd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:23.907283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895657a7-13c2-449c-a071-d7f5d2a31bcd None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:23.911487 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:23.941525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22222fc9-84f4-43f3-b735-157254538099 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:23.974591 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6e8ab-f419-4345-94ca-186110260306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:23.975207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6e8ab-f419-4345-94ca-186110260306 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:23.975485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6e8ab-f419-4345-94ca-186110260306 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:23.975750 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6e8ab-f419-4345-94ca-186110260306 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:23.982147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6e8ab-f419-4345-94ca-186110260306 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:23.983586 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6e8ab-f419-4345-94ca-186110260306 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:23.995827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-86d6e8ab-f419-4345-94ca-186110260306 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:23.995827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:23.995827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:23.995827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:23.995827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:23.995827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:23.995827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:23.995827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:23.995827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:23.995827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:23.995827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:23.995827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:23.995827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:23.995827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:23.995827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:23.998080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:23.998951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:23.998951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:23.998951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:23.998951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:23.998951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:23.998951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:23.998951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:23.998951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:23.998951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 264/521] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:23.998951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6e8ab-f419-4345-94ca-186110260306 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:24.021384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 258/522] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:45:23 2022] POST /identity/v3/users => generated 247 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:45:24.022429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895657a7-13c2-449c-a071-d7f5d2a31bcd None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:24.114633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6e8ab-f419-4345-94ca-186110260306 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:24.139588 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895657a7-13c2-449c-a071-d7f5d2a31bcd None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:24.147782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:24.157494 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090ad5f-a39f-4bdf-8317-a2a59f51a7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:24.158355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090ad5f-a39f-4bdf-8317-a2a59f51a7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:24.158749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090ad5f-a39f-4bdf-8317-a2a59f51a7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:24.159387 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090ad5f-a39f-4bdf-8317-a2a59f51a7f3 None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:24.159926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090ad5f-a39f-4bdf-8317-a2a59f51a7f3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:24.160373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090ad5f-a39f-4bdf-8317-a2a59f51a7f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:24.162648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090ad5f-a39f-4bdf-8317-a2a59f51a7f3 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:24.184229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250e2cc-a2a2-46c9-859f-a7cce9f7c2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:24.184848 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250e2cc-a2a2-46c9-859f-a7cce9f7c2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:24.185133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250e2cc-a2a2-46c9-859f-a7cce9f7c2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:24.185408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250e2cc-a2a2-46c9-859f-a7cce9f7c2a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:24.186303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 265/523] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Sep 1 13:45:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:24.186410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250e2cc-a2a2-46c9-859f-a7cce9f7c2a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:24.186410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250e2cc-a2a2-46c9-859f-a7cce9f7c2a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:24.186990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090ad5f-a39f-4bdf-8317-a2a59f51a7f3 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:24.187761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250e2cc-a2a2-46c9-859f-a7cce9f7c2a3 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:24.202152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 259/524] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:24.205489 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250e2cc-a2a2-46c9-859f-a7cce9f7c2a3 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:24.254389 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:24.300811 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090ad5f-a39f-4bdf-8317-a2a59f51a7f3 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:24.314446 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250e2cc-a2a2-46c9-859f-a7cce9f7c2a3 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:24.337725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c4d15-3737-401b-9ab1-74f2f07a56ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:24.338600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c4d15-3737-401b-9ab1-74f2f07a56ab None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:24.338897 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c4d15-3737-401b-9ab1-74f2f07a56ab None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:24.339176 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c4d15-3737-401b-9ab1-74f2f07a56ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:24.350990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0148672-f69f-4dbe-ae1c-7f52cc4f2db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:24.351599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0148672-f69f-4dbe-ae1c-7f52cc4f2db3 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:24.351890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0148672-f69f-4dbe-ae1c-7f52cc4f2db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:24.352199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0148672-f69f-4dbe-ae1c-7f52cc4f2db3 None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:24.352900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0148672-f69f-4dbe-ae1c-7f52cc4f2db3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:24.353207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0148672-f69f-4dbe-ae1c-7f52cc4f2db3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:24.354632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0148672-f69f-4dbe-ae1c-7f52cc4f2db3 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:24.378031 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 260/525] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:24.378031 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0148672-f69f-4dbe-ae1c-7f52cc4f2db3 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:24.407277 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:24.420336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c4d15-3737-401b-9ab1-74f2f07a56ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:24.423977 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c4d15-3737-401b-9ab1-74f2f07a56ab None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:24.485560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:24.490047 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0148672-f69f-4dbe-ae1c-7f52cc4f2db3 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:24.527334 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 266/526] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:24.528355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c4d15-3737-401b-9ab1-74f2f07a56ab None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:24.533322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd507b1-4fa9-4c90-a3e1-f25268035477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:24.533978 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd507b1-4fa9-4c90-a3e1-f25268035477 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:24.534266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd507b1-4fa9-4c90-a3e1-f25268035477 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:24.534535 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd507b1-4fa9-4c90-a3e1-f25268035477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:24.609946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd507b1-4fa9-4c90-a3e1-f25268035477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:24.611410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd507b1-4fa9-4c90-a3e1-f25268035477 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:24.628281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:24.640722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c4d15-3737-401b-9ab1-74f2f07a56ab None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:24.681070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86b6c9-5344-41ae-aea3-7a25d9aab441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:24.682535 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86b6c9-5344-41ae-aea3-7a25d9aab441 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:24.682886 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86b6c9-5344-41ae-aea3-7a25d9aab441 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:24.683380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86b6c9-5344-41ae-aea3-7a25d9aab441 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:24.690408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86b6c9-5344-41ae-aea3-7a25d9aab441 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:24.691899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86b6c9-5344-41ae-aea3-7a25d9aab441 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:24.703793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-5e86b6c9-5344-41ae-aea3-7a25d9aab441 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:24.703793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:24.703793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:24.703793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:24.703793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:24.703793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:24.703793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:24.703793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:24.703793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:24.703793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:24.703793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:24.703793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:24.703793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:24.703793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:24.703793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:24.704831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:24.705726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:24.705726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:24.705726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:24.705726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:24.705726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:24.705726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:24.705726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:24.705726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:24.705726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 267/527] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:24.705726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86b6c9-5344-41ae-aea3-7a25d9aab441 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:24.717097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:24.720681 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 261/528] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:24.722040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd507b1-4fa9-4c90-a3e1-f25268035477 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:24.828894 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86b6c9-5344-41ae-aea3-7a25d9aab441 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:24.835770 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd507b1-4fa9-4c90-a3e1-f25268035477 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:24.868284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf551d3-c2e8-492e-a7cc-1892bca5db8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:24.868898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf551d3-c2e8-492e-a7cc-1892bca5db8e None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:24.869181 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf551d3-c2e8-492e-a7cc-1892bca5db8e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:24.869497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf551d3-c2e8-492e-a7cc-1892bca5db8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:24.870178 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf551d3-c2e8-492e-a7cc-1892bca5db8e None admin] RBAC: Adding query filter params (role.id=530c8dc4a70b4cb48bc4036a57ffa71b, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=4b3c8a90b97246a98612b627b5f8da80) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:24.870494 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf551d3-c2e8-492e-a7cc-1892bca5db8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:24.872036 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf551d3-c2e8-492e-a7cc-1892bca5db8e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:24.887902 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 268/529] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:45:24 2022] GET /identity/v3/role_assignments?user.id=4b3c8a90b97246a98612b627b5f8da80&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=530c8dc4a70b4cb48bc4036a57ffa71b => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:24.887902 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf551d3-c2e8-492e-a7cc-1892bca5db8e None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:24.893896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880dae2-5e0c-4c1f-a70f-080d8912b14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:24.894837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880dae2-5e0c-4c1f-a70f-080d8912b14b None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:24.895311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880dae2-5e0c-4c1f-a70f-080d8912b14b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:24.895774 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880dae2-5e0c-4c1f-a70f-080d8912b14b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:24.904079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:24.914256 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880dae2-5e0c-4c1f-a70f-080d8912b14b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:24.916214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880dae2-5e0c-4c1f-a70f-080d8912b14b None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-a880dae2-5e0c-4c1f-a70f-080d8912b14b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:24.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:24.941940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:24.943021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:24.943021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:24.943021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:24.943021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 262/530] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:24.944281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880dae2-5e0c-4c1f-a70f-080d8912b14b None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:25.013447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf551d3-c2e8-492e-a7cc-1892bca5db8e None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:25.028697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:25.053610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f5808-458e-4e3f-9f39-29c56664db22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:25.053820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f5808-458e-4e3f-9f39-29c56664db22 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:25.054077 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f5808-458e-4e3f-9f39-29c56664db22 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:25.054234 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f5808-458e-4e3f-9f39-29c56664db22 None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:25.054924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f5808-458e-4e3f-9f39-29c56664db22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:25.055304 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f5808-458e-4e3f-9f39-29c56664db22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:25.056864 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f5808-458e-4e3f-9f39-29c56664db22 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:25.087534 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 269/531] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:25.088629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f5808-458e-4e3f-9f39-29c56664db22 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:25.092743 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880dae2-5e0c-4c1f-a70f-080d8912b14b None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:25.129452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf1aac-1c3b-45bc-857e-d172d32e7c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:25.130602 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf1aac-1c3b-45bc-857e-d172d32e7c1e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:25.130880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf1aac-1c3b-45bc-857e-d172d32e7c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:25.131149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf1aac-1c3b-45bc-857e-d172d32e7c1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:25.146446 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf1aac-1c3b-45bc-857e-d172d32e7c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:25.148026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf1aac-1c3b-45bc-857e-d172d32e7c1e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-a7cf1aac-1c3b-45bc-857e-d172d32e7c1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:25.171966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:25.173127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:25.174692 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:25.174692 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:25.174692 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:25.174692 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 263/532] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:25.177173 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf1aac-1c3b-45bc-857e-d172d32e7c1e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:25.197760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:25.210226 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f5808-458e-4e3f-9f39-29c56664db22 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:25.246862 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd6e87-8007-4f98-8f84-399e0f717929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:25.253303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd6e87-8007-4f98-8f84-399e0f717929 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:25.253303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd6e87-8007-4f98-8f84-399e0f717929 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:25.253303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd6e87-8007-4f98-8f84-399e0f717929 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:25.253303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd6e87-8007-4f98-8f84-399e0f717929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:25.253303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd6e87-8007-4f98-8f84-399e0f717929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:25.253303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd6e87-8007-4f98-8f84-399e0f717929 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:25.268118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 270/533] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:25.269072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd6e87-8007-4f98-8f84-399e0f717929 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:25.282254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf1aac-1c3b-45bc-857e-d172d32e7c1e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:25.285745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:25.319087 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780a0d4-aab3-4b0e-9d33-fe1c9e1d1f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:25.320145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780a0d4-aab3-4b0e-9d33-fe1c9e1d1f0a None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:25.320523 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780a0d4-aab3-4b0e-9d33-fe1c9e1d1f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:25.321042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780a0d4-aab3-4b0e-9d33-fe1c9e1d1f0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:25.322160 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780a0d4-aab3-4b0e-9d33-fe1c9e1d1f0a None admin] RBAC: Adding query filter params (role.id=530c8dc4a70b4cb48bc4036a57ffa71b, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=0f750815038d404d9d39a68bf62db8c4) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:25.322569 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780a0d4-aab3-4b0e-9d33-fe1c9e1d1f0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:25.324119 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780a0d4-aab3-4b0e-9d33-fe1c9e1d1f0a None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:25.340195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 264/534] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:45:25 2022] GET /identity/v3/role_assignments?user.id=0f750815038d404d9d39a68bf62db8c4&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=530c8dc4a70b4cb48bc4036a57ffa71b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:25.341368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780a0d4-aab3-4b0e-9d33-fe1c9e1d1f0a None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:25.377907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd6e87-8007-4f98-8f84-399e0f717929 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:25.411286 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:25.416448 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630d71f-ccef-4b39-9a78-77364a0e3852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:25.417078 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630d71f-ccef-4b39-9a78-77364a0e3852 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:25.417363 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630d71f-ccef-4b39-9a78-77364a0e3852 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:25.417640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630d71f-ccef-4b39-9a78-77364a0e3852 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:25.418285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630d71f-ccef-4b39-9a78-77364a0e3852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:25.418594 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630d71f-ccef-4b39-9a78-77364a0e3852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:25.420083 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630d71f-ccef-4b39-9a78-77364a0e3852 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:25.438474 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 271/535] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:25.439997 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630d71f-ccef-4b39-9a78-77364a0e3852 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:25.476092 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780a0d4-aab3-4b0e-9d33-fe1c9e1d1f0a None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:25.515488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251e788-1640-4e0b-add6-f0a2802e6b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:25.516170 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251e788-1640-4e0b-add6-f0a2802e6b20 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:25.516449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251e788-1640-4e0b-add6-f0a2802e6b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:25.516720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251e788-1640-4e0b-add6-f0a2802e6b20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:25.524807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251e788-1640-4e0b-add6-f0a2802e6b20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:25.526285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251e788-1640-4e0b-add6-f0a2802e6b20 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:25.540073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-c251e788-1640-4e0b-add6-f0a2802e6b20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:25.540073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:25.540073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:25.540073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:25.540073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:25.540073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:25.540073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:25.540073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:25.540073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:25.540073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:25.540073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:25.540073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:25.540073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:25.540073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:25.540073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:25.541014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:25.541870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:25.541870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:25.541870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:25.541870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:25.541870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:25.541870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:25.541870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:25.541870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:25.541870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 265/536] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:25.548891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251e788-1640-4e0b-add6-f0a2802e6b20 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:25.586867 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:25.665633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251e788-1640-4e0b-add6-f0a2802e6b20 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:25.698704 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630d71f-ccef-4b39-9a78-77364a0e3852 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:25.713019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b2a2-39cd-4dbc-acba-6d508efa4707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:25.713686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b2a2-39cd-4dbc-acba-6d508efa4707 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:25.714018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b2a2-39cd-4dbc-acba-6d508efa4707 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:25.714340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411b2a2-39cd-4dbc-acba-6d508efa4707 None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:25.715033 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411b2a2-39cd-4dbc-acba-6d508efa4707 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:25.715334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411b2a2-39cd-4dbc-acba-6d508efa4707 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:25.719026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411b2a2-39cd-4dbc-acba-6d508efa4707 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:25.744842 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 266/537] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:25.761350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b2a2-39cd-4dbc-acba-6d508efa4707 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:25.774874 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb34ead-2e99-4646-9f6a-130b4ac5b62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:25.776680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb34ead-2e99-4646-9f6a-130b4ac5b62b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:25.776965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb34ead-2e99-4646-9f6a-130b4ac5b62b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:25.777232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb34ead-2e99-4646-9f6a-130b4ac5b62b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:25.791183 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb34ead-2e99-4646-9f6a-130b4ac5b62b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:25.792674 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb34ead-2e99-4646-9f6a-130b4ac5b62b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:25.815789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-3bb34ead-2e99-4646-9f6a-130b4ac5b62b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:25.815789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:25.815789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:25.815789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:25.815789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:25.815789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:25.815789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:25.815789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:25.815789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:25.815789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:25.815789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:25.815789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:25.815789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:25.815789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:25.815789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:25.816728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:25.817589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:25.817589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:25.817589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:25.817589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:25.817589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:25.817589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:25.817589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:25.817589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:25.818453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 272/538] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:25.825635 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb34ead-2e99-4646-9f6a-130b4ac5b62b None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:25.889071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:25.958105 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb34ead-2e99-4646-9f6a-130b4ac5b62b None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:25.962490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:25.985832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411b2a2-39cd-4dbc-acba-6d508efa4707 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:26.033321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3a74a-e8dd-4e4d-b56f-285a51dde8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:26.035314 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3a74a-e8dd-4e4d-b56f-285a51dde8dd None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:26.035598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3a74a-e8dd-4e4d-b56f-285a51dde8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:26.035890 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3a74a-e8dd-4e4d-b56f-285a51dde8dd None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:26.039003 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3a74a-e8dd-4e4d-b56f-285a51dde8dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:26.039333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3a74a-e8dd-4e4d-b56f-285a51dde8dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:26.040824 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3a74a-e8dd-4e4d-b56f-285a51dde8dd None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:26.060334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538d87d-4330-44d0-8c7f-0bad034f1ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:26.061071 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538d87d-4330-44d0-8c7f-0bad034f1ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:26.061353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538d87d-4330-44d0-8c7f-0bad034f1ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:26.061630 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538d87d-4330-44d0-8c7f-0bad034f1ee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:26.062359 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538d87d-4330-44d0-8c7f-0bad034f1ee4 None admin] RBAC: Adding query filter params (role.id=530c8dc4a70b4cb48bc4036a57ffa71b, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=4a9703db64624bbeb392d693ca60c6e3) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:26.062667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538d87d-4330-44d0-8c7f-0bad034f1ee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:26.064139 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538d87d-4330-44d0-8c7f-0bad034f1ee4 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:26.069088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 273/539] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:26.074739 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3a74a-e8dd-4e4d-b56f-285a51dde8dd None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:26.075199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 267/540] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:45:25 2022] GET /identity/v3/role_assignments?user.id=4a9703db64624bbeb392d693ca60c6e3&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=530c8dc4a70b4cb48bc4036a57ffa71b => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:26.102410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027f4bc-9433-447b-a988-826b443b184a None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:26.102712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027f4bc-9433-447b-a988-826b443b184a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:26.102960 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027f4bc-9433-447b-a988-826b443b184a None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:26.108007 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 268/541] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:45:26.110022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956e0a6-3ab3-4895-a985-ffc9b0d0bd16 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:26.110323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956e0a6-3ab3-4895-a985-ffc9b0d0bd16 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:26.110603 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956e0a6-3ab3-4895-a985-ffc9b0d0bd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:26.137140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-9956e0a6-3ab3-4895-a985-ffc9b0d0bd16 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:26.138412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-9956e0a6-3ab3-4895-a985-ffc9b0d0bd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:26.269365 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3a74a-e8dd-4e4d-b56f-285a51dde8dd None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:26.282041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 269/542] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:26.290426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:26.315984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5c27f-08c6-451b-8ad4-ef91473ed463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:26.316607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5c27f-08c6-451b-8ad4-ef91473ed463 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:26.316941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5c27f-08c6-451b-8ad4-ef91473ed463 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:26.317217 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5c27f-08c6-451b-8ad4-ef91473ed463 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:26.317943 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5c27f-08c6-451b-8ad4-ef91473ed463 None admin] RBAC: Adding query filter params (role.id=530c8dc4a70b4cb48bc4036a57ffa71b, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=92870867b169496fa8913b2ab93eac37) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:26.318253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5c27f-08c6-451b-8ad4-ef91473ed463 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:26.319685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5c27f-08c6-451b-8ad4-ef91473ed463 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:26.325596 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 274/543] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:45:26 2022] GET /identity/v3/role_assignments?user.id=92870867b169496fa8913b2ab93eac37&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=530c8dc4a70b4cb48bc4036a57ffa71b => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:26.689538 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956e0a6-3ab3-4895-a985-ffc9b0d0bd16 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:26.796959 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:26.816998 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956e0a6-3ab3-4895-a985-ffc9b0d0bd16 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:26.853504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3795e-bde6-48f1-b821-5ecf8b2f57dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:26.854140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3795e-bde6-48f1-b821-5ecf8b2f57dc None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:26.854414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3795e-bde6-48f1-b821-5ecf8b2f57dc None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:26.854687 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3795e-bde6-48f1-b821-5ecf8b2f57dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:26.866569 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3795e-bde6-48f1-b821-5ecf8b2f57dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-87f3795e-bde6-48f1-b821-5ecf8b2f57dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:26.871452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:26.874933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:26.878210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:26.878210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:26.878210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:26.878210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:26.878210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:26.878210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:26.878210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:26.878210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:26.878210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:26.878210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:26.878210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:26.878210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:26.878210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 270/544] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:26.881001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5c27f-08c6-451b-8ad4-ef91473ed463 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:27.029262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc16714-4be2-493a-b771-854c14c22513 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:27.029262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc16714-4be2-493a-b771-854c14c22513 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:27.029262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc16714-4be2-493a-b771-854c14c22513 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:27.029262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 271/545] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:45:27.031306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5c27f-08c6-451b-8ad4-ef91473ed463 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:27.037762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfc17b-9140-491d-8cf0-6b8ff6cfda26 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:27.037762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfc17b-9140-491d-8cf0-6b8ff6cfda26 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:27.037762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfc17b-9140-491d-8cf0-6b8ff6cfda26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:27.058908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-8ddfc17b-9140-491d-8cf0-6b8ff6cfda26 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:27.061959 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-8ddfc17b-9140-491d-8cf0-6b8ff6cfda26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:27.094730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dfdc8-0ff4-4569-a453-d1a9e159caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:27.095709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dfdc8-0ff4-4569-a453-d1a9e159caa8 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:27.096247 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dfdc8-0ff4-4569-a453-d1a9e159caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:27.096718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dfdc8-0ff4-4569-a453-d1a9e159caa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:27.097573 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007dfdc8-0ff4-4569-a453-d1a9e159caa8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:27.098096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007dfdc8-0ff4-4569-a453-d1a9e159caa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:27.099655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007dfdc8-0ff4-4569-a453-d1a9e159caa8 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:27.116927 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 275/546] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:27.122245 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dfdc8-0ff4-4569-a453-d1a9e159caa8 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:27.190274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:27.199036 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 272/547] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:45:27.256864 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dfdc8-0ff4-4569-a453-d1a9e159caa8 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:27.308654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2849f1-9d28-41e6-9cd5-fafbcaee859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:27.309302 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2849f1-9d28-41e6-9cd5-fafbcaee859b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:27.309587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2849f1-9d28-41e6-9cd5-fafbcaee859b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:27.309853 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2849f1-9d28-41e6-9cd5-fafbcaee859b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:27.324120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2849f1-9d28-41e6-9cd5-fafbcaee859b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:27.325579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2849f1-9d28-41e6-9cd5-fafbcaee859b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-dd2849f1-9d28-41e6-9cd5-fafbcaee859b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:27.346134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:27.347033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:27.348437 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:27.348437 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:27.348437 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:27.348437 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 276/548] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:45:27.353376 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfc17b-9140-491d-8cf0-6b8ff6cfda26 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:27.462024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:27.501514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfc17b-9140-491d-8cf0-6b8ff6cfda26 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:27.558126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ef2a0-02f0-4daa-a4f2-9105e5606852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:27.558816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ef2a0-02f0-4daa-a4f2-9105e5606852 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:27.559099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ef2a0-02f0-4daa-a4f2-9105e5606852 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:27.559312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ef2a0-02f0-4daa-a4f2-9105e5606852 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:27.560024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ef2a0-02f0-4daa-a4f2-9105e5606852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:27.560336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ef2a0-02f0-4daa-a4f2-9105e5606852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:27.561725 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ef2a0-02f0-4daa-a4f2-9105e5606852 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:27.575595 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 273/549] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:27.581753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2849f1-9d28-41e6-9cd5-fafbcaee859b None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:27.616789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ef2a0-02f0-4daa-a4f2-9105e5606852 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:27.696330 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:27.712187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2849f1-9d28-41e6-9cd5-fafbcaee859b None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:27.756527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650a4d9-00a2-43e3-95b4-359483c1dcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:27.757324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650a4d9-00a2-43e3-95b4-359483c1dcdb None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:27.757969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650a4d9-00a2-43e3-95b4-359483c1dcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:27.758269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ef2a0-02f0-4daa-a4f2-9105e5606852 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:27.758716 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650a4d9-00a2-43e3-95b4-359483c1dcdb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:27.768850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650a4d9-00a2-43e3-95b4-359483c1dcdb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:27.771429 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650a4d9-00a2-43e3-95b4-359483c1dcdb None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-5650a4d9-00a2-43e3-95b4-359483c1dcdb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:27.788854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:27.790041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:27.790994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:27.790994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:27.790994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:27.790994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:27.790994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:27.790994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:27.790994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:27.790994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:27.790994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:45:27.790994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:27.791606 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 277/550] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:45:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:27.793307 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce80bb7-5db7-436a-bf66-a3323eb319b8 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:27.793665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce80bb7-5db7-436a-bf66-a3323eb319b8 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:27.794011 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce80bb7-5db7-436a-bf66-a3323eb319b8 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:27.796051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:27.796287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 278/551] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:27.797184 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce80bb7-5db7-436a-bf66-a3323eb319b8 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:27.806267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8df91a-36e1-4f5e-93cc-1d98e3782690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:27.809195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8df91a-36e1-4f5e-93cc-1d98e3782690 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:27.809195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8df91a-36e1-4f5e-93cc-1d98e3782690 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:27.809195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8df91a-36e1-4f5e-93cc-1d98e3782690 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:27.820864 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8df91a-36e1-4f5e-93cc-1d98e3782690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-ed8df91a-36e1-4f5e-93cc-1d98e3782690 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:27.826847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:27.827779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:27.828683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:27.828683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:27.828683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:27.828683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:27.828683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:27.828683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:27.828683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:27.828683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:27.828683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:27.828683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:27.828683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:27.828683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:27.831938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 274/552] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:27.834792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2bbc6-d8b9-4145-934e-97c1c6324860 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:27.835967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2bbc6-d8b9-4145-934e-97c1c6324860 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:27.836357 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2bbc6-d8b9-4145-934e-97c1c6324860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:27.857581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-d9c2bbc6-d8b9-4145-934e-97c1c6324860 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:27.857581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d9c2bbc6-d8b9-4145-934e-97c1c6324860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:27.925777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce80bb7-5db7-436a-bf66-a3323eb319b8 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:27.935897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 275/553] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:27.935897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2bbc6-d8b9-4145-934e-97c1c6324860 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:28.005338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968f596-bac9-4ff7-9c60-bf8eeba02048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:28.006289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968f596-bac9-4ff7-9c60-bf8eeba02048 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:28.006776 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968f596-bac9-4ff7-9c60-bf8eeba02048 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:28.007228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968f596-bac9-4ff7-9c60-bf8eeba02048 None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:28.008430 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968f596-bac9-4ff7-9c60-bf8eeba02048 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:28.009179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968f596-bac9-4ff7-9c60-bf8eeba02048 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:28.011846 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968f596-bac9-4ff7-9c60-bf8eeba02048 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:28.050058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 279/554] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Sep 1 13:45:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:28.053193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968f596-bac9-4ff7-9c60-bf8eeba02048 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:28.080333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:28.092266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2bbc6-d8b9-4145-934e-97c1c6324860 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:28.116639 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:28.151135 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09aedfe-80e5-4a9f-bf18-e8216a61b211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:28.151135 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aedfe-80e5-4a9f-bf18-e8216a61b211 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:28.151135 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aedfe-80e5-4a9f-bf18-e8216a61b211 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:28.151135 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aedfe-80e5-4a9f-bf18-e8216a61b211 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:28.151548 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09aedfe-80e5-4a9f-bf18-e8216a61b211 None admin] RBAC: Adding query filter params (name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:28.151548 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09aedfe-80e5-4a9f-bf18-e8216a61b211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:28.152185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09aedfe-80e5-4a9f-bf18-e8216a61b211 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:28.171889 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 276/555] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:28.176785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09aedfe-80e5-4a9f-bf18-e8216a61b211 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:28.219489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968f596-bac9-4ff7-9c60-bf8eeba02048 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:28.256320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e13f3-0672-4373-afda-4e8b707f8b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:28.256992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e13f3-0672-4373-afda-4e8b707f8b77 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:28.257283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e13f3-0672-4373-afda-4e8b707f8b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:28.257561 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e13f3-0672-4373-afda-4e8b707f8b77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:28.328272 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e13f3-0672-4373-afda-4e8b707f8b77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:28.329743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5e13f3-0672-4373-afda-4e8b707f8b77 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:28.340374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:28.368739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09aedfe-80e5-4a9f-bf18-e8216a61b211 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:28.410942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e6c5c-3acd-46db-9c38-aa4daa3abeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:28.411956 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e6c5c-3acd-46db-9c38-aa4daa3abeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:28.411956 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e6c5c-3acd-46db-9c38-aa4daa3abeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:28.412370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e6c5c-3acd-46db-9c38-aa4daa3abeb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:28.423494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e6c5c-3acd-46db-9c38-aa4daa3abeb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:28.424848 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e6c5c-3acd-46db-9c38-aa4daa3abeb9 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-758e6c5c-3acd-46db-9c38-aa4daa3abeb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:28.442181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:28.443175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:28.444108 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:28.444108 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:28.444108 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:28.444108 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 277/556] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:28.444761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e6c5c-3acd-46db-9c38-aa4daa3abeb9 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:28.459944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 280/557] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:28.464833 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e13f3-0672-4373-afda-4e8b707f8b77 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:28.487293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:28.579502 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e6c5c-3acd-46db-9c38-aa4daa3abeb9 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:28.595458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e13f3-0672-4373-afda-4e8b707f8b77 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:28.606263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:28.625097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ba85c-8909-463b-a85e-1852a7268fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:28.625955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ba85c-8909-463b-a85e-1852a7268fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:28.626387 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ba85c-8909-463b-a85e-1852a7268fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:28.626860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ba85c-8909-463b-a85e-1852a7268fa8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:28.634151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53e3e4-f80c-4ac1-99ba-f853b4699eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:28.634760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53e3e4-f80c-4ac1-99ba-f853b4699eae None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:28.635201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53e3e4-f80c-4ac1-99ba-f853b4699eae None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:28.635483 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53e3e4-f80c-4ac1-99ba-f853b4699eae None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:28.636191 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53e3e4-f80c-4ac1-99ba-f853b4699eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:28.636499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53e3e4-f80c-4ac1-99ba-f853b4699eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:28.638176 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53e3e4-f80c-4ac1-99ba-f853b4699eae None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:28.639989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ba85c-8909-463b-a85e-1852a7268fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-460ba85c-8909-463b-a85e-1852a7268fa8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:28.645715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:28.646834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:28.647953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:28.647953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:28.647953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:28.647953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:28.647953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:28.647953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:28.647953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:28.647953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:28.647953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:28.647953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:28.647953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:28.647953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:28.649103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 278/558] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:28.649901 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ba85c-8909-463b-a85e-1852a7268fa8 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:28.659486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 281/559] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:28.659486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254484-eefb-4de1-8a59-a2c214cbbbc6 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:28.659486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254484-eefb-4de1-8a59-a2c214cbbbc6 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:28.659486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2254484-eefb-4de1-8a59-a2c214cbbbc6 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:28.659486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 282/560] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:28.659486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254484-eefb-4de1-8a59-a2c214cbbbc6 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:28.757166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:28.763280 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ba85c-8909-463b-a85e-1852a7268fa8 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:28.770201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2254484-eefb-4de1-8a59-a2c214cbbbc6 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:28.798702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708636f1-8411-43af-828a-423b7a307d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:28.799380 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708636f1-8411-43af-828a-423b7a307d28 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:28.799664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708636f1-8411-43af-828a-423b7a307d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:28.799974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708636f1-8411-43af-828a-423b7a307d28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:28.803503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52135bc1-44d1-4d69-8b9f-570db6a78aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:28.804195 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52135bc1-44d1-4d69-8b9f-570db6a78aed None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:28.804481 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52135bc1-44d1-4d69-8b9f-570db6a78aed None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:28.804755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52135bc1-44d1-4d69-8b9f-570db6a78aed None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:28.805415 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52135bc1-44d1-4d69-8b9f-570db6a78aed None admin] RBAC: Adding query filter params (name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:28.805723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52135bc1-44d1-4d69-8b9f-570db6a78aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:28.807101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52135bc1-44d1-4d69-8b9f-570db6a78aed None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:28.810354 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708636f1-8411-43af-828a-423b7a307d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:28.811780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708636f1-8411-43af-828a-423b7a307d28 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:28.815295 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 283/561] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:28.816841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52135bc1-44d1-4d69-8b9f-570db6a78aed None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-708636f1-8411-43af-828a-423b7a307d28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:28.826452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:28.827416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:28.828543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:28.828543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:28.828543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:28.828543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 279/562] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:28.829176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa1edb-630d-475e-81f5-77fb2ed56eb2 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:28.829176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa1edb-630d-475e-81f5-77fb2ed56eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:28.829431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa1edb-630d-475e-81f5-77fb2ed56eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:28.848289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-03aa1edb-630d-475e-81f5-77fb2ed56eb2 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:28.849136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:28.849419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-03aa1edb-630d-475e-81f5-77fb2ed56eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:28.929288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 280/563] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:28.930574 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888c090-cf9d-4ff1-a043-fe902031d263 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:28.930872 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888c090-cf9d-4ff1-a043-fe902031d263 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:28.931123 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888c090-cf9d-4ff1-a043-fe902031d263 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:28.932583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52135bc1-44d1-4d69-8b9f-570db6a78aed None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:28.934860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 281/564] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:28.937100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888c090-cf9d-4ff1-a043-fe902031d263 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:28.971973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb90a8-0f8c-4cd6-938d-3c4205b62d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:28.972508 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb90a8-0f8c-4cd6-938d-3c4205b62d9b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:28.972784 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb90a8-0f8c-4cd6-938d-3c4205b62d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:28.973115 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb90a8-0f8c-4cd6-938d-3c4205b62d9b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:28.981418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb90a8-0f8c-4cd6-938d-3c4205b62d9b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:28.982842 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb90a8-0f8c-4cd6-938d-3c4205b62d9b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-72eb90a8-0f8c-4cd6-938d-3c4205b62d9b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:28.995158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:28.996461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:28.997421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:28.997421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:28.997421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:28.997421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:28.997421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:28.997421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:28.997421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:28.997421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:28.997421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:45:28.997421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:28.997421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 284/565] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 13:45:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:29.000671 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb90a8-0f8c-4cd6-938d-3c4205b62d9b None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:29.030422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:29.053736 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888c090-cf9d-4ff1-a043-fe902031d263 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:29.092082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4cf67-27be-4bb6-bc7a-7ee101efc9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:29.092828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4cf67-27be-4bb6-bc7a-7ee101efc9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:29.093165 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4cf67-27be-4bb6-bc7a-7ee101efc9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:29.093552 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4cf67-27be-4bb6-bc7a-7ee101efc9f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:29.099480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:29.104627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4cf67-27be-4bb6-bc7a-7ee101efc9f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:29.106134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4cf67-27be-4bb6-bc7a-7ee101efc9f9 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:29.109357 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb90a8-0f8c-4cd6-938d-3c4205b62d9b None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-14c4cf67-27be-4bb6-bc7a-7ee101efc9f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:29.122153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:29.123295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:29.124199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:29.124199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:29.124199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:29.124199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 282/566] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:29.124818 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb124f3e-69d1-4737-8527-e6cc9ff8f1a8 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:29.124818 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb124f3e-69d1-4737-8527-e6cc9ff8f1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:29.125056 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb124f3e-69d1-4737-8527-e6cc9ff8f1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:29.144852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-fb124f3e-69d1-4737-8527-e6cc9ff8f1a8 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:29.146268 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fb124f3e-69d1-4737-8527-e6cc9ff8f1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:29.150926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b619bc6-8fa1-4dbb-b234-c3e8df8221cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:29.151540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b619bc6-8fa1-4dbb-b234-c3e8df8221cd None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:29.151821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b619bc6-8fa1-4dbb-b234-c3e8df8221cd None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:29.152125 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b619bc6-8fa1-4dbb-b234-c3e8df8221cd None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:29.152771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b619bc6-8fa1-4dbb-b234-c3e8df8221cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:29.153099 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b619bc6-8fa1-4dbb-b234-c3e8df8221cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:29.154614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b619bc6-8fa1-4dbb-b234-c3e8df8221cd None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:29.171621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 285/567] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:29.172520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b619bc6-8fa1-4dbb-b234-c3e8df8221cd None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:29.226523 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 283/568] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:29.227385 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb124f3e-69d1-4737-8527-e6cc9ff8f1a8 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:29.290262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b619bc6-8fa1-4dbb-b234-c3e8df8221cd None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:29.290462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:29.331945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb124f3e-69d1-4737-8527-e6cc9ff8f1a8 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:29.335199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aee7fb-50e7-4d2b-b7e7-39b9832ed1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:29.336068 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aee7fb-50e7-4d2b-b7e7-39b9832ed1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:29.336547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aee7fb-50e7-4d2b-b7e7-39b9832ed1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:29.337032 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aee7fb-50e7-4d2b-b7e7-39b9832ed1a5 None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:29.337949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aee7fb-50e7-4d2b-b7e7-39b9832ed1a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:29.338461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aee7fb-50e7-4d2b-b7e7-39b9832ed1a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:29.340504 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aee7fb-50e7-4d2b-b7e7-39b9832ed1a5 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:29.359269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 286/569] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 13:45:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:29.359819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aee7fb-50e7-4d2b-b7e7-39b9832ed1a5 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:29.369461 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d7aeb-1e28-4284-b435-6aa6a7d975da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:29.370058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d7aeb-1e28-4284-b435-6aa6a7d975da None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:29.370341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d7aeb-1e28-4284-b435-6aa6a7d975da None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:29.370611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d7aeb-1e28-4284-b435-6aa6a7d975da None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:29.371058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:29.371252 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d7aeb-1e28-4284-b435-6aa6a7d975da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:29.371559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d7aeb-1e28-4284-b435-6aa6a7d975da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:29.372965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d7aeb-1e28-4284-b435-6aa6a7d975da None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:29.385065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 284/570] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:29.385884 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d7aeb-1e28-4284-b435-6aa6a7d975da None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:29.475297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aee7fb-50e7-4d2b-b7e7-39b9832ed1a5 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:29.491537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d7aeb-1e28-4284-b435-6aa6a7d975da None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:29.511550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5054785-7bdc-46cd-a70f-c1a5164684cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:29.512123 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:29.512236 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5054785-7bdc-46cd-a70f-c1a5164684cb None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:29.512482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5054785-7bdc-46cd-a70f-c1a5164684cb None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:29.512753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5054785-7bdc-46cd-a70f-c1a5164684cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:29.519984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5054785-7bdc-46cd-a70f-c1a5164684cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:29.521437 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5054785-7bdc-46cd-a70f-c1a5164684cb None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:29.526024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e255cfb-feb2-4194-9ba8-9d96ee34d824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:29.532583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e255cfb-feb2-4194-9ba8-9d96ee34d824 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:29.532583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e255cfb-feb2-4194-9ba8-9d96ee34d824 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:29.532583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e255cfb-feb2-4194-9ba8-9d96ee34d824 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:29.533332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-b5054785-7bdc-46cd-a70f-c1a5164684cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:29.533332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:29.533332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:29.533332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:29.533332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:29.533332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:29.533332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:29.533332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:29.533332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:29.533332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:29.533332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:29.533332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:29.533332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:29.533332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:29.533332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:29.534969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:29.536284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:29.536284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:29.536284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:29.536284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:29.536284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:29.536284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:29.536284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:29.536284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:29.536284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 287/571] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:29.536284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5054785-7bdc-46cd-a70f-c1a5164684cb None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:29.541307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e255cfb-feb2-4194-9ba8-9d96ee34d824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-0e255cfb-feb2-4194-9ba8-9d96ee34d824 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:29.546198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:29.547333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:29.548240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:29.548240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:29.548240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:29.548240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:29.548240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:29.548240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:29.548240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:29.548240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:29.548240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:29.548240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:29.548240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:29.548240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:29.548240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 285/572] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:29.548240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e255cfb-feb2-4194-9ba8-9d96ee34d824 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:29.607672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:29.640566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5054785-7bdc-46cd-a70f-c1a5164684cb None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:29.650893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e255cfb-feb2-4194-9ba8-9d96ee34d824 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:29.674852 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9849792-dfec-42fc-a7a4-574eb3d282f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:29.675480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9849792-dfec-42fc-a7a4-574eb3d282f6 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:29.675766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9849792-dfec-42fc-a7a4-574eb3d282f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:29.676070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9849792-dfec-42fc-a7a4-574eb3d282f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:29.684861 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9718c42-cc0c-462d-b3c7-c232deb0f65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:29.685479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9718c42-cc0c-462d-b3c7-c232deb0f65e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:29.685757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9718c42-cc0c-462d-b3c7-c232deb0f65e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:29.685978 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9849792-dfec-42fc-a7a4-574eb3d282f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:29.686070 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9718c42-cc0c-462d-b3c7-c232deb0f65e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:29.687422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9849792-dfec-42fc-a7a4-574eb3d282f6 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:29.693398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9718c42-cc0c-462d-b3c7-c232deb0f65e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:29.694828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9718c42-cc0c-462d-b3c7-c232deb0f65e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-b9849792-dfec-42fc-a7a4-574eb3d282f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:29.701649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:29.702598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:29.703500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:29.703500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:29.703500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:29.703500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 288/573] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:29.703500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9849792-dfec-42fc-a7a4-574eb3d282f6 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-f9718c42-cc0c-462d-b3c7-c232deb0f65e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:29.706237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:29.707427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:29.709221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:29.709221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:29.709221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:29.709221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:29.709221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:29.709221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:29.709221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:29.709221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:29.709221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 13:45:29.709221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:29.709221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 286/574] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:29.709221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9718c42-cc0c-462d-b3c7-c232deb0f65e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:29.751817 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:29.808386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9849792-dfec-42fc-a7a4-574eb3d282f6 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:29.809765 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9718c42-cc0c-462d-b3c7-c232deb0f65e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:29.829027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:29.843113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa2f6a-982c-418a-bc0d-1ec5d92b9378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:29.843301 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16072295-7518-4480-b74e-189e667d38d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:29.843740 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa2f6a-982c-418a-bc0d-1ec5d92b9378 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:29.843839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16072295-7518-4480-b74e-189e667d38d7 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:29.844053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa2f6a-982c-418a-bc0d-1ec5d92b9378 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:29.844154 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16072295-7518-4480-b74e-189e667d38d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:29.844327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa2f6a-982c-418a-bc0d-1ec5d92b9378 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:29.844423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16072295-7518-4480-b74e-189e667d38d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:29.845101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16072295-7518-4480-b74e-189e667d38d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:29.845415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16072295-7518-4480-b74e-189e667d38d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:29.847467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16072295-7518-4480-b74e-189e667d38d7 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:29.855374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa2f6a-982c-418a-bc0d-1ec5d92b9378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:29.859385 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 287/575] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:29.860209 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16072295-7518-4480-b74e-189e667d38d7 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-72aa2f6a-982c-418a-bc0d-1ec5d92b9378 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:29.860347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:29.861297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:29.862685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:29.862685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:29.862685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:29.862685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:29.862685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:29.862685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:29.862685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:29.862685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:29.862685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:29.862685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:29.862685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:29.862685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:29.870301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 289/576] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:29.870301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa2f6a-982c-418a-bc0d-1ec5d92b9378 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:29.956312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:29.959704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16072295-7518-4480-b74e-189e667d38d7 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:29.965417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa2f6a-982c-418a-bc0d-1ec5d92b9378 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:29.994968 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80331f90-f92e-475b-b963-8c8540a2848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:29.995564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80331f90-f92e-475b-b963-8c8540a2848f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:29.995840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80331f90-f92e-475b-b963-8c8540a2848f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:29.996140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80331f90-f92e-475b-b963-8c8540a2848f None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:29.996785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80331f90-f92e-475b-b963-8c8540a2848f None admin] RBAC: Adding query filter params (name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:29.997083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80331f90-f92e-475b-b963-8c8540a2848f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:29.998429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80331f90-f92e-475b-b963-8c8540a2848f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:29.999259 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108f408-ce15-46b6-996f-088d20ac82fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:29.999887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108f408-ce15-46b6-996f-088d20ac82fc None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:30.000174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108f408-ce15-46b6-996f-088d20ac82fc None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:30.000449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108f408-ce15-46b6-996f-088d20ac82fc None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:30.001085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108f408-ce15-46b6-996f-088d20ac82fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:30.001395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108f408-ce15-46b6-996f-088d20ac82fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:30.003257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108f408-ce15-46b6-996f-088d20ac82fc None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:30.006461 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 288/577] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:30.007242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80331f90-f92e-475b-b963-8c8540a2848f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:30.021063 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 290/578] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:30.021063 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108f408-ce15-46b6-996f-088d20ac82fc None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:30.059547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:30.108930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80331f90-f92e-475b-b963-8c8540a2848f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:30.116753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108f408-ce15-46b6-996f-088d20ac82fc None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:30.142976 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413bd09-6657-4a17-97a4-0b2262542386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:30.143580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413bd09-6657-4a17-97a4-0b2262542386 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:30.143888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413bd09-6657-4a17-97a4-0b2262542386 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:30.144198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413bd09-6657-4a17-97a4-0b2262542386 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:30.144907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413bd09-6657-4a17-97a4-0b2262542386 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:30.145216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413bd09-6657-4a17-97a4-0b2262542386 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:30.146673 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413bd09-6657-4a17-97a4-0b2262542386 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:30.153026 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ac85b-711f-48c3-bbe3-795cbc37ac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:30.153638 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ac85b-711f-48c3-bbe3-795cbc37ac6e None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:30.153919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ac85b-711f-48c3-bbe3-795cbc37ac6e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:30.154192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ac85b-711f-48c3-bbe3-795cbc37ac6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:30.154921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ac85b-711f-48c3-bbe3-795cbc37ac6e None admin] RBAC: Adding query filter params (role.id=530c8dc4a70b4cb48bc4036a57ffa71b, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=cdebe1b674cc4b2bb6bf962de01a24ac) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:30.155232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ac85b-711f-48c3-bbe3-795cbc37ac6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:30.156681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ac85b-711f-48c3-bbe3-795cbc37ac6e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:30.162804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 291/579] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:45:30 2022] GET /identity/v3/role_assignments?user.id=cdebe1b674cc4b2bb6bf962de01a24ac&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=530c8dc4a70b4cb48bc4036a57ffa71b => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:30.163579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ac85b-711f-48c3-bbe3-795cbc37ac6e None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:30.168066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 289/580] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Sep 1 13:45:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:30.169073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413bd09-6657-4a17-97a4-0b2262542386 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:30.196984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:30.299148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413bd09-6657-4a17-97a4-0b2262542386 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:30.300760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ac85b-711f-48c3-bbe3-795cbc37ac6e None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:30.304997 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:30.338162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034d526-68e3-4ced-8b97-731f90f00a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:30.338794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034d526-68e3-4ced-8b97-731f90f00a69 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:30.339074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034d526-68e3-4ced-8b97-731f90f00a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:30.339344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034d526-68e3-4ced-8b97-731f90f00a69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:30.343341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c3627-5317-436d-8301-2492787d01f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:30.344245 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c3627-5317-436d-8301-2492787d01f3 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:30.344753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c3627-5317-436d-8301-2492787d01f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:30.345237 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c3627-5317-436d-8301-2492787d01f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:30.346807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c3627-5317-436d-8301-2492787d01f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:30.347333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c3627-5317-436d-8301-2492787d01f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:30.349050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c3627-5317-436d-8301-2492787d01f3 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:30.350169 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034d526-68e3-4ced-8b97-731f90f00a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:30.351603 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b034d526-68e3-4ced-8b97-731f90f00a69 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:30.358806 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 292/581] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:30.359892 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c3627-5317-436d-8301-2492787d01f3 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-b034d526-68e3-4ced-8b97-731f90f00a69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:30.370453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:30.371447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:30.372414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:30.372414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:30.372414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:30.372414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 290/582] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:30.372414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034d526-68e3-4ced-8b97-731f90f00a69 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:30.456520 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:30.476158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c3627-5317-436d-8301-2492787d01f3 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:30.488873 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034d526-68e3-4ced-8b97-731f90f00a69 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:30.509701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb2ca7-261a-4f8e-b783-117ed6cf2c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:30.510337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb2ca7-261a-4f8e-b783-117ed6cf2c15 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:30.510615 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb2ca7-261a-4f8e-b783-117ed6cf2c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:30.510890 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb2ca7-261a-4f8e-b783-117ed6cf2c15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:30.518167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb2ca7-261a-4f8e-b783-117ed6cf2c15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:30.519602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb2ca7-261a-4f8e-b783-117ed6cf2c15 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:30.526094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0f3d4-ad6a-46f1-b2bd-ec8086d2ac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:30.526963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0f3d4-ad6a-46f1-b2bd-ec8086d2ac10 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:30.527670 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0f3d4-ad6a-46f1-b2bd-ec8086d2ac10 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:30.528184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0f3d4-ad6a-46f1-b2bd-ec8086d2ac10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:30.530893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-eccb2ca7-261a-4f8e-b783-117ed6cf2c15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:30.530893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:30.530893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:30.530893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:30.530893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:30.530893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:30.530893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:30.530893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:30.530893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:30.530893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:30.530893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:30.530893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:30.530893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:30.530893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:30.530893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:30.531807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:30.533029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:30.533029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:30.533029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:30.533029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:30.533029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:30.533029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:30.533029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:30.533029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:30.537088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 293/583] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:30.537922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb2ca7-261a-4f8e-b783-117ed6cf2c15 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:30.544079 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0f3d4-ad6a-46f1-b2bd-ec8086d2ac10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:30.545841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0f3d4-ad6a-46f1-b2bd-ec8086d2ac10 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-11d0f3d4-ad6a-46f1-b2bd-ec8086d2ac10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:30.561931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:30.563129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:30.564290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:30.564290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:30.564290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:30.566226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 291/584] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:30.567242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0f3d4-ad6a-46f1-b2bd-ec8086d2ac10 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:30.573753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:30.654343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb2ca7-261a-4f8e-b783-117ed6cf2c15 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:30.684946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0f3d4-ad6a-46f1-b2bd-ec8086d2ac10 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:30.689057 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91112162-95fa-4f63-b78d-fd32026154ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:30.690214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91112162-95fa-4f63-b78d-fd32026154ad None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:30.690490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91112162-95fa-4f63-b78d-fd32026154ad None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:30.690758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91112162-95fa-4f63-b78d-fd32026154ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:30.702545 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91112162-95fa-4f63-b78d-fd32026154ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:30.704009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91112162-95fa-4f63-b78d-fd32026154ad None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:30.710505 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-91112162-95fa-4f63-b78d-fd32026154ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:30.718965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:30.722312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:30.723345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:30.723345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:30.723345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:30.723345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 294/585] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:30.723345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91112162-95fa-4f63-b78d-fd32026154ad None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:30.727077 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e4d56-2d42-4936-8a1c-315c0b76af25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:30.727784 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e4d56-2d42-4936-8a1c-315c0b76af25 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:30.728151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e4d56-2d42-4936-8a1c-315c0b76af25 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:30.728495 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e4d56-2d42-4936-8a1c-315c0b76af25 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:30.729213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e4d56-2d42-4936-8a1c-315c0b76af25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:30.729590 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e4d56-2d42-4936-8a1c-315c0b76af25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:30.731020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e4d56-2d42-4936-8a1c-315c0b76af25 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:30.754647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 292/586] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:30.754647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e4d56-2d42-4936-8a1c-315c0b76af25 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:30.807423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:30.829977 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91112162-95fa-4f63-b78d-fd32026154ad None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:30.863158 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e4d56-2d42-4936-8a1c-315c0b76af25 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:30.865354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ac7e3-31f0-4a1a-a067-e6ab75f1c44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:30.865963 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ac7e3-31f0-4a1a-a067-e6ab75f1c44a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:30.866243 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ac7e3-31f0-4a1a-a067-e6ab75f1c44a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:30.866516 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ac7e3-31f0-4a1a-a067-e6ab75f1c44a None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:30.867198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ac7e3-31f0-4a1a-a067-e6ab75f1c44a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:30.867506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ac7e3-31f0-4a1a-a067-e6ab75f1c44a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:30.868963 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ac7e3-31f0-4a1a-a067-e6ab75f1c44a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:30.887492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 295/587] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:30.887492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ac7e3-31f0-4a1a-a067-e6ab75f1c44a None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:30.907390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e94f61-add1-4a54-8fb4-d6a7f0010487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:30.908045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e94f61-add1-4a54-8fb4-d6a7f0010487 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:30.908363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e94f61-add1-4a54-8fb4-d6a7f0010487 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:30.908642 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e94f61-add1-4a54-8fb4-d6a7f0010487 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:30.909451 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e94f61-add1-4a54-8fb4-d6a7f0010487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:30.909944 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e94f61-add1-4a54-8fb4-d6a7f0010487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:30.911456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e94f61-add1-4a54-8fb4-d6a7f0010487 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:30.927893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 293/588] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:30.927893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e94f61-add1-4a54-8fb4-d6a7f0010487 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:30.974638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:31.007253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ac7e3-31f0-4a1a-a067-e6ab75f1c44a None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:31.033608 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e94f61-add1-4a54-8fb4-d6a7f0010487 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:31.043491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52179d9-0aad-4c22-ad86-03c35d75d5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:31.044135 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52179d9-0aad-4c22-ad86-03c35d75d5dc None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:31.044417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52179d9-0aad-4c22-ad86-03c35d75d5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:31.044792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52179d9-0aad-4c22-ad86-03c35d75d5dc None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:31.045439 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52179d9-0aad-4c22-ad86-03c35d75d5dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:31.045741 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52179d9-0aad-4c22-ad86-03c35d75d5dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:31.047116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52179d9-0aad-4c22-ad86-03c35d75d5dc None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:31.054737 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:31.059657 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 296/589] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:31.060452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52179d9-0aad-4c22-ad86-03c35d75d5dc None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:31.079217 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dabba-e676-4dd4-951e-a85673e55002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:31.079848 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dabba-e676-4dd4-951e-a85673e55002 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:31.080727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dabba-e676-4dd4-951e-a85673e55002 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:31.080950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dabba-e676-4dd4-951e-a85673e55002 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:31.088803 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dabba-e676-4dd4-951e-a85673e55002 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:31.090262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dabba-e676-4dd4-951e-a85673e55002 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-f09dabba-e676-4dd4-951e-a85673e55002 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:31.101847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:31.102905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:31.103885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:31.103885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:31.103885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:31.103885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:31.103885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:31.103885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:31.103885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:31.103885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:31.103885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 13:45:31.103885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:31.103885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 294/590] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:31.103885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dabba-e676-4dd4-951e-a85673e55002 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:31.183802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52179d9-0aad-4c22-ad86-03c35d75d5dc None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:31.215605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dabba-e676-4dd4-951e-a85673e55002 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:31.218145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:31.220707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21904df3-85d7-4502-8a71-449df0f56e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:31.221369 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21904df3-85d7-4502-8a71-449df0f56e2e None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:31.221652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21904df3-85d7-4502-8a71-449df0f56e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:31.221930 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21904df3-85d7-4502-8a71-449df0f56e2e None admin] PATH_INFO: `/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/4b3c8a90b97246a98612b627b5f8da80/roles/530c8dc4a70b4cb48bc4036a57ffa71b` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:31.237522 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21904df3-85d7-4502-8a71-449df0f56e2e None admin] RBAC: Authorizing `identity:create_grant(project_id=5e7998cc03064a0bb9a9dc6a1475d73c, user_id=4b3c8a90b97246a98612b627b5f8da80, role_id=530c8dc4a70b4cb48bc4036a57ffa71b)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:31.239047 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21904df3-85d7-4502-8a71-449df0f56e2e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:31.252702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ba36d-98d9-4208-8400-28e319a656f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:31.259003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ba36d-98d9-4208-8400-28e319a656f7 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:31.259003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ba36d-98d9-4208-8400-28e319a656f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:31.259003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ba36d-98d9-4208-8400-28e319a656f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:31.261548 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ba36d-98d9-4208-8400-28e319a656f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:31.262998 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ba36d-98d9-4208-8400-28e319a656f7 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:31.274323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-152ba36d-98d9-4208-8400-28e319a656f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:31.274323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:31.274323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:31.274323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:31.274323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:31.274323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:31.274323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:31.274323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:31.274323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:31.274323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:31.274323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:31.274323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:31.274323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:31.274323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:31.274323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:31.275397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:31.276545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:31.276545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:31.276545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:31.276545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:31.276545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:31.276545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:31.276545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:31.276545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:31.276545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 295/591] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:31.276545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ba36d-98d9-4208-8400-28e319a656f7 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:31.307418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 297/592] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:45:31 2022] PUT /identity/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/4b3c8a90b97246a98612b627b5f8da80/roles/530c8dc4a70b4cb48bc4036a57ffa71b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:45:31.316975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21904df3-85d7-4502-8a71-449df0f56e2e None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:31.396225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ba36d-98d9-4208-8400-28e319a656f7 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:31.398784 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:31.438197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02237bd6-9aa7-482c-af53-bdd5743d6d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:31.439146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02237bd6-9aa7-482c-af53-bdd5743d6d10 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:31.439626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02237bd6-9aa7-482c-af53-bdd5743d6d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:31.440098 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02237bd6-9aa7-482c-af53-bdd5743d6d10 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:31.450768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02237bd6-9aa7-482c-af53-bdd5743d6d10 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:31.452533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02237bd6-9aa7-482c-af53-bdd5743d6d10 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-02237bd6-9aa7-482c-af53-bdd5743d6d10 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:31.466592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:31.467815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:31.469059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:31.469059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:31.469059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:31.469059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:31.469059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:31.469059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:31.469059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:31.469059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:31.469059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:45:31.469059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:31.471747 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 296/593] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:31.472701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02237bd6-9aa7-482c-af53-bdd5743d6d10 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:31.476050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21904df3-85d7-4502-8a71-449df0f56e2e None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:31.518019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:31.518816 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadeb98-4142-4b11-a705-dcd7b3c03a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:31.519495 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadeb98-4142-4b11-a705-dcd7b3c03a2f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:31.519789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadeb98-4142-4b11-a705-dcd7b3c03a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:31.520099 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadeb98-4142-4b11-a705-dcd7b3c03a2f None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:31.520835 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadeb98-4142-4b11-a705-dcd7b3c03a2f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:31.521148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadeb98-4142-4b11-a705-dcd7b3c03a2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:31.522590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadeb98-4142-4b11-a705-dcd7b3c03a2f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:31.541082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 298/594] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Sep 1 13:45:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:31.544764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadeb98-4142-4b11-a705-dcd7b3c03a2f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:31.613476 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02237bd6-9aa7-482c-af53-bdd5743d6d10 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:31.651580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fff8b-1420-47e3-810f-03b834c6ec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:31.652168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fff8b-1420-47e3-810f-03b834c6ec83 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:31.652452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fff8b-1420-47e3-810f-03b834c6ec83 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:31.652730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fff8b-1420-47e3-810f-03b834c6ec83 None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:31.653424 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537fff8b-1420-47e3-810f-03b834c6ec83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:31.653735 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537fff8b-1420-47e3-810f-03b834c6ec83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:31.655172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537fff8b-1420-47e3-810f-03b834c6ec83 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:31.668308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 297/595] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:31.669160 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fff8b-1420-47e3-810f-03b834c6ec83 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:31.673481 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadeb98-4142-4b11-a705-dcd7b3c03a2f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:31.686141 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:31.724966 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4029b-13dc-4ebe-88e9-6b81698f9ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:31.725586 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4029b-13dc-4ebe-88e9-6b81698f9ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:31.725870 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4029b-13dc-4ebe-88e9-6b81698f9ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:31.726144 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4029b-13dc-4ebe-88e9-6b81698f9ab0 None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:31.728325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4029b-13dc-4ebe-88e9-6b81698f9ab0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:31.728645 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4029b-13dc-4ebe-88e9-6b81698f9ab0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:31.731404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4029b-13dc-4ebe-88e9-6b81698f9ab0 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:31.759678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 299/596] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Sep 1 13:45:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:31.761040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4029b-13dc-4ebe-88e9-6b81698f9ab0 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:31.778770 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:31.800370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fff8b-1420-47e3-810f-03b834c6ec83 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:31.843895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f99c36-8254-43fe-89da-cdf6b5a35f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:31.844607 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f99c36-8254-43fe-89da-cdf6b5a35f4a None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:31.844888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f99c36-8254-43fe-89da-cdf6b5a35f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:31.845158 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f99c36-8254-43fe-89da-cdf6b5a35f4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:31.858458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f99c36-8254-43fe-89da-cdf6b5a35f4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:31.860051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f99c36-8254-43fe-89da-cdf6b5a35f4a None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-c0f99c36-8254-43fe-89da-cdf6b5a35f4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:31.876291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:31.877726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:31.878654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:31.878654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:31.878654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:31.881334 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4029b-13dc-4ebe-88e9-6b81698f9ab0 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:31.882089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 298/597] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:31.883307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f99c36-8254-43fe-89da-cdf6b5a35f4a None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:31.928547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dea771-e169-425b-9642-027b61c0ffa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:31.930092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dea771-e169-425b-9642-027b61c0ffa0 None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:31.930591 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dea771-e169-425b-9642-027b61c0ffa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:31.931488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dea771-e169-425b-9642-027b61c0ffa0 None admin] PATH_INFO: `/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/0f750815038d404d9d39a68bf62db8c4/roles/530c8dc4a70b4cb48bc4036a57ffa71b` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:31.952887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dea771-e169-425b-9642-027b61c0ffa0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e7998cc03064a0bb9a9dc6a1475d73c, user_id=0f750815038d404d9d39a68bf62db8c4, role_id=530c8dc4a70b4cb48bc4036a57ffa71b)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:31.954948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dea771-e169-425b-9642-027b61c0ffa0 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:31.995380 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f99c36-8254-43fe-89da-cdf6b5a35f4a None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:32.031896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fae12-3913-4a45-9264-260f9ed0a4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:32.032516 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fae12-3913-4a45-9264-260f9ed0a4bd None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:32.032850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fae12-3913-4a45-9264-260f9ed0a4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:32.033137 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fae12-3913-4a45-9264-260f9ed0a4bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:32.036596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:32.051971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fae12-3913-4a45-9264-260f9ed0a4bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:32.051971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fae12-3913-4a45-9264-260f9ed0a4bd None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:32.052522 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 300/598] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:45:31 2022] PUT /identity/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/0f750815038d404d9d39a68bf62db8c4/roles/530c8dc4a70b4cb48bc4036a57ffa71b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:45:32.054076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dea771-e169-425b-9642-027b61c0ffa0 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-706fae12-3913-4a45-9264-260f9ed0a4bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:32.071918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:32.073116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:32.074224 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:32.074224 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:32.074224 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:32.077702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 299/599] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:32.083443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fae12-3913-4a45-9264-260f9ed0a4bd None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:32.090404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:32.200658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dea771-e169-425b-9642-027b61c0ffa0 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:32.230664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fae12-3913-4a45-9264-260f9ed0a4bd None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:32.260029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ff200-b5ab-4636-86db-63fdb46f5bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:32.260655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ff200-b5ab-4636-86db-63fdb46f5bff None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:32.260934 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ff200-b5ab-4636-86db-63fdb46f5bff None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:32.261206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ff200-b5ab-4636-86db-63fdb46f5bff None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:32.261859 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ff200-b5ab-4636-86db-63fdb46f5bff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:32.262151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ff200-b5ab-4636-86db-63fdb46f5bff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:32.263525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ff200-b5ab-4636-86db-63fdb46f5bff None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:32.274414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae329ec-2e09-4805-9b04-37e872af4ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:32.277060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae329ec-2e09-4805-9b04-37e872af4ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:32.277060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae329ec-2e09-4805-9b04-37e872af4ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:32.277060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae329ec-2e09-4805-9b04-37e872af4ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:32.277060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae329ec-2e09-4805-9b04-37e872af4ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:32.277060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae329ec-2e09-4805-9b04-37e872af4ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:32.277788 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae329ec-2e09-4805-9b04-37e872af4ab8 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:32.282162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 301/600] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:32.284321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311d0ca-7cd3-445e-a9c0-a793c22285f2 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:32.284927 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311d0ca-7cd3-445e-a9c0-a793c22285f2 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:32.285401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311d0ca-7cd3-445e-a9c0-a793c22285f2 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:32.287220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 302/601] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:32.292206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 300/602] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:32.292364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311d0ca-7cd3-445e-a9c0-a793c22285f2 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:32.293946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4f6ab-e772-4f5b-9366-6b3a7b799abd None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:32.294067 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4f6ab-e772-4f5b-9366-6b3a7b799abd None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:32.294307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4f6ab-e772-4f5b-9366-6b3a7b799abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:32.313104 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-e6e4f6ab-e772-4f5b-9366-6b3a7b799abd None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:32.314304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e6e4f6ab-e772-4f5b-9366-6b3a7b799abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:32.361145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:32.385820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 301/603] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:32.393874 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4f6ab-e772-4f5b-9366-6b3a7b799abd None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:32.398252 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:32.449983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311d0ca-7cd3-445e-a9c0-a793c22285f2 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:32.525795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299051e-b112-4d72-b754-a819ebd718c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:32.525795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299051e-b112-4d72-b754-a819ebd718c9 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:32.525795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299051e-b112-4d72-b754-a819ebd718c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:32.525795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299051e-b112-4d72-b754-a819ebd718c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:32.539645 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299051e-b112-4d72-b754-a819ebd718c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:32.541131 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299051e-b112-4d72-b754-a819ebd718c9 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:32.559926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-0299051e-b112-4d72-b754-a819ebd718c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:32.559926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:32.559926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:32.559926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:32.559926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:32.559926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:32.559926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:32.559926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:32.559926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:32.559926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:32.559926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:32.559926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:32.559926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:32.559926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:32.559926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:32.560847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:32.561735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:32.561735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:32.561735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:32.561735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:32.561735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:32.561735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:32.561735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:32.561735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:32.561735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 303/604] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:32.568452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299051e-b112-4d72-b754-a819ebd718c9 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:32.589338 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4f6ab-e772-4f5b-9366-6b3a7b799abd None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:32.653952 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99282721-e673-47e0-b3fc-b6942a90aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:32.654594 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99282721-e673-47e0-b3fc-b6942a90aca2 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:32.654874 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99282721-e673-47e0-b3fc-b6942a90aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:32.655191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99282721-e673-47e0-b3fc-b6942a90aca2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:32.667943 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99282721-e673-47e0-b3fc-b6942a90aca2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:32.670397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99282721-e673-47e0-b3fc-b6942a90aca2 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:32.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-99282721-e673-47e0-b3fc-b6942a90aca2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:32.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:32.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:32.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:32.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:32.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:32.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:32.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:32.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:32.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:32.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:32.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:32.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:32.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:32.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:32.692974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:32.693859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:32.693859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:32.693859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:32.693859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:32.693859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:32.693859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:32.693859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:32.693859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:32.699760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 302/605] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:32.701050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99282721-e673-47e0-b3fc-b6942a90aca2 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:32.736773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299051e-b112-4d72-b754-a819ebd718c9 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:32.756656 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:32.785975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28109bf1-77bc-405f-8e06-49c80b0b885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:32.785975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28109bf1-77bc-405f-8e06-49c80b0b885b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:32.785975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28109bf1-77bc-405f-8e06-49c80b0b885b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:32.785975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28109bf1-77bc-405f-8e06-49c80b0b885b None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:32.786424 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28109bf1-77bc-405f-8e06-49c80b0b885b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:32.786424 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28109bf1-77bc-405f-8e06-49c80b0b885b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:32.786424 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28109bf1-77bc-405f-8e06-49c80b0b885b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:32.786424 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:32.795075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 304/606] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:32.796395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28109bf1-77bc-405f-8e06-49c80b0b885b None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:32.838240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99282721-e673-47e0-b3fc-b6942a90aca2 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:32.882474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd533451-6f1b-43d3-a3c5-c8fcccfb1581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:32.883500 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd533451-6f1b-43d3-a3c5-c8fcccfb1581 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:32.883725 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd533451-6f1b-43d3-a3c5-c8fcccfb1581 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:32.884014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd533451-6f1b-43d3-a3c5-c8fcccfb1581 None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:32.884855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd533451-6f1b-43d3-a3c5-c8fcccfb1581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:32.885148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd533451-6f1b-43d3-a3c5-c8fcccfb1581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:32.886751 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd533451-6f1b-43d3-a3c5-c8fcccfb1581 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:32.903965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 303/607] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:32.905076 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd533451-6f1b-43d3-a3c5-c8fcccfb1581 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:32.911620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28109bf1-77bc-405f-8e06-49c80b0b885b None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:32.949392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07114f-b5b0-49bc-a796-b7cdaf57c666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:32.950374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07114f-b5b0-49bc-a796-b7cdaf57c666 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:32.950914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07114f-b5b0-49bc-a796-b7cdaf57c666 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:32.951530 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07114f-b5b0-49bc-a796-b7cdaf57c666 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:32.964638 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07114f-b5b0-49bc-a796-b7cdaf57c666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-5a07114f-b5b0-49bc-a796-b7cdaf57c666 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:32.969438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:32.970371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:32.971471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:32.971471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:32.971471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:32.971471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:32.971471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:32.971471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:32.971471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:32.971471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:32.971471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:32.971471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:32.971471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:32.971471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:32.975607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 305/608] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:32.976450 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07114f-b5b0-49bc-a796-b7cdaf57c666 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:33.036797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:33.038754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:33.044102 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd533451-6f1b-43d3-a3c5-c8fcccfb1581 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:33.083615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bee067-9564-4101-9587-edb9b66037b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:33.084617 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bee067-9564-4101-9587-edb9b66037b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:33.085135 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bee067-9564-4101-9587-edb9b66037b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:33.086366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bee067-9564-4101-9587-edb9b66037b5 None admin] PATH_INFO: `/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/4a9703db64624bbeb392d693ca60c6e3/roles/530c8dc4a70b4cb48bc4036a57ffa71b` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:33.087028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07114f-b5b0-49bc-a796-b7cdaf57c666 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:33.102285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bee067-9564-4101-9587-edb9b66037b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e7998cc03064a0bb9a9dc6a1475d73c, user_id=4a9703db64624bbeb392d693ca60c6e3, role_id=530c8dc4a70b4cb48bc4036a57ffa71b)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:33.104076 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bee067-9564-4101-9587-edb9b66037b5 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:33.125461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590432e-a407-4e00-a02f-201a79f320d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:33.126122 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590432e-a407-4e00-a02f-201a79f320d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:33.126402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590432e-a407-4e00-a02f-201a79f320d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:33.126673 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590432e-a407-4e00-a02f-201a79f320d9 None admin] PATH_INFO: `/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/92870867b169496fa8913b2ab93eac37/roles/530c8dc4a70b4cb48bc4036a57ffa71b` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:33.144274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590432e-a407-4e00-a02f-201a79f320d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e7998cc03064a0bb9a9dc6a1475d73c, user_id=92870867b169496fa8913b2ab93eac37, role_id=530c8dc4a70b4cb48bc4036a57ffa71b)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:33.146007 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590432e-a407-4e00-a02f-201a79f320d9 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:33.210524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 304/609] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:45:32 2022] PUT /identity/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/4a9703db64624bbeb392d693ca60c6e3/roles/530c8dc4a70b4cb48bc4036a57ffa71b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:45:33.211927 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bee067-9564-4101-9587-edb9b66037b5 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:33.250812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 306/610] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:45:32 2022] PUT /identity/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/92870867b169496fa8913b2ab93eac37/roles/530c8dc4a70b4cb48bc4036a57ffa71b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:45:33.276099 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92054e3a-9469-4c05-bfab-f76644ccfda5 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:33.276589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92054e3a-9469-4c05-bfab-f76644ccfda5 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:33.276983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92054e3a-9469-4c05-bfab-f76644ccfda5 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:33.279448 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 307/611] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:45:33.291237 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443155c2-108c-4b3c-9bb3-f18222005257 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:33.291601 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443155c2-108c-4b3c-9bb3-f18222005257 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:33.292298 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443155c2-108c-4b3c-9bb3-f18222005257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:33.332161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-443155c2-108c-4b3c-9bb3-f18222005257 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:33.334710 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-443155c2-108c-4b3c-9bb3-f18222005257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:33.401805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bee067-9564-4101-9587-edb9b66037b5 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:33.464364 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30542d79-5a86-4cce-b63a-81a4342260e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:33.465137 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30542d79-5a86-4cce-b63a-81a4342260e6 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:33.465503 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30542d79-5a86-4cce-b63a-81a4342260e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:33.465791 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30542d79-5a86-4cce-b63a-81a4342260e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:33.466456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30542d79-5a86-4cce-b63a-81a4342260e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:33.466763 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30542d79-5a86-4cce-b63a-81a4342260e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:33.468172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30542d79-5a86-4cce-b63a-81a4342260e6 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:33.468843 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 308/612] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:33.479752 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 305/613] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:33.485452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443155c2-108c-4b3c-9bb3-f18222005257 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:33.531991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:33.614327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443155c2-108c-4b3c-9bb3-f18222005257 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:33.665996 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ceae2-b311-43fe-a287-96dba6566db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:33.666644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ceae2-b311-43fe-a287-96dba6566db6 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:33.666928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ceae2-b311-43fe-a287-96dba6566db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:33.667201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ceae2-b311-43fe-a287-96dba6566db6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:33.683587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ceae2-b311-43fe-a287-96dba6566db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:33.685075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ceae2-b311-43fe-a287-96dba6566db6 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-be0ceae2-b311-43fe-a287-96dba6566db6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:33.706500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:33.707677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:33.708944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:33.708944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:33.708944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:33.708944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 309/614] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:33.714981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30542d79-5a86-4cce-b63a-81a4342260e6 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:33.740397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:33.786040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ceae2-b311-43fe-a287-96dba6566db6 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:33.907891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30542d79-5a86-4cce-b63a-81a4342260e6 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:33.922439 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:33.937764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ceae2-b311-43fe-a287-96dba6566db6 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:33.965625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd780b17-ab55-45f1-8013-001479b57d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:33.966243 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd780b17-ab55-45f1-8013-001479b57d61 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:33.966525 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd780b17-ab55-45f1-8013-001479b57d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:33.966804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd780b17-ab55-45f1-8013-001479b57d61 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:33.967450 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd780b17-ab55-45f1-8013-001479b57d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:33.967758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd780b17-ab55-45f1-8013-001479b57d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:33.969150 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd780b17-ab55-45f1-8013-001479b57d61 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:33.988793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 306/615] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:33.997443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd780b17-ab55-45f1-8013-001479b57d61 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:34.006851 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602972c-76e2-4a11-8091-020a1ccb3a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:34.007493 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602972c-76e2-4a11-8091-020a1ccb3a51 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:34.008065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602972c-76e2-4a11-8091-020a1ccb3a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:34.008340 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602972c-76e2-4a11-8091-020a1ccb3a51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:34.028208 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602972c-76e2-4a11-8091-020a1ccb3a51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-9602972c-76e2-4a11-8091-020a1ccb3a51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:34.034075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:34.034991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:34.035952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:34.035952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:34.035952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:34.035952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:34.035952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:34.035952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:34.035952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:34.035952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:34.035952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:34.035952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:34.035952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:34.035952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:34.036610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 310/616] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:34.040972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602972c-76e2-4a11-8091-020a1ccb3a51 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:34.126319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:34.185365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd780b17-ab55-45f1-8013-001479b57d61 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:34.228281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602972c-76e2-4a11-8091-020a1ccb3a51 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:34.246704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3a439-0980-4a4e-84c4-db8ed232f1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:34.247345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3a439-0980-4a4e-84c4-db8ed232f1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:34.252874 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3a439-0980-4a4e-84c4-db8ed232f1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:34.252874 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3a439-0980-4a4e-84c4-db8ed232f1a8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:34.261515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3a439-0980-4a4e-84c4-db8ed232f1a8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:34.262997 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3a439-0980-4a4e-84c4-db8ed232f1a8 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-24a3a439-0980-4a4e-84c4-db8ed232f1a8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:34.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:34.284427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:34.285378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:34.285378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:34.285378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:34.285378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:34.285378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:34.285378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:34.285378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:34.285378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:34.285378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:45:34.285378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:34.285378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 307/617] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:45:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:34.286132 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d8190-dde7-44e0-9b03-d03121bc81ea None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:34.286610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d8190-dde7-44e0-9b03-d03121bc81ea None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:34.286610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d8190-dde7-44e0-9b03-d03121bc81ea None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:34.287569 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5aade-6e0a-4ac8-8fd9-ddc491d90d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:34.288749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5aade-6e0a-4ac8-8fd9-ddc491d90d8c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:34.289233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5aade-6e0a-4ac8-8fd9-ddc491d90d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:34.289424 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 308/618] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:34.289888 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5aade-6e0a-4ac8-8fd9-ddc491d90d8c None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:34.289993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d8190-dde7-44e0-9b03-d03121bc81ea None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:34.290963 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5aade-6e0a-4ac8-8fd9-ddc491d90d8c None admin] RBAC: Adding query filter params (name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:34.291485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5aade-6e0a-4ac8-8fd9-ddc491d90d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:34.293104 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5aade-6e0a-4ac8-8fd9-ddc491d90d8c None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:34.303291 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 311/619] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:34.304916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6425e5-33a4-4118-bc35-df885f5695d7 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:34.305408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6425e5-33a4-4118-bc35-df885f5695d7 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:34.305886 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6425e5-33a4-4118-bc35-df885f5695d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:34.324713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-ab6425e5-33a4-4118-bc35-df885f5695d7 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:34.326276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ab6425e5-33a4-4118-bc35-df885f5695d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:34.328540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:34.412302 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 312/620] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:34.413239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6425e5-33a4-4118-bc35-df885f5695d7 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:34.430589 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d8190-dde7-44e0-9b03-d03121bc81ea None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:34.467091 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:34.474722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcc188-dee4-48f7-b791-3415e6cd86d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:34.478494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcc188-dee4-48f7-b791-3415e6cd86d4 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:34.478494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcc188-dee4-48f7-b791-3415e6cd86d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:34.478494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcc188-dee4-48f7-b791-3415e6cd86d4 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:34.478494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcc188-dee4-48f7-b791-3415e6cd86d4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:34.478494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcc188-dee4-48f7-b791-3415e6cd86d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:34.480463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcc188-dee4-48f7-b791-3415e6cd86d4 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:34.502371 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 309/621] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Sep 1 13:45:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:34.510894 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcc188-dee4-48f7-b791-3415e6cd86d4 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:34.629421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcc188-dee4-48f7-b791-3415e6cd86d4 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:34.670341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee052dc-df99-4a1b-8e59-d9b99ddbf2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:34.671335 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee052dc-df99-4a1b-8e59-d9b99ddbf2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:34.671840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee052dc-df99-4a1b-8e59-d9b99ddbf2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:34.672348 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee052dc-df99-4a1b-8e59-d9b99ddbf2b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:34.674336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6425e5-33a4-4118-bc35-df885f5695d7 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:34.685074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee052dc-df99-4a1b-8e59-d9b99ddbf2b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:34.686808 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee052dc-df99-4a1b-8e59-d9b99ddbf2b1 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-1ee052dc-df99-4a1b-8e59-d9b99ddbf2b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:34.703072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:34.704344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:34.705819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:34.705819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:34.705819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:34.708111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 310/622] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:34.714207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee052dc-df99-4a1b-8e59-d9b99ddbf2b1 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:34.756244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ae67f-f61b-488f-881c-0cdab8780b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:34.757267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ae67f-f61b-488f-881c-0cdab8780b22 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:34.758032 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ae67f-f61b-488f-881c-0cdab8780b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:34.758507 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ae67f-f61b-488f-881c-0cdab8780b22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:34.766347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:34.771435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ae67f-f61b-488f-881c-0cdab8780b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:34.773171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ae67f-f61b-488f-881c-0cdab8780b22 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:34.781172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-9e3ae67f-f61b-488f-881c-0cdab8780b22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:34.790622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:34.791557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:34.792527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:34.792527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:34.792527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:34.792527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 313/623] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:34.793785 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ae67f-f61b-488f-881c-0cdab8780b22 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:34.869212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee052dc-df99-4a1b-8e59-d9b99ddbf2b1 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:34.903462 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ae67f-f61b-488f-881c-0cdab8780b22 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:34.914373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517da00-5847-41f5-8877-680a869edcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:34.915058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517da00-5847-41f5-8877-680a869edcd1 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:34.915344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517da00-5847-41f5-8877-680a869edcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:34.915650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517da00-5847-41f5-8877-680a869edcd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:34.916322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517da00-5847-41f5-8877-680a869edcd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:34.916626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517da00-5847-41f5-8877-680a869edcd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:34.918685 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517da00-5847-41f5-8877-680a869edcd1 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:34.940064 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 311/624] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:34.941491 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517da00-5847-41f5-8877-680a869edcd1 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:34.953521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922496a-fb2a-4c61-bbb3-ea95dd583027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:34.955080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922496a-fb2a-4c61-bbb3-ea95dd583027 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:34.955567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922496a-fb2a-4c61-bbb3-ea95dd583027 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:34.956228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922496a-fb2a-4c61-bbb3-ea95dd583027 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:34.970723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922496a-fb2a-4c61-bbb3-ea95dd583027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-4922496a-fb2a-4c61-bbb3-ea95dd583027 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:34.979227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:34.980197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:34.981040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:34.981040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:34.981040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:34.981040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:34.981040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:34.981040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:34.981040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:34.981040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:34.981040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:34.981040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:34.981040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:34.981040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:34.987435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 314/625] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:34.987435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922496a-fb2a-4c61-bbb3-ea95dd583027 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:35.058864 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:35.085826 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:35.089266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517da00-5847-41f5-8877-680a869edcd1 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:35.119190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922496a-fb2a-4c61-bbb3-ea95dd583027 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:35.135046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e917d35-1f90-4526-bee2-d993f3208dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:35.135664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e917d35-1f90-4526-bee2-d993f3208dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:35.135979 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e917d35-1f90-4526-bee2-d993f3208dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:35.136516 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e917d35-1f90-4526-bee2-d993f3208dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:35.137176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e917d35-1f90-4526-bee2-d993f3208dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:35.137486 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e917d35-1f90-4526-bee2-d993f3208dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:35.139029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e917d35-1f90-4526-bee2-d993f3208dd7 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:35.155966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 312/626] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:35.157236 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e917d35-1f90-4526-bee2-d993f3208dd7 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:35.163674 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02eff0-fe66-4496-80cd-8757c8753a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:35.164630 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02eff0-fe66-4496-80cd-8757c8753a18 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:35.165113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02eff0-fe66-4496-80cd-8757c8753a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:35.165607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02eff0-fe66-4496-80cd-8757c8753a18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:35.176492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02eff0-fe66-4496-80cd-8757c8753a18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:35.179020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02eff0-fe66-4496-80cd-8757c8753a18 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:35.191985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-ec02eff0-fe66-4496-80cd-8757c8753a18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:35.191985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:35.191985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:35.191985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:35.191985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:35.191985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:35.191985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:35.191985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:35.191985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:35.191985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:35.191985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:35.191985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:35.191985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:35.191985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:35.191985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:35.192909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:35.193797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:35.193797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:35.193797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:35.193797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:35.193797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:35.193797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:35.193797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:35.193797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:35.200612 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 315/627] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:35.201791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02eff0-fe66-4496-80cd-8757c8753a18 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:35.293805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e917d35-1f90-4526-bee2-d993f3208dd7 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:35.329111 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02eff0-fe66-4496-80cd-8757c8753a18 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:35.332229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c80151-715b-4115-a2ab-189c0d8c1146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:35.332845 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c80151-715b-4115-a2ab-189c0d8c1146 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:35.333209 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c80151-715b-4115-a2ab-189c0d8c1146 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:35.334176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c80151-715b-4115-a2ab-189c0d8c1146 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:35.334288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c80151-715b-4115-a2ab-189c0d8c1146 None admin] RBAC: Adding query filter params (name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:35.334540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c80151-715b-4115-a2ab-189c0d8c1146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:35.335992 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c80151-715b-4115-a2ab-189c0d8c1146 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:35.342721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:35.346555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 313/628] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:35.347549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c80151-715b-4115-a2ab-189c0d8c1146 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:35.372920 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9defd3-3ec6-4b3b-8ab3-fb185109abaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:35.373555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9defd3-3ec6-4b3b-8ab3-fb185109abaf None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:35.373884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9defd3-3ec6-4b3b-8ab3-fb185109abaf None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:35.374315 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9defd3-3ec6-4b3b-8ab3-fb185109abaf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:35.379637 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:35.384494 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9defd3-3ec6-4b3b-8ab3-fb185109abaf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:35.386055 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9defd3-3ec6-4b3b-8ab3-fb185109abaf None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-0a9defd3-3ec6-4b3b-8ab3-fb185109abaf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:35.398296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:35.399498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:35.400536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:35.400536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:35.400536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:35.400536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:35.400536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:35.400536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:35.400536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:35.400536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:35.400536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:45:35.400536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:35.400536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 316/629] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 13:45:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:35.400536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9defd3-3ec6-4b3b-8ab3-fb185109abaf None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:35.464311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c80151-715b-4115-a2ab-189c0d8c1146 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:35.499825 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21eca4-bd69-47f6-806c-fcd8c1b644bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:35.500999 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21eca4-bd69-47f6-806c-fcd8c1b644bb None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:35.501837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21eca4-bd69-47f6-806c-fcd8c1b644bb None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:35.502283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21eca4-bd69-47f6-806c-fcd8c1b644bb None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:35.502984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21eca4-bd69-47f6-806c-fcd8c1b644bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:35.503296 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21eca4-bd69-47f6-806c-fcd8c1b644bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:35.504768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21eca4-bd69-47f6-806c-fcd8c1b644bb None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:35.510518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9defd3-3ec6-4b3b-8ab3-fb185109abaf None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:35.518584 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 314/630] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:35.519789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbc4b0-47a1-4709-95d3-51772e78b53f None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:35.520114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbc4b0-47a1-4709-95d3-51772e78b53f None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:35.520390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbc4b0-47a1-4709-95d3-51772e78b53f None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:35.521576 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 315/631] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:35.522266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbc4b0-47a1-4709-95d3-51772e78b53f None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:35.550571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a75f9c-bc74-4217-8b4e-3eaf2c3d5b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:35.551197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a75f9c-bc74-4217-8b4e-3eaf2c3d5b48 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:35.551484 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a75f9c-bc74-4217-8b4e-3eaf2c3d5b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:35.551754 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a75f9c-bc74-4217-8b4e-3eaf2c3d5b48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:35.562052 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a75f9c-bc74-4217-8b4e-3eaf2c3d5b48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:35.563485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a75f9c-bc74-4217-8b4e-3eaf2c3d5b48 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-39a75f9c-bc74-4217-8b4e-3eaf2c3d5b48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:35.578262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:35.579435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:35.580944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:35.580944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:35.580944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:35.580944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 317/632] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:35.581221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ae4f9-4e22-499c-bfd3-fa383fdf8af7 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:35.581311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ae4f9-4e22-499c-bfd3-fa383fdf8af7 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:35.581553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ae4f9-4e22-499c-bfd3-fa383fdf8af7 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:35.582752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 318/633] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:35.583411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ae4f9-4e22-499c-bfd3-fa383fdf8af7 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:35.608229 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:35.616332 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:35.635100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbc4b0-47a1-4709-95d3-51772e78b53f None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:35.668307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95054ee6-eed9-4a50-a095-33c795108b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:35.668911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054ee6-eed9-4a50-a095-33c795108b71 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:35.669189 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054ee6-eed9-4a50-a095-33c795108b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:35.669461 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054ee6-eed9-4a50-a095-33c795108b71 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:35.670181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95054ee6-eed9-4a50-a095-33c795108b71 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:35.670488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95054ee6-eed9-4a50-a095-33c795108b71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:35.671990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95054ee6-eed9-4a50-a095-33c795108b71 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:35.684876 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ae4f9-4e22-499c-bfd3-fa383fdf8af7 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:35.690900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 316/634] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 13:45:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:35.692506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264462-015a-460c-94aa-f5c3fe122c13 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:35.692794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264462-015a-460c-94aa-f5c3fe122c13 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:35.693170 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264462-015a-460c-94aa-f5c3fe122c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:35.710657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-60264462-015a-460c-94aa-f5c3fe122c13 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:35.711886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-60264462-015a-460c-94aa-f5c3fe122c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:35.719294 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede39e64-3cc0-412d-b143-fc5bfae19a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:35.719915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede39e64-3cc0-412d-b143-fc5bfae19a54 None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:35.720200 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede39e64-3cc0-412d-b143-fc5bfae19a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:35.720473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede39e64-3cc0-412d-b143-fc5bfae19a54 None admin] PATH_INFO: `/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/cdebe1b674cc4b2bb6bf962de01a24ac/roles/530c8dc4a70b4cb48bc4036a57ffa71b` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:35.734422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede39e64-3cc0-412d-b143-fc5bfae19a54 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e7998cc03064a0bb9a9dc6a1475d73c, user_id=cdebe1b674cc4b2bb6bf962de01a24ac, role_id=530c8dc4a70b4cb48bc4036a57ffa71b)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:35.735847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede39e64-3cc0-412d-b143-fc5bfae19a54 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:35.777886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 317/635] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:35.778858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60264462-015a-460c-94aa-f5c3fe122c13 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:35.828790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 319/636] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:45:35 2022] PUT /identity/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/cdebe1b674cc4b2bb6bf962de01a24ac/roles/530c8dc4a70b4cb48bc4036a57ffa71b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:45:35.830475 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadce4c-ac36-4119-8e57-ebef62063f4f None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:35.830852 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadce4c-ac36-4119-8e57-ebef62063f4f None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:35.831488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadce4c-ac36-4119-8e57-ebef62063f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:35.864262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:35.874007 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-adadce4c-ac36-4119-8e57-ebef62063f4f None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:35.876563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-adadce4c-ac36-4119-8e57-ebef62063f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:35.911100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60264462-015a-460c-94aa-f5c3fe122c13 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:35.960365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5390313-a6e3-497b-b5aa-19b73a3aa133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:35.962375 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5390313-a6e3-497b-b5aa-19b73a3aa133 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:35.962923 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5390313-a6e3-497b-b5aa-19b73a3aa133 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:35.963345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5390313-a6e3-497b-b5aa-19b73a3aa133 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:35.964298 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5390313-a6e3-497b-b5aa-19b73a3aa133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:35.964855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5390313-a6e3-497b-b5aa-19b73a3aa133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:35.966521 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5390313-a6e3-497b-b5aa-19b73a3aa133 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:35.966929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 320/637] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:35.967899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadce4c-ac36-4119-8e57-ebef62063f4f None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:35.971213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:35.985012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 318/638] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:35.992630 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5390313-a6e3-497b-b5aa-19b73a3aa133 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:36.099348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadce4c-ac36-4119-8e57-ebef62063f4f None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:36.123529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5390313-a6e3-497b-b5aa-19b73a3aa133 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:36.138662 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f59f6-a17a-43af-b22b-33b040f2038c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:36.139659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f59f6-a17a-43af-b22b-33b040f2038c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:36.139952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f59f6-a17a-43af-b22b-33b040f2038c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:36.140328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f59f6-a17a-43af-b22b-33b040f2038c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:36.156542 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:36.164708 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ece4a-ec1b-4d1b-a8dd-30341c98e868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:36.167143 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ece4a-ec1b-4d1b-a8dd-30341c98e868 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:36.167143 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ece4a-ec1b-4d1b-a8dd-30341c98e868 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:36.167143 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ece4a-ec1b-4d1b-a8dd-30341c98e868 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:36.176177 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ece4a-ec1b-4d1b-a8dd-30341c98e868 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:36.177687 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ece4a-ec1b-4d1b-a8dd-30341c98e868 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-612ece4a-ec1b-4d1b-a8dd-30341c98e868 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:36.193053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:36.194212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:36.195537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:36.195537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:36.195537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:36.195537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:36.195537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:36.195537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:36.195537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:36.195537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:36.195537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 13:45:36.195537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:36.195537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 319/639] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:36.195537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ece4a-ec1b-4d1b-a8dd-30341c98e868 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:36.219627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f59f6-a17a-43af-b22b-33b040f2038c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:36.221904 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f59f6-a17a-43af-b22b-33b040f2038c None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:36.224025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:36.306967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ece4a-ec1b-4d1b-a8dd-30341c98e868 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:36.334566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 321/640] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:36.336061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f59f6-a17a-43af-b22b-33b040f2038c None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:36.347974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62828fe-ded4-47d1-8790-4197bcf8a1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:36.348676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62828fe-ded4-47d1-8790-4197bcf8a1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:36.349022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62828fe-ded4-47d1-8790-4197bcf8a1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:36.349299 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62828fe-ded4-47d1-8790-4197bcf8a1d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:36.359407 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62828fe-ded4-47d1-8790-4197bcf8a1d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-b62828fe-ded4-47d1-8790-4197bcf8a1d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:36.365113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:36.366043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:36.366892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:36.366892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:36.366892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:36.366892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:36.366892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:36.366892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:36.366892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:36.366892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:36.366892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:36.366892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:36.366892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:36.366892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:36.366892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 320/641] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:36.367606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62828fe-ded4-47d1-8790-4197bcf8a1d5 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:36.421599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:36.450689 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f59f6-a17a-43af-b22b-33b040f2038c None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:36.452413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:36.481364 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62828fe-ded4-47d1-8790-4197bcf8a1d5 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:36.488173 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b0e8d-12cc-4997-b088-aaee229bbc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:36.488780 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b0e8d-12cc-4997-b088-aaee229bbc54 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:36.489057 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b0e8d-12cc-4997-b088-aaee229bbc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:36.489495 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b0e8d-12cc-4997-b088-aaee229bbc54 None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:36.490225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b0e8d-12cc-4997-b088-aaee229bbc54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:36.490528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b0e8d-12cc-4997-b088-aaee229bbc54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:36.491989 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b0e8d-12cc-4997-b088-aaee229bbc54 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:36.511908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 322/642] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Sep 1 13:45:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:36.511908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b0e8d-12cc-4997-b088-aaee229bbc54 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:36.522666 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83049a20-5824-465e-a575-5bff7c12ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:36.523306 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83049a20-5824-465e-a575-5bff7c12ca06 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:36.523646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83049a20-5824-465e-a575-5bff7c12ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:36.523959 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83049a20-5824-465e-a575-5bff7c12ca06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:36.534901 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83049a20-5824-465e-a575-5bff7c12ca06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-83049a20-5824-465e-a575-5bff7c12ca06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:36.540626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:36.541856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:36.542738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:36.542738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:36.542738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:36.542738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:36.542738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:36.542738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:36.542738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:36.542738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:36.542738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:36.542738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:36.542738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:36.542738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:36.542738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 321/643] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:36.543462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83049a20-5824-465e-a575-5bff7c12ca06 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:36.617838 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b0e8d-12cc-4997-b088-aaee229bbc54 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:36.652831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f8b6a-7f13-44f1-afb3-425cbe07b8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:36.653465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f8b6a-7f13-44f1-afb3-425cbe07b8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:36.653748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f8b6a-7f13-44f1-afb3-425cbe07b8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:36.654049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f8b6a-7f13-44f1-afb3-425cbe07b8f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:36.654851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83049a20-5824-465e-a575-5bff7c12ca06 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:36.664889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f8b6a-7f13-44f1-afb3-425cbe07b8f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:36.666334 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f8b6a-7f13-44f1-afb3-425cbe07b8f7 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:36.666471 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-414f8b6a-7f13-44f1-afb3-425cbe07b8f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:36.681306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:36.688287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:36.689361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:36.689361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:36.689361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:36.689361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 323/644] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:36.689361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f8b6a-7f13-44f1-afb3-425cbe07b8f7 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:36.700130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac16d41-64f6-4d39-b42c-6ee3acd78ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:36.701001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16d41-64f6-4d39-b42c-6ee3acd78ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:36.701381 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16d41-64f6-4d39-b42c-6ee3acd78ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:36.701770 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac16d41-64f6-4d39-b42c-6ee3acd78ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:36.702342 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac16d41-64f6-4d39-b42c-6ee3acd78ff9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:36.702839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac16d41-64f6-4d39-b42c-6ee3acd78ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:36.704068 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac16d41-64f6-4d39-b42c-6ee3acd78ff9 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:36.708678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:36.718328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 322/645] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:36.718328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac16d41-64f6-4d39-b42c-6ee3acd78ff9 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:36.804652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f8b6a-7f13-44f1-afb3-425cbe07b8f7 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:36.823901 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac16d41-64f6-4d39-b42c-6ee3acd78ff9 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:36.839653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d980ac-faeb-43de-984a-65b067973bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:36.840296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d980ac-faeb-43de-984a-65b067973bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:36.840576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d980ac-faeb-43de-984a-65b067973bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:36.840850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d980ac-faeb-43de-984a-65b067973bb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:36.859350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edc8f9-cc92-4aa8-959b-0a41439469ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:36.859986 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edc8f9-cc92-4aa8-959b-0a41439469ff None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:36.860276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edc8f9-cc92-4aa8-959b-0a41439469ff None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:36.860556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edc8f9-cc92-4aa8-959b-0a41439469ff None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:36.861775 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edc8f9-cc92-4aa8-959b-0a41439469ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:36.862133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edc8f9-cc92-4aa8-959b-0a41439469ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:36.863507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edc8f9-cc92-4aa8-959b-0a41439469ff None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:36.871615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 323/646] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:36.872458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edc8f9-cc92-4aa8-959b-0a41439469ff None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:36.909622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:36.926131 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d980ac-faeb-43de-984a-65b067973bb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:36.927791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d980ac-faeb-43de-984a-65b067973bb1 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:36.942603 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:36.982651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edc8f9-cc92-4aa8-959b-0a41439469ff None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:37.031820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b09a8-89f2-4656-b683-dce93c96c47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:37.032466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b09a8-89f2-4656-b683-dce93c96c47a None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:37.032744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b09a8-89f2-4656-b683-dce93c96c47a None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:37.033054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b09a8-89f2-4656-b683-dce93c96c47a None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:37.033805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b09a8-89f2-4656-b683-dce93c96c47a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:37.034090 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b09a8-89f2-4656-b683-dce93c96c47a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:37.035587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b09a8-89f2-4656-b683-dce93c96c47a None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:37.046578 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 324/647] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:37.047748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d980ac-faeb-43de-984a-65b067973bb1 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:37.051838 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 324/648] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:37.052693 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b09a8-89f2-4656-b683-dce93c96c47a None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:37.156466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:37.160781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d980ac-faeb-43de-984a-65b067973bb1 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:37.163260 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b09a8-89f2-4656-b683-dce93c96c47a None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:37.179606 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:37.197786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7716dda-5542-449d-8004-7845df637d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:37.198410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7716dda-5542-449d-8004-7845df637d16 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:37.198687 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7716dda-5542-449d-8004-7845df637d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:37.198954 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7716dda-5542-449d-8004-7845df637d16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:37.201509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699a3ed-259b-4844-bcfb-05c4094ed895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:37.202131 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699a3ed-259b-4844-bcfb-05c4094ed895 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:37.202412 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699a3ed-259b-4844-bcfb-05c4094ed895 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:37.202687 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699a3ed-259b-4844-bcfb-05c4094ed895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:37.210964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7716dda-5542-449d-8004-7845df637d16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:37.212437 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7716dda-5542-449d-8004-7845df637d16 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:37.213656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699a3ed-259b-4844-bcfb-05c4094ed895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:37.215084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699a3ed-259b-4844-bcfb-05c4094ed895 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-c7716dda-5542-449d-8004-7845df637d16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:37.227223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:37.228408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:37.229295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:37.229295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:37.229295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:37.229295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 325/649] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:37.229521 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7716dda-5542-449d-8004-7845df637d16 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-2699a3ed-259b-4844-bcfb-05c4094ed895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:37.234644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:37.235767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:37.237424 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:37.237424 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:37.237424 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:37.243955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 325/650] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:37.243955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699a3ed-259b-4844-bcfb-05c4094ed895 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:37.346135 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7716dda-5542-449d-8004-7845df637d16 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:37.348762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699a3ed-259b-4844-bcfb-05c4094ed895 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:37.381125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64551373-2ca9-40d9-ab71-e9bcc4264d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:37.381841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64551373-2ca9-40d9-ab71-e9bcc4264d4d None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:37.382187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64551373-2ca9-40d9-ab71-e9bcc4264d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:37.382780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64551373-2ca9-40d9-ab71-e9bcc4264d4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:37.384856 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c7fc2-c06b-4416-aac1-d28271fbb840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:37.385798 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c7fc2-c06b-4416-aac1-d28271fbb840 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:37.386088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c7fc2-c06b-4416-aac1-d28271fbb840 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:37.386366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c7fc2-c06b-4416-aac1-d28271fbb840 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:37.393632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64551373-2ca9-40d9-ab71-e9bcc4264d4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:37.394048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c7fc2-c06b-4416-aac1-d28271fbb840 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:37.395198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64551373-2ca9-40d9-ab71-e9bcc4264d4d None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:37.395474 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c7fc2-c06b-4416-aac1-d28271fbb840 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:37.402521 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:37.407233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-da6c7fc2-c06b-4416-aac1-d28271fbb840 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:37.407233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:37.407233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:37.407233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:37.407233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:37.407233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:37.407233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:37.407233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:37.407233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:37.407233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:37.407233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:37.407233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:37.407233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:37.407233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:37.407233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:37.408932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:37.410441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:37.410441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:37.410441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:37.410441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:37.410441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:37.410441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:37.410441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:37.410441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-64551373-2ca9-40d9-ab71-e9bcc4264d4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:37.412851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:37.419900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:37.421057 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:37.421057 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:37.421057 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:37.421508 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 326/651] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:37.421595 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 326/652] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:37.421676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c7fc2-c06b-4416-aac1-d28271fbb840 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:37.421764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64551373-2ca9-40d9-ab71-e9bcc4264d4d None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:37.446842 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:37.525913 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64551373-2ca9-40d9-ab71-e9bcc4264d4d None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:37.526116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c7fc2-c06b-4416-aac1-d28271fbb840 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:37.560845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48ae4a-23b2-40aa-ac7c-3a06938c3196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:37.561053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1944df-e4ff-4d99-beb7-db8f31bcc568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:37.561453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48ae4a-23b2-40aa-ac7c-3a06938c3196 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:37.561565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1944df-e4ff-4d99-beb7-db8f31bcc568 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:37.561723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48ae4a-23b2-40aa-ac7c-3a06938c3196 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:37.561816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1944df-e4ff-4d99-beb7-db8f31bcc568 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:37.561985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf48ae4a-23b2-40aa-ac7c-3a06938c3196 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:37.562145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1944df-e4ff-4d99-beb7-db8f31bcc568 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:37.562623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf48ae4a-23b2-40aa-ac7c-3a06938c3196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:37.562777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1944df-e4ff-4d99-beb7-db8f31bcc568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:37.562932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf48ae4a-23b2-40aa-ac7c-3a06938c3196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:37.563077 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1944df-e4ff-4d99-beb7-db8f31bcc568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:37.564359 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf48ae4a-23b2-40aa-ac7c-3a06938c3196 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:37.564457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1944df-e4ff-4d99-beb7-db8f31bcc568 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:37.580574 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 327/653] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:37.580744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 327/654] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:37.580744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48ae4a-23b2-40aa-ac7c-3a06938c3196 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:37.581649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1944df-e4ff-4d99-beb7-db8f31bcc568 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:37.645841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:37.681314 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:37.692009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1944df-e4ff-4d99-beb7-db8f31bcc568 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:37.696949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf48ae4a-23b2-40aa-ac7c-3a06938c3196 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:37.729337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6037b1-bb9d-419e-8b75-79de833f841f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:37.729799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6037b1-bb9d-419e-8b75-79de833f841f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:37.730070 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6037b1-bb9d-419e-8b75-79de833f841f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:37.730341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6037b1-bb9d-419e-8b75-79de833f841f None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:37.731026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6037b1-bb9d-419e-8b75-79de833f841f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:37.731331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6037b1-bb9d-419e-8b75-79de833f841f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:37.732815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6037b1-bb9d-419e-8b75-79de833f841f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:37.733938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a81b9-d41d-46be-9aaf-81a9e78425bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:37.734554 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a81b9-d41d-46be-9aaf-81a9e78425bb None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:37.734843 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a81b9-d41d-46be-9aaf-81a9e78425bb None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:37.735117 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a81b9-d41d-46be-9aaf-81a9e78425bb None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:37.735762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a81b9-d41d-46be-9aaf-81a9e78425bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:37.736126 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a81b9-d41d-46be-9aaf-81a9e78425bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:37.737480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a81b9-d41d-46be-9aaf-81a9e78425bb None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:37.745240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 328/655] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:37.745868 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6037b1-bb9d-419e-8b75-79de833f841f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:37.754927 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 328/656] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:37.755844 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a81b9-d41d-46be-9aaf-81a9e78425bb None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:37.856593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6037b1-bb9d-419e-8b75-79de833f841f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:37.864555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a81b9-d41d-46be-9aaf-81a9e78425bb None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:37.877873 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:37.899780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b258953-8916-43ae-8da6-14663e227813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:37.900614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c9edb-41e6-46c0-9155-849b8854e46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:37.900749 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b258953-8916-43ae-8da6-14663e227813 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:37.900749 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b258953-8916-43ae-8da6-14663e227813 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:37.900981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b258953-8916-43ae-8da6-14663e227813 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:37.901084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c9edb-41e6-46c0-9155-849b8854e46f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:37.901289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c9edb-41e6-46c0-9155-849b8854e46f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:37.901564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c9edb-41e6-46c0-9155-849b8854e46f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:37.908535 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b258953-8916-43ae-8da6-14663e227813 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:37.908929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c9edb-41e6-46c0-9155-849b8854e46f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:37.910006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b258953-8916-43ae-8da6-14663e227813 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:37.910533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c9edb-41e6-46c0-9155-849b8854e46f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-0c5c9edb-41e6-46c0-9155-849b8854e46f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:37.921840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:37.922940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:37.924611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:37.924611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:37.924611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:37.924611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:37.924611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:37.924611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:37.924611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:37.924611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:37.924611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 13:45:37.924611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-7b258953-8916-43ae-8da6-14663e227813 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:37.925211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:37.926088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:37.927050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:37.927050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:37.927050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:37.927050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:37.927050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:37.927050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:37.927050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:37.927050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:37.927050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:45:37.927050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:37.927600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 329/657] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:37.927600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c9edb-41e6-46c0-9155-849b8854e46f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:37.928327 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 329/658] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:37.929088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:37.929208 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b258953-8916-43ae-8da6-14663e227813 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:38.027109 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b258953-8916-43ae-8da6-14663e227813 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:38.028035 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c9edb-41e6-46c0-9155-849b8854e46f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:38.060777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a652e-bd6d-4817-b3e5-0fdd93737bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:38.061415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a652e-bd6d-4817-b3e5-0fdd93737bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:38.061698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a652e-bd6d-4817-b3e5-0fdd93737bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:38.061969 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a652e-bd6d-4817-b3e5-0fdd93737bb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:38.062999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a5865-b1f2-45b6-a1b5-7b81fc51fa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:38.063603 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a5865-b1f2-45b6-a1b5-7b81fc51fa20 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:38.063918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a5865-b1f2-45b6-a1b5-7b81fc51fa20 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:38.064257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a5865-b1f2-45b6-a1b5-7b81fc51fa20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:38.065480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a5865-b1f2-45b6-a1b5-7b81fc51fa20 None admin] RBAC: Adding query filter params (role.id=530c8dc4a70b4cb48bc4036a57ffa71b, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=4b3c8a90b97246a98612b627b5f8da80) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:38.065791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a5865-b1f2-45b6-a1b5-7b81fc51fa20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:38.067222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a5865-b1f2-45b6-a1b5-7b81fc51fa20 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:38.069383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a652e-bd6d-4817-b3e5-0fdd93737bb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:38.070860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a652e-bd6d-4817-b3e5-0fdd93737bb5 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:38.073079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 330/659] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:45:37 2022] GET /identity/v3/role_assignments?user.id=4b3c8a90b97246a98612b627b5f8da80&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=530c8dc4a70b4cb48bc4036a57ffa71b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:38.074260 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c815d-a95e-480d-b250-7bbe8177a4ae None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:38.074543 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c815d-a95e-480d-b250-7bbe8177a4ae None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:38.074818 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c815d-a95e-480d-b250-7bbe8177a4ae None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:38.076038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 331/660] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:38.076737 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c815d-a95e-480d-b250-7bbe8177a4ae None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:38.094570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-4d2a652e-bd6d-4817-b3e5-0fdd93737bb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:38.094570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:38.094570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:38.094570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:38.094570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:38.094570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:38.094570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:38.094570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:38.094570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:38.094570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:38.094570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:38.094570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:38.094570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:38.094570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:38.094570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:38.096367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:38.097307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:38.097307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:38.097307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:38.097307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:38.097307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:38.097307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:38.097307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:38.097307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:38.097307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 330/661] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:38.097307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a652e-bd6d-4817-b3e5-0fdd93737bb5 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:38.144773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:38.174931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:38.214510 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c815d-a95e-480d-b250-7bbe8177a4ae None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:38.217956 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a652e-bd6d-4817-b3e5-0fdd93737bb5 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:38.259365 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5f086-e762-4d40-8135-4bf8b01f849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:38.260023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5f086-e762-4d40-8135-4bf8b01f849e None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:38.260308 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5f086-e762-4d40-8135-4bf8b01f849e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:38.260438 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408710da-cddc-47ef-9586-84df13cb67db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:38.260618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5f086-e762-4d40-8135-4bf8b01f849e None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:38.260959 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408710da-cddc-47ef-9586-84df13cb67db None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:38.261246 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408710da-cddc-47ef-9586-84df13cb67db None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:38.261353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5f086-e762-4d40-8135-4bf8b01f849e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:38.261529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408710da-cddc-47ef-9586-84df13cb67db None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:38.261645 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5f086-e762-4d40-8135-4bf8b01f849e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:38.262354 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408710da-cddc-47ef-9586-84df13cb67db None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:38.262661 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408710da-cddc-47ef-9586-84df13cb67db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:38.263079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5f086-e762-4d40-8135-4bf8b01f849e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:38.264104 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408710da-cddc-47ef-9586-84df13cb67db None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:38.284058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 331/663] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Sep 1 13:45:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:38.285305 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45686741-d537-4d11-8444-3d771e7b463f None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:38.285632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45686741-d537-4d11-8444-3d771e7b463f None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:38.285876 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45686741-d537-4d11-8444-3d771e7b463f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:38.287972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 332/663] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Sep 1 13:45:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:38.288975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5f086-e762-4d40-8135-4bf8b01f849e None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:38.304517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-45686741-d537-4d11-8444-3d771e7b463f None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:38.305717 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-45686741-d537-4d11-8444-3d771e7b463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:38.380315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 332/664] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:38.380315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45686741-d537-4d11-8444-3d771e7b463f None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:38.406841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5f086-e762-4d40-8135-4bf8b01f849e None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:38.417550 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:38.434749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:38.444271 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53d270-5183-4610-9966-840a5ff17192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:38.445016 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53d270-5183-4610-9966-840a5ff17192 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:38.445419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53d270-5183-4610-9966-840a5ff17192 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:38.445791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53d270-5183-4610-9966-840a5ff17192 None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:38.446582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53d270-5183-4610-9966-840a5ff17192 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:38.446988 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53d270-5183-4610-9966-840a5ff17192 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:38.448560 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53d270-5183-4610-9966-840a5ff17192 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:38.465192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 333/665] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:38.465192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53d270-5183-4610-9966-840a5ff17192 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:38.516500 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45686741-d537-4d11-8444-3d771e7b463f None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:38.563063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363dd3a-c6eb-40a1-90bb-75eb8b6eba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:38.564147 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363dd3a-c6eb-40a1-90bb-75eb8b6eba95 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:38.564980 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363dd3a-c6eb-40a1-90bb-75eb8b6eba95 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:38.565255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363dd3a-c6eb-40a1-90bb-75eb8b6eba95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:38.578488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53d270-5183-4610-9966-840a5ff17192 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:38.615518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb59f97-3f8f-4ee3-a505-4c9223292200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:38.616752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb59f97-3f8f-4ee3-a505-4c9223292200 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:38.616752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb59f97-3f8f-4ee3-a505-4c9223292200 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:38.616959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb59f97-3f8f-4ee3-a505-4c9223292200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:38.662792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363dd3a-c6eb-40a1-90bb-75eb8b6eba95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:38.664919 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363dd3a-c6eb-40a1-90bb-75eb8b6eba95 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:38.676282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:38.690151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb59f97-3f8f-4ee3-a505-4c9223292200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:38.691511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb59f97-3f8f-4ee3-a505-4c9223292200 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:38.699181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:38.779515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 333/666] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:38.779515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363dd3a-c6eb-40a1-90bb-75eb8b6eba95 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:38.805087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 334/667] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:38.805087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb59f97-3f8f-4ee3-a505-4c9223292200 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:38.887889 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363dd3a-c6eb-40a1-90bb-75eb8b6eba95 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:38.890812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:38.907392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb59f97-3f8f-4ee3-a505-4c9223292200 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:38.933601 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:38.942462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7e92b-86ac-4714-93d9-94d4bc72ec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:38.943400 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7e92b-86ac-4714-93d9-94d4bc72ec97 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:38.943892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7e92b-86ac-4714-93d9-94d4bc72ec97 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:38.944351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7e92b-86ac-4714-93d9-94d4bc72ec97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:38.945403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7e92b-86ac-4714-93d9-94d4bc72ec97 None admin] RBAC: Adding query filter params (role.id=530c8dc4a70b4cb48bc4036a57ffa71b, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=0f750815038d404d9d39a68bf62db8c4) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:38.945880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7e92b-86ac-4714-93d9-94d4bc72ec97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:38.947573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7e92b-86ac-4714-93d9-94d4bc72ec97 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:38.949010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10562731-f714-4a16-a1c8-fd569f1a5739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:38.949643 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10562731-f714-4a16-a1c8-fd569f1a5739 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:38.949922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10562731-f714-4a16-a1c8-fd569f1a5739 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:38.950194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10562731-f714-4a16-a1c8-fd569f1a5739 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:38.964325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 334/668] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:45:38 2022] GET /identity/v3/role_assignments?user.id=0f750815038d404d9d39a68bf62db8c4&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=530c8dc4a70b4cb48bc4036a57ffa71b => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:38.965632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7e92b-86ac-4714-93d9-94d4bc72ec97 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:38.976839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10562731-f714-4a16-a1c8-fd569f1a5739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-10562731-f714-4a16-a1c8-fd569f1a5739 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:38.982044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:38.983056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:38.983924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:38.983924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:38.983924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:38.983924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:38.983924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:38.983924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:38.983924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:38.983924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:38.983924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:38.983924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:38.983924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:38.983924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:38.988636 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 335/669] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:38.989595 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10562731-f714-4a16-a1c8-fd569f1a5739 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:39.106502 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7e92b-86ac-4714-93d9-94d4bc72ec97 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:39.132835 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10562731-f714-4a16-a1c8-fd569f1a5739 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:39.158388 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f607a-dfab-4ff9-85ba-a7c76782bb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:39.159890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f607a-dfab-4ff9-85ba-a7c76782bb7c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:39.160397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f607a-dfab-4ff9-85ba-a7c76782bb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:39.160676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f607a-dfab-4ff9-85ba-a7c76782bb7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:39.174140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f607a-dfab-4ff9-85ba-a7c76782bb7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:39.175613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f607a-dfab-4ff9-85ba-a7c76782bb7c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:39.182342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fcee2-0197-4ae6-86a9-0a0003eb7bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:39.183166 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fcee2-0197-4ae6-86a9-0a0003eb7bbb None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:39.183610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fcee2-0197-4ae6-86a9-0a0003eb7bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:39.184056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fcee2-0197-4ae6-86a9-0a0003eb7bbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-587f607a-dfab-4ff9-85ba-a7c76782bb7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:39.192967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:39.194130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:39.195221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:39.195221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:39.195221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:39.196919 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 335/670] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:39.197852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f607a-dfab-4ff9-85ba-a7c76782bb7c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:39.200594 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fcee2-0197-4ae6-86a9-0a0003eb7bbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:39.203563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fcee2-0197-4ae6-86a9-0a0003eb7bbb None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:39.213839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-7e0fcee2-0197-4ae6-86a9-0a0003eb7bbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:39.224810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:39.229702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:39.230609 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:39.230609 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:39.230609 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:39.230609 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 336/671] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:39.230609 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fcee2-0197-4ae6-86a9-0a0003eb7bbb None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:39.259326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:39.332451 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f607a-dfab-4ff9-85ba-a7c76782bb7c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:39.363264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fcee2-0197-4ae6-86a9-0a0003eb7bbb None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:39.375788 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f434c3-83a0-4a7a-bb70-16ce2191f50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:39.377017 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f434c3-83a0-4a7a-bb70-16ce2191f50d None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:39.377452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f434c3-83a0-4a7a-bb70-16ce2191f50d None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:39.377876 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f434c3-83a0-4a7a-bb70-16ce2191f50d None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:39.378852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f434c3-83a0-4a7a-bb70-16ce2191f50d None admin] RBAC: Adding query filter params (name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:39.379308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f434c3-83a0-4a7a-bb70-16ce2191f50d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:39.381542 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f434c3-83a0-4a7a-bb70-16ce2191f50d None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:39.393117 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 336/672] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:39.394328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f434c3-83a0-4a7a-bb70-16ce2191f50d None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:39.408720 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8fb0e-7219-46bf-9300-f24172688bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:39.409342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8fb0e-7219-46bf-9300-f24172688bee None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:39.409782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8fb0e-7219-46bf-9300-f24172688bee None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:39.410113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8fb0e-7219-46bf-9300-f24172688bee None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:39.411152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8fb0e-7219-46bf-9300-f24172688bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:39.411509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8fb0e-7219-46bf-9300-f24172688bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:39.413275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8fb0e-7219-46bf-9300-f24172688bee None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:39.433373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 337/673] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:39.433373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8fb0e-7219-46bf-9300-f24172688bee None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:39.504354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:39.525615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f434c3-83a0-4a7a-bb70-16ce2191f50d None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:39.529175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:39.554974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8fb0e-7219-46bf-9300-f24172688bee None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:39.572084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709833d3-d52d-46fe-b0bb-8f40121bae89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:39.572943 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709833d3-d52d-46fe-b0bb-8f40121bae89 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:39.574875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709833d3-d52d-46fe-b0bb-8f40121bae89 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:39.574875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709833d3-d52d-46fe-b0bb-8f40121bae89 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:39.575193 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709833d3-d52d-46fe-b0bb-8f40121bae89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:39.575931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709833d3-d52d-46fe-b0bb-8f40121bae89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:39.577997 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709833d3-d52d-46fe-b0bb-8f40121bae89 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:39.595650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 337/674] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:39.597132 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aab50f-7fac-42e5-9777-8e1b1b8ccdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:39.597581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709833d3-d52d-46fe-b0bb-8f40121bae89 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:39.597962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aab50f-7fac-42e5-9777-8e1b1b8ccdd4 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:39.598327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aab50f-7fac-42e5-9777-8e1b1b8ccdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:39.598695 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aab50f-7fac-42e5-9777-8e1b1b8ccdd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:39.610721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aab50f-7fac-42e5-9777-8e1b1b8ccdd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:39.613284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aab50f-7fac-42e5-9777-8e1b1b8ccdd4 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-95aab50f-7fac-42e5-9777-8e1b1b8ccdd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:39.631748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:39.633218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:39.634310 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:39.634310 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:39.634310 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:39.635949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 338/675] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:39.636939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aab50f-7fac-42e5-9777-8e1b1b8ccdd4 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:39.718386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709833d3-d52d-46fe-b0bb-8f40121bae89 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:39.751829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aab50f-7fac-42e5-9777-8e1b1b8ccdd4 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:39.755358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653a5c4-9805-4ec5-9415-729ae7f3796e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:39.756029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653a5c4-9805-4ec5-9415-729ae7f3796e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:39.756310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653a5c4-9805-4ec5-9415-729ae7f3796e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:39.756588 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653a5c4-9805-4ec5-9415-729ae7f3796e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:39.764072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653a5c4-9805-4ec5-9415-729ae7f3796e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:39.765517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653a5c4-9805-4ec5-9415-729ae7f3796e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:39.766357 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:39.777507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-d653a5c4-9805-4ec5-9415-729ae7f3796e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:39.777507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:39.777507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:39.777507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:39.777507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:39.777507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:39.777507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:39.777507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:39.777507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:39.777507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:39.777507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:39.777507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:39.777507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:39.777507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:39.777507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:39.778654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:39.779704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:39.779704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:39.779704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:39.779704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:39.779704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:39.779704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:39.779704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:39.779704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:39.783791 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 338/676] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:39.784709 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653a5c4-9805-4ec5-9415-729ae7f3796e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:39.795036 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bce31b-8d33-4cb0-9aff-f73cfa1390c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:39.796064 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bce31b-8d33-4cb0-9aff-f73cfa1390c1 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:39.796576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bce31b-8d33-4cb0-9aff-f73cfa1390c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:39.797094 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bce31b-8d33-4cb0-9aff-f73cfa1390c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:39.805214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bce31b-8d33-4cb0-9aff-f73cfa1390c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:39.806925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bce31b-8d33-4cb0-9aff-f73cfa1390c1 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:39.810218 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:39.820634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-d8bce31b-8d33-4cb0-9aff-f73cfa1390c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:39.820634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:39.820634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:39.820634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:39.820634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:39.820634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:39.820634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:39.820634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:39.820634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:39.820634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:39.820634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:39.820634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:39.820634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:39.820634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:39.820634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:39.821725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:39.822789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:39.822789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:39.822789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:39.822789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:39.822789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:39.822789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:39.822789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:39.822789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:39.824719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 339/677] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:39.825620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bce31b-8d33-4cb0-9aff-f73cfa1390c1 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:39.887974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653a5c4-9805-4ec5-9415-729ae7f3796e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:39.922327 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac7065-2378-4cd7-aa3d-9ddd6f21020b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:39.922935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac7065-2378-4cd7-aa3d-9ddd6f21020b None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:39.923215 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac7065-2378-4cd7-aa3d-9ddd6f21020b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:39.923541 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac7065-2378-4cd7-aa3d-9ddd6f21020b None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:39.924221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac7065-2378-4cd7-aa3d-9ddd6f21020b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:39.924525 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac7065-2378-4cd7-aa3d-9ddd6f21020b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:39.925983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac7065-2378-4cd7-aa3d-9ddd6f21020b None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:39.935770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bce31b-8d33-4cb0-9aff-f73cfa1390c1 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:39.942753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 339/678] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:39.944090 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac7065-2378-4cd7-aa3d-9ddd6f21020b None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:39.974687 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49c376-2fa5-42b1-a9d5-0e36cf8c9b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:39.975638 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49c376-2fa5-42b1-a9d5-0e36cf8c9b6a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:39.976132 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49c376-2fa5-42b1-a9d5-0e36cf8c9b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:39.976607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49c376-2fa5-42b1-a9d5-0e36cf8c9b6a None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:39.977442 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49c376-2fa5-42b1-a9d5-0e36cf8c9b6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:39.977954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49c376-2fa5-42b1-a9d5-0e36cf8c9b6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:39.979705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49c376-2fa5-42b1-a9d5-0e36cf8c9b6a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:39.994235 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 340/679] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:39.995365 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49c376-2fa5-42b1-a9d5-0e36cf8c9b6a None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:40.035711 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:40.044263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:40.052170 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac7065-2378-4cd7-aa3d-9ddd6f21020b None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:40.087763 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2cc33-b75c-46bc-a793-5a1171c33032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:40.088389 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2cc33-b75c-46bc-a793-5a1171c33032 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:40.088670 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2cc33-b75c-46bc-a793-5a1171c33032 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:40.089280 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2cc33-b75c-46bc-a793-5a1171c33032 None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:40.089624 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2cc33-b75c-46bc-a793-5a1171c33032 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:40.089930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2cc33-b75c-46bc-a793-5a1171c33032 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:40.091346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2cc33-b75c-46bc-a793-5a1171c33032 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:40.104137 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 340/680] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:40.104993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2cc33-b75c-46bc-a793-5a1171c33032 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:40.109174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49c376-2fa5-42b1-a9d5-0e36cf8c9b6a None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:40.146875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a7f00-7101-4440-a4f2-0ebe9ccba827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:40.147574 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7f00-7101-4440-a4f2-0ebe9ccba827 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:40.148085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7f00-7101-4440-a4f2-0ebe9ccba827 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:40.148527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7f00-7101-4440-a4f2-0ebe9ccba827 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:40.158423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a7f00-7101-4440-a4f2-0ebe9ccba827 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:40.159917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a7f00-7101-4440-a4f2-0ebe9ccba827 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-7c4a7f00-7101-4440-a4f2-0ebe9ccba827 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:40.176167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:40.177341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:40.178436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:40.178436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:40.178436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:40.178436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:40.178436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:40.178436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:40.178436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:40.178436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:40.178436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:45:40.178436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:40.180565 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 341/681] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:45:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:40.181891 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc8c23-0363-4be7-a999-d476d1596cef None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:40.181891 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc8c23-0363-4be7-a999-d476d1596cef None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:40.181891 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc8c23-0363-4be7-a999-d476d1596cef None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:40.187899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 342/682] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:40.187899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc8c23-0363-4be7-a999-d476d1596cef None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:40.233514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2cc33-b75c-46bc-a793-5a1171c33032 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:40.272472 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb15091-32b9-43c5-82ef-bde47ee1d7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:40.273076 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb15091-32b9-43c5-82ef-bde47ee1d7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:40.273358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb15091-32b9-43c5-82ef-bde47ee1d7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:40.273651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb15091-32b9-43c5-82ef-bde47ee1d7c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:40.274402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb15091-32b9-43c5-82ef-bde47ee1d7c5 None admin] RBAC: Adding query filter params (role.id=530c8dc4a70b4cb48bc4036a57ffa71b, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=92870867b169496fa8913b2ab93eac37) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:40.274691 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb15091-32b9-43c5-82ef-bde47ee1d7c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:40.276186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb15091-32b9-43c5-82ef-bde47ee1d7c5 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:40.291895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 341/683] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:45:40 2022] GET /identity/v3/role_assignments?user.id=92870867b169496fa8913b2ab93eac37&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=530c8dc4a70b4cb48bc4036a57ffa71b => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:40.291895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb15091-32b9-43c5-82ef-bde47ee1d7c5 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:40.301868 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:40.307882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:40.316415 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc8c23-0363-4be7-a999-d476d1596cef None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:40.357752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c27048-855c-4078-b131-bceb8a17cfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:40.358740 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c27048-855c-4078-b131-bceb8a17cfbd None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:40.359231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c27048-855c-4078-b131-bceb8a17cfbd None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:40.359786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c27048-855c-4078-b131-bceb8a17cfbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:40.360858 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c27048-855c-4078-b131-bceb8a17cfbd None admin] RBAC: Adding query filter params (role.id=530c8dc4a70b4cb48bc4036a57ffa71b, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=4a9703db64624bbeb392d693ca60c6e3) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:40.361423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c27048-855c-4078-b131-bceb8a17cfbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:40.363103 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c27048-855c-4078-b131-bceb8a17cfbd None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:40.376382 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 343/684] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:45:40 2022] GET /identity/v3/role_assignments?user.id=4a9703db64624bbeb392d693ca60c6e3&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=530c8dc4a70b4cb48bc4036a57ffa71b => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:40.378841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab06649-25d5-4972-882e-dbb5e2be46f6 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:40.379393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab06649-25d5-4972-882e-dbb5e2be46f6 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:40.380027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab06649-25d5-4972-882e-dbb5e2be46f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:40.421135 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-9ab06649-25d5-4972-882e-dbb5e2be46f6 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:40.423317 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-9ab06649-25d5-4972-882e-dbb5e2be46f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:40.434018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb15091-32b9-43c5-82ef-bde47ee1d7c5 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:40.486931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528cb01-8b18-467d-a489-af7c01c172e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:40.488439 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528cb01-8b18-467d-a489-af7c01c172e1 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:40.488439 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528cb01-8b18-467d-a489-af7c01c172e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:40.488439 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528cb01-8b18-467d-a489-af7c01c172e1 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:40.489248 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528cb01-8b18-467d-a489-af7c01c172e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:40.490937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528cb01-8b18-467d-a489-af7c01c172e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:40.491218 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528cb01-8b18-467d-a489-af7c01c172e1 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:40.517986 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 342/685] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Sep 1 13:45:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:40.529009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528cb01-8b18-467d-a489-af7c01c172e1 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:40.545878 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 344/686] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:40.607553 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:40.638684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528cb01-8b18-467d-a489-af7c01c172e1 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:40.681657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05dc34-28a1-42a2-b223-6444ad0f216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:40.682287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05dc34-28a1-42a2-b223-6444ad0f216f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:40.682570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05dc34-28a1-42a2-b223-6444ad0f216f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:40.682903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05dc34-28a1-42a2-b223-6444ad0f216f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:40.755045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05dc34-28a1-42a2-b223-6444ad0f216f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:40.756473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05dc34-28a1-42a2-b223-6444ad0f216f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:40.824189 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:40.840283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab06649-25d5-4972-882e-dbb5e2be46f6 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:40.877802 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 343/687] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:40.883851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05dc34-28a1-42a2-b223-6444ad0f216f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:40.939758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:40.959255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab06649-25d5-4972-882e-dbb5e2be46f6 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:41.038399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4ae33-c31e-4cfc-b753-51dbc3012a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:41.039479 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4ae33-c31e-4cfc-b753-51dbc3012a5a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:41.040621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4ae33-c31e-4cfc-b753-51dbc3012a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:41.040621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4ae33-c31e-4cfc-b753-51dbc3012a5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:41.071072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4ae33-c31e-4cfc-b753-51dbc3012a5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-48b4ae33-c31e-4cfc-b753-51dbc3012a5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:41.075938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:41.076932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:41.077829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:41.077829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:41.077829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:41.077829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:41.077829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:41.077829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:41.077829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:41.077829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:41.077829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:41.077829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:41.077829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:41.077829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:41.078485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05dc34-28a1-42a2-b223-6444ad0f216f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:41.080520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 345/688] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:45:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:45:41.085070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4ae33-c31e-4cfc-b753-51dbc3012a5a None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:41.114833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00c847-13c1-4e19-8b3d-0bdea08f4160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:41.115645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00c847-13c1-4e19-8b3d-0bdea08f4160 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:41.115972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00c847-13c1-4e19-8b3d-0bdea08f4160 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:41.116256 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00c847-13c1-4e19-8b3d-0bdea08f4160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:41.128147 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00c847-13c1-4e19-8b3d-0bdea08f4160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:41.129676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00c847-13c1-4e19-8b3d-0bdea08f4160 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-3f00c847-13c1-4e19-8b3d-0bdea08f4160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:41.146893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:41.147945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:41.149185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:41.149185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:41.149185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:41.149185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 344/689] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:45:41.150191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c441092-9cb9-4034-9b25-779bdf6b2aa6 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:41.150541 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c441092-9cb9-4034-9b25-779bdf6b2aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:41.150883 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c441092-9cb9-4034-9b25-779bdf6b2aa6 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:41.152452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 345/690] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:41.156762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c441092-9cb9-4034-9b25-779bdf6b2aa6 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:41.177380 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:41.239709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4ae33-c31e-4cfc-b753-51dbc3012a5a None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:41.278360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96447c9e-db59-44ec-b8c6-ae24a361b524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:41.279102 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96447c9e-db59-44ec-b8c6-ae24a361b524 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:41.279449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96447c9e-db59-44ec-b8c6-ae24a361b524 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:41.279896 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96447c9e-db59-44ec-b8c6-ae24a361b524 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:41.280635 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96447c9e-db59-44ec-b8c6-ae24a361b524 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:41.280884 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c441092-9cb9-4034-9b25-779bdf6b2aa6 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:41.281331 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96447c9e-db59-44ec-b8c6-ae24a361b524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:41.282457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96447c9e-db59-44ec-b8c6-ae24a361b524 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:41.292306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 346/691] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:41.293711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e7ad0-e93b-42b8-ba6b-0f337c88743b None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:41.294001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e7ad0-e93b-42b8-ba6b-0f337c88743b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:41.294413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e7ad0-e93b-42b8-ba6b-0f337c88743b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:41.315351 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:41.325001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cb681-6a08-4cc1-ae14-07836e796830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:41.325857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cb681-6a08-4cc1-ae14-07836e796830 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:41.328995 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b18e7ad0-e93b-42b8-ba6b-0f337c88743b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:41.329107 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cb681-6a08-4cc1-ae14-07836e796830 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:41.329107 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cb681-6a08-4cc1-ae14-07836e796830 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:41.329241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b18e7ad0-e93b-42b8-ba6b-0f337c88743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:41.329312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cb681-6a08-4cc1-ae14-07836e796830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:41.329312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cb681-6a08-4cc1-ae14-07836e796830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:41.330004 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cb681-6a08-4cc1-ae14-07836e796830 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:41.350310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 346/692] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:41.351680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cb681-6a08-4cc1-ae14-07836e796830 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:41.408267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 347/693] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:41.409273 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e7ad0-e93b-42b8-ba6b-0f337c88743b None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:41.452416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:41.479046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cb681-6a08-4cc1-ae14-07836e796830 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:41.519359 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bd011-6c10-44f2-8871-45da8fc476c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:41.520278 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bd011-6c10-44f2-8871-45da8fc476c6 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:41.521108 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bd011-6c10-44f2-8871-45da8fc476c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:41.521540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bd011-6c10-44f2-8871-45da8fc476c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:41.535001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bd011-6c10-44f2-8871-45da8fc476c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:41.536834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bd011-6c10-44f2-8871-45da8fc476c6 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-d09bd011-6c10-44f2-8871-45da8fc476c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:41.555911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:41.557065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:41.558180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:41.558180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:41.558180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:41.564616 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 347/694] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:41.566557 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bd011-6c10-44f2-8871-45da8fc476c6 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:41.678460 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bd011-6c10-44f2-8871-45da8fc476c6 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:41.697917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e7ad0-e93b-42b8-ba6b-0f337c88743b None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:41.721433 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d909fdc-4605-4639-801a-6fa37e40b792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:41.722282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d909fdc-4605-4639-801a-6fa37e40b792 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:41.722734 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d909fdc-4605-4639-801a-6fa37e40b792 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:41.723166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d909fdc-4605-4639-801a-6fa37e40b792 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:41.724009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d909fdc-4605-4639-801a-6fa37e40b792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:41.724467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d909fdc-4605-4639-801a-6fa37e40b792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:41.725981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d909fdc-4605-4639-801a-6fa37e40b792 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:41.734194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:41.745701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 348/695] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:41.745701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d909fdc-4605-4639-801a-6fa37e40b792 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:41.772305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304edd76-58ea-4166-aa45-c7cd0ebdcc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:41.773299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304edd76-58ea-4166-aa45-c7cd0ebdcc83 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:41.773827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304edd76-58ea-4166-aa45-c7cd0ebdcc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:41.774306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304edd76-58ea-4166-aa45-c7cd0ebdcc83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:41.777387 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:41.782953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304edd76-58ea-4166-aa45-c7cd0ebdcc83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:41.784826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304edd76-58ea-4166-aa45-c7cd0ebdcc83 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:41.796550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-304edd76-58ea-4166-aa45-c7cd0ebdcc83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:41.796550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:41.796550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:41.796550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:41.796550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:41.796550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:41.796550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:41.796550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:41.796550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:41.796550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:41.796550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:41.796550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:41.796550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:41.796550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:41.796550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:41.797480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:41.798918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:41.798918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:41.798918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:41.798918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:41.798918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:41.798918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:41.798918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:41.798918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:41.801397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 348/696] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:41.802535 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304edd76-58ea-4166-aa45-c7cd0ebdcc83 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:41.874425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d909fdc-4605-4639-801a-6fa37e40b792 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:41.912188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304edd76-58ea-4166-aa45-c7cd0ebdcc83 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:41.922221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c48d1c-147d-4b48-9dae-ff2252f13036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:41.922866 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c48d1c-147d-4b48-9dae-ff2252f13036 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:41.923152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c48d1c-147d-4b48-9dae-ff2252f13036 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:41.923480 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c48d1c-147d-4b48-9dae-ff2252f13036 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:41.937075 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c48d1c-147d-4b48-9dae-ff2252f13036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:41.939039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c48d1c-147d-4b48-9dae-ff2252f13036 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:41.949916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3f9c6-c4f9-4419-abb5-b4b3c3f66425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:41.950860 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3f9c6-c4f9-4419-abb5-b4b3c3f66425 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:41.951436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3f9c6-c4f9-4419-abb5-b4b3c3f66425 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:41.952045 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3f9c6-c4f9-4419-abb5-b4b3c3f66425 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-f2c48d1c-147d-4b48-9dae-ff2252f13036 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:41.958122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:41.959066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:41.960023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:41.960023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:41.960023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:41.964234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 349/697] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:41.965214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c48d1c-147d-4b48-9dae-ff2252f13036 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:41.965667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3f9c6-c4f9-4419-abb5-b4b3c3f66425 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:41.967390 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3f9c6-c4f9-4419-abb5-b4b3c3f66425 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-1fb3f9c6-c4f9-4419-abb5-b4b3c3f66425 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:41.980969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:41.981985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:41.982974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:41.982974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:41.982974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:41.982974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:41.982974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:41.982974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:41.982974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:41.982974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:41.982974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:45:41.982974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:41.989934 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 349/698] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 13:45:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:41.990983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3f9c6-c4f9-4419-abb5-b4b3c3f66425 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:42.017778 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:42.062211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:42.082655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c48d1c-147d-4b48-9dae-ff2252f13036 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:42.119789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3f9c6-c4f9-4419-abb5-b4b3c3f66425 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:42.128464 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7788193-808b-4651-a706-19af7ada3e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:42.129281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7788193-808b-4651-a706-19af7ada3e60 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:42.129731 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7788193-808b-4651-a706-19af7ada3e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:42.130523 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7788193-808b-4651-a706-19af7ada3e60 None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:42.131377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7788193-808b-4651-a706-19af7ada3e60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:42.132192 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7788193-808b-4651-a706-19af7ada3e60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:42.134314 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7788193-808b-4651-a706-19af7ada3e60 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:42.152476 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 350/699] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:42.153567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7788193-808b-4651-a706-19af7ada3e60 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:42.162231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b539651-f789-41c6-b94e-ca599a9a4427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:42.162981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b539651-f789-41c6-b94e-ca599a9a4427 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:42.163383 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b539651-f789-41c6-b94e-ca599a9a4427 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:42.163760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b539651-f789-41c6-b94e-ca599a9a4427 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:42.165137 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b539651-f789-41c6-b94e-ca599a9a4427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:42.165522 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b539651-f789-41c6-b94e-ca599a9a4427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:42.167150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b539651-f789-41c6-b94e-ca599a9a4427 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:42.183989 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 350/700] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:42.185213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b539651-f789-41c6-b94e-ca599a9a4427 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:42.323137 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7788193-808b-4651-a706-19af7ada3e60 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:42.325733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:42.330883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b539651-f789-41c6-b94e-ca599a9a4427 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:42.356324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:42.377041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94164737-7d2d-45f1-bd83-310f125dee9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:42.377997 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94164737-7d2d-45f1-bd83-310f125dee9f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:42.378538 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94164737-7d2d-45f1-bd83-310f125dee9f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:42.379032 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94164737-7d2d-45f1-bd83-310f125dee9f None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:42.380146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94164737-7d2d-45f1-bd83-310f125dee9f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:42.380670 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94164737-7d2d-45f1-bd83-310f125dee9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:42.383047 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94164737-7d2d-45f1-bd83-310f125dee9f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:42.388408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a6580-078f-44a3-8186-7ffa8a0b4489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:42.389027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a6580-078f-44a3-8186-7ffa8a0b4489 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:42.389309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a6580-078f-44a3-8186-7ffa8a0b4489 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:42.389580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a6580-078f-44a3-8186-7ffa8a0b4489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:42.390305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a6580-078f-44a3-8186-7ffa8a0b4489 None admin] RBAC: Adding query filter params (role.id=530c8dc4a70b4cb48bc4036a57ffa71b, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=cdebe1b674cc4b2bb6bf962de01a24ac) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:42.390612 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a6580-078f-44a3-8186-7ffa8a0b4489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:42.392054 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a6580-078f-44a3-8186-7ffa8a0b4489 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:42.400446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 351/701] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:45:42 2022] GET /identity/v3/role_assignments?user.id=cdebe1b674cc4b2bb6bf962de01a24ac&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=530c8dc4a70b4cb48bc4036a57ffa71b => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:42.401372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a6580-078f-44a3-8186-7ffa8a0b4489 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:42.426782 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 351/702] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 13:45:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:42.431690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94164737-7d2d-45f1-bd83-310f125dee9f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:42.565685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a6580-078f-44a3-8186-7ffa8a0b4489 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:42.605379 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3728116-ead9-42af-8d48-48c1301a0fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:42.606021 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3728116-ead9-42af-8d48-48c1301a0fbf None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:42.606304 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3728116-ead9-42af-8d48-48c1301a0fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:42.606576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3728116-ead9-42af-8d48-48c1301a0fbf None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:42.607238 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3728116-ead9-42af-8d48-48c1301a0fbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:42.608757 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3728116-ead9-42af-8d48-48c1301a0fbf None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:42.668195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94164737-7d2d-45f1-bd83-310f125dee9f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:42.712756 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faf90d-f522-4bae-96c4-efebf6859ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:42.713869 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faf90d-f522-4bae-96c4-efebf6859ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:42.714360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faf90d-f522-4bae-96c4-efebf6859ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:42.714846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faf90d-f522-4bae-96c4-efebf6859ac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:42.741614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 352/703] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:45:42 2022] POST /identity/v3/users => generated 254 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:45:42.744378 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354aaba1-27bf-44f9-bb34-5efbb1b883a0 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:42.744983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354aaba1-27bf-44f9-bb34-5efbb1b883a0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:42.745521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354aaba1-27bf-44f9-bb34-5efbb1b883a0 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:42.747541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 353/704] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:42.755896 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0ee18-4863-4cef-80ec-94b0571477e3 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:42.756523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0ee18-4863-4cef-80ec-94b0571477e3 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:42.757293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:42.759401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0ee18-4863-4cef-80ec-94b0571477e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:42.792867 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-7fc0ee18-4863-4cef-80ec-94b0571477e3 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:42.794567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7fc0ee18-4863-4cef-80ec-94b0571477e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:42.823733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2faf90d-f522-4bae-96c4-efebf6859ac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:42.825270 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2faf90d-f522-4bae-96c4-efebf6859ac4 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:42.833375 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:42.886975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 354/705] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:42.888422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f86cb6-62be-4f42-9853-9863ada90871 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:42.889142 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f86cb6-62be-4f42-9853-9863ada90871 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:42.889429 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f86cb6-62be-4f42-9853-9863ada90871 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:42.891608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 355/706] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:42.897564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bc983-fda5-4fa0-ae18-e4b03ac4e0b6 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:42.897851 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bc983-fda5-4fa0-ae18-e4b03ac4e0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:42.898129 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bc983-fda5-4fa0-ae18-e4b03ac4e0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:42.921371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-1b6bc983-fda5-4fa0-ae18-e4b03ac4e0b6 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:42.922768 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1b6bc983-fda5-4fa0-ae18-e4b03ac4e0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:42.968887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 352/707] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 13:45:42.975839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faf90d-f522-4bae-96c4-efebf6859ac4 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:43.010664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 356/708] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:43.045352 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:43.093915 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faf90d-f522-4bae-96c4-efebf6859ac4 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:43.129666 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f817c2-2817-4e1f-be68-1336d3a56910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:43.130304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f817c2-2817-4e1f-be68-1336d3a56910 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:43.130588 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f817c2-2817-4e1f-be68-1336d3a56910 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:43.130861 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f817c2-2817-4e1f-be68-1336d3a56910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:43.141551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f817c2-2817-4e1f-be68-1336d3a56910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:43.143175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f817c2-2817-4e1f-be68-1336d3a56910 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-c8f817c2-2817-4e1f-be68-1336d3a56910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:43.159703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:43.160755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:43.161678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:43.161678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:43.161678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:43.167224 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 353/709] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:43.167387 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bc983-fda5-4fa0-ae18-e4b03ac4e0b6 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:43.182094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f817c2-2817-4e1f-be68-1336d3a56910 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:43.306687 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:43.314562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bc983-fda5-4fa0-ae18-e4b03ac4e0b6 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:43.338823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f817c2-2817-4e1f-be68-1336d3a56910 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:43.357452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:43.368051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dffba-70f3-4147-84a5-498f64c3e49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:43.369060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dffba-70f3-4147-84a5-498f64c3e49c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:43.369503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dffba-70f3-4147-84a5-498f64c3e49c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:43.369951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dffba-70f3-4147-84a5-498f64c3e49c None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:43.370795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dffba-70f3-4147-84a5-498f64c3e49c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:43.371277 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dffba-70f3-4147-84a5-498f64c3e49c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:43.373413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dffba-70f3-4147-84a5-498f64c3e49c None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:43.405146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 357/710] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:43.405146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dffba-70f3-4147-84a5-498f64c3e49c None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:43.409261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfb0e1-aefa-4188-9616-e985a35077b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:43.410134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfb0e1-aefa-4188-9616-e985a35077b7 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:43.410647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfb0e1-aefa-4188-9616-e985a35077b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:43.411103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfb0e1-aefa-4188-9616-e985a35077b7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:43.411897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfb0e1-aefa-4188-9616-e985a35077b7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:43.413528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfb0e1-aefa-4188-9616-e985a35077b7 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-d7dfb0e1-aefa-4188-9616-e985a35077b7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:43.425819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:43.426977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:43.427850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:43.427850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:43.427850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:43.427850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:43.427850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:43.427850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:43.427850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:43.427850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:43.427850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:43.427850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:43.427850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:45:43.427850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:45:43.427850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:45:43.427850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:43.430891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 354/711] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Sep 1 13:45:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:45:43.432061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfb0e1-aefa-4188-9616-e985a35077b7 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:43.519823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dffba-70f3-4147-84a5-498f64c3e49c None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:43.542386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfb0e1-aefa-4188-9616-e985a35077b7 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:43.556371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376721a-b69b-46ce-aaab-95e8c992843f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:43.557013 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376721a-b69b-46ce-aaab-95e8c992843f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:43.557297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376721a-b69b-46ce-aaab-95e8c992843f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:43.557572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376721a-b69b-46ce-aaab-95e8c992843f None admin] PATH_INFO: `/v3/services/network` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:43.558158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376721a-b69b-46ce-aaab-95e8c992843f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:43.559809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376721a-b69b-46ce-aaab-95e8c992843f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-c376721a-b69b-46ce-aaab-95e8c992843f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:43.572343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:43.573373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:43.574246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:43.574246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:43.574246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:43.574246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:43.574246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:43.574246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:43.574246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:43.574246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:43.574246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:43.574246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:43.574246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:45:43.574246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:45:43.574246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:45:43.574246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:43.578427 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 358/712] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:43 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:43.579377 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376721a-b69b-46ce-aaab-95e8c992843f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:43.590392 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655449b-735a-4cbb-a5f2-88b07b0f2dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:43.591665 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655449b-735a-4cbb-a5f2-88b07b0f2dfb None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:43.592166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655449b-735a-4cbb-a5f2-88b07b0f2dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:43.592902 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655449b-735a-4cbb-a5f2-88b07b0f2dfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:43.602385 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655449b-735a-4cbb-a5f2-88b07b0f2dfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:43.603159 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:43.604910 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655449b-735a-4cbb-a5f2-88b07b0f2dfb None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:43.621570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-d655449b-735a-4cbb-a5f2-88b07b0f2dfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:43.621570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:43.621570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:43.621570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:43.621570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:43.621570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:43.621570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:43.621570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:43.621570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:43.621570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:43.621570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:43.621570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:43.621570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:43.621570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:43.621570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:43.622513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:43.623412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:43.623412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:43.623412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:43.623412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:43.623412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:43.623412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:43.623412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:43.623412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:43.632171 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 355/713] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:43.632171 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655449b-735a-4cbb-a5f2-88b07b0f2dfb None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:43.677058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:43.709551 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376721a-b69b-46ce-aaab-95e8c992843f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:43.759808 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655449b-735a-4cbb-a5f2-88b07b0f2dfb None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:43.760327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ac13a-76b7-4866-9da8-40fba0fc3c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:43.760948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ac13a-76b7-4866-9da8-40fba0fc3c4a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:43.761230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ac13a-76b7-4866-9da8-40fba0fc3c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:43.761503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ac13a-76b7-4866-9da8-40fba0fc3c4a None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:43.762132 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ac13a-76b7-4866-9da8-40fba0fc3c4a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:43.762433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ac13a-76b7-4866-9da8-40fba0fc3c4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:43.764007 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ac13a-76b7-4866-9da8-40fba0fc3c4a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:43.775228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 359/714] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Sep 1 13:45:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:43.775228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ac13a-76b7-4866-9da8-40fba0fc3c4a None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:43.804266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9bef8-134f-4ca1-b599-d0ebe0c84559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:43.805318 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9bef8-134f-4ca1-b599-d0ebe0c84559 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:43.805865 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9bef8-134f-4ca1-b599-d0ebe0c84559 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:43.806354 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9bef8-134f-4ca1-b599-d0ebe0c84559 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:43.807202 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9bef8-134f-4ca1-b599-d0ebe0c84559 None admin] RBAC: Adding query filter params (name=network) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:43.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9bef8-134f-4ca1-b599-d0ebe0c84559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:43.809380 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9bef8-134f-4ca1-b599-d0ebe0c84559 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:43.819111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 356/715] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 13:45:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:43.820386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9bef8-134f-4ca1-b599-d0ebe0c84559 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:43.869538 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:43.886402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ac13a-76b7-4866-9da8-40fba0fc3c4a None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:43.922618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a8cf3-1e1d-4d45-bfbe-67340d99a9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:43.924085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a8cf3-1e1d-4d45-bfbe-67340d99a9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:43.924528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a8cf3-1e1d-4d45-bfbe-67340d99a9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:43.924947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a8cf3-1e1d-4d45-bfbe-67340d99a9b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:43.925777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a8cf3-1e1d-4d45-bfbe-67340d99a9b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:43.926314 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a8cf3-1e1d-4d45-bfbe-67340d99a9b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:43.927982 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a8cf3-1e1d-4d45-bfbe-67340d99a9b6 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:43.929035 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:43.932841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9bef8-134f-4ca1-b599-d0ebe0c84559 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:43.945861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 360/716] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:43.947058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a8cf3-1e1d-4d45-bfbe-67340d99a9b6 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:43.969951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907f865-3440-44ff-b0a5-233c6fa459a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:43.971267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f865-3440-44ff-b0a5-233c6fa459a9 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:43.971499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f865-3440-44ff-b0a5-233c6fa459a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:43.971849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f865-3440-44ff-b0a5-233c6fa459a9 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:43.972739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907f865-3440-44ff-b0a5-233c6fa459a9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:43.973156 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907f865-3440-44ff-b0a5-233c6fa459a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:43.974520 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907f865-3440-44ff-b0a5-233c6fa459a9 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:43.980402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 357/717] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Sep 1 13:45:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:43.988605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907f865-3440-44ff-b0a5-233c6fa459a9 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:44.059178 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a8cf3-1e1d-4d45-bfbe-67340d99a9b6 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:44.111085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728c979-f47e-4d91-ae22-99e148be2266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:44.112538 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728c979-f47e-4d91-ae22-99e148be2266 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:44.113754 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728c979-f47e-4d91-ae22-99e148be2266 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:44.114403 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728c979-f47e-4d91-ae22-99e148be2266 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:44.117916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728c979-f47e-4d91-ae22-99e148be2266 None admin] RBAC: Adding query filter params (type=network) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:44.118529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728c979-f47e-4d91-ae22-99e148be2266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:44.120183 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728c979-f47e-4d91-ae22-99e148be2266 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:44.146010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 361/718] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 13:45:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:44.166960 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907f865-3440-44ff-b0a5-233c6fa459a9 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:44.211958 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f1fde-36a4-4a82-a981-1e8727c89517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:44.213344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f1fde-36a4-4a82-a981-1e8727c89517 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:44.214036 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f1fde-36a4-4a82-a981-1e8727c89517 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:44.214723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f1fde-36a4-4a82-a981-1e8727c89517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:44.216166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f1fde-36a4-4a82-a981-1e8727c89517 None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=4b3c8a90b97246a98612b627b5f8da80) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:44.216720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f1fde-36a4-4a82-a981-1e8727c89517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:44.218416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f1fde-36a4-4a82-a981-1e8727c89517 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:44.232058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 358/719] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:45:43 2022] GET /identity/v3/role_assignments?user.id=4b3c8a90b97246a98612b627b5f8da80&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:44.770908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89f6d4-3c21-4939-91d0-51e68a552612 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:44.771440 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89f6d4-3c21-4939-91d0-51e68a552612 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:44.771552 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89f6d4-3c21-4939-91d0-51e68a552612 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:44.773102 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 362/720] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:44.778689 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc080c6-e62f-4ac7-a231-94d06050f26a None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:44.779145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc080c6-e62f-4ac7-a231-94d06050f26a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:44.779225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc080c6-e62f-4ac7-a231-94d06050f26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:44.808956 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-2bc080c6-e62f-4ac7-a231-94d06050f26a None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:44.810172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2bc080c6-e62f-4ac7-a231-94d06050f26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:44.840673 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:44.890574 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 359/721] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:45:45.175020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89f6d4-3c21-4939-91d0-51e68a552612 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:45.189955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:45.244232 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c1eb6-4a7b-4b0d-9f77-71be5c1fb8b3 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:45.244543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c1eb6-4a7b-4b0d-9f77-71be5c1fb8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:45.244811 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c1eb6-4a7b-4b0d-9f77-71be5c1fb8b3 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:45.246496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 360/722] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:45.253019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add1d1f-6764-4af1-b86c-c275ad4a6dda None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:45.253308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add1d1f-6764-4af1-b86c-c275ad4a6dda None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:45.253585 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add1d1f-6764-4af1-b86c-c275ad4a6dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:45.275657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-0add1d1f-6764-4af1-b86c-c275ad4a6dda None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:45.277398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0add1d1f-6764-4af1-b86c-c275ad4a6dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:45.312060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89f6d4-3c21-4939-91d0-51e68a552612 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:45.372295 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565a3e2-0dec-476a-8d45-4f39cee1d9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:45.373008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565a3e2-0dec-476a-8d45-4f39cee1d9ea None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:45.373339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565a3e2-0dec-476a-8d45-4f39cee1d9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:45.373614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565a3e2-0dec-476a-8d45-4f39cee1d9ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:45.393682 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565a3e2-0dec-476a-8d45-4f39cee1d9ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-8565a3e2-0dec-476a-8d45-4f39cee1d9ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:45.398952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:45.399884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:45.400749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:45.400749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:45.400749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:45.400749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:45.400749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:45.400749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:45.400749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:45.400749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:45.400749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:45.400749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:45.400749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:45.400749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:45.400749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 363/723] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:45:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:45.402591 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 361/724] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 13:45:45.405929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565a3e2-0dec-476a-8d45-4f39cee1d9ea None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:45.513310 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:45.554959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565a3e2-0dec-476a-8d45-4f39cee1d9ea None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:45.604435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20503ce-b811-4911-ab9c-9fddc83bc29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:45.605047 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20503ce-b811-4911-ab9c-9fddc83bc29b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:45.605324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20503ce-b811-4911-ab9c-9fddc83bc29b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:45.605592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20503ce-b811-4911-ab9c-9fddc83bc29b None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:45.606251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20503ce-b811-4911-ab9c-9fddc83bc29b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:45.606554 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20503ce-b811-4911-ab9c-9fddc83bc29b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:45.607924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20503ce-b811-4911-ab9c-9fddc83bc29b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:45.622757 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 364/725] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:45.628438 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add1d1f-6764-4af1-b86c-c275ad4a6dda None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:45.713652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20503ce-b811-4911-ab9c-9fddc83bc29b None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:45.736436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:45.760100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add1d1f-6764-4af1-b86c-c275ad4a6dda None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:45.827238 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971311b7-5488-4975-bf91-a240b237e33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:45.828338 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971311b7-5488-4975-bf91-a240b237e33b None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:45.828838 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971311b7-5488-4975-bf91-a240b237e33b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:45.829309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971311b7-5488-4975-bf91-a240b237e33b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:45.859096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971311b7-5488-4975-bf91-a240b237e33b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:45.861706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971311b7-5488-4975-bf91-a240b237e33b None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-971311b7-5488-4975-bf91-a240b237e33b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:45.888828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:45.890390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:45.891965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:45.891965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:45.891965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:45.891965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 362/726] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:45.897732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971311b7-5488-4975-bf91-a240b237e33b None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:45.949810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20503ce-b811-4911-ab9c-9fddc83bc29b None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:46.011165 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971311b7-5488-4975-bf91-a240b237e33b None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:46.024206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:46.041883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff781e-6034-4635-a0dd-dc88dd15306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:46.042525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff781e-6034-4635-a0dd-dc88dd15306c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:46.042815 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff781e-6034-4635-a0dd-dc88dd15306c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:46.043060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff781e-6034-4635-a0dd-dc88dd15306c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:46.047675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f765841-0d80-4959-b6b8-b25508c71092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:46.048349 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f765841-0d80-4959-b6b8-b25508c71092 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:46.048637 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f765841-0d80-4959-b6b8-b25508c71092 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:46.048916 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f765841-0d80-4959-b6b8-b25508c71092 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:46.049565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f765841-0d80-4959-b6b8-b25508c71092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:46.049876 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f765841-0d80-4959-b6b8-b25508c71092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:46.051245 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f765841-0d80-4959-b6b8-b25508c71092 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:46.060636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:46.062811 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff781e-6034-4635-a0dd-dc88dd15306c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:46.064997 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 363/727] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:46.070463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f765841-0d80-4959-b6b8-b25508c71092 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-b4ff781e-6034-4635-a0dd-dc88dd15306c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:46.074358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:46.075316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:46.076198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:46.076198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:46.076198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:46.076198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:46.076198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:46.076198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:46.076198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:46.076198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:46.076198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:46.076198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:46.076198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:46.076198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:46.078788 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 365/728] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:45:46.085106 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff781e-6034-4635-a0dd-dc88dd15306c None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:46.249692 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f765841-0d80-4959-b6b8-b25508c71092 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:46.290752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff781e-6034-4635-a0dd-dc88dd15306c None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:46.325744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd03b1d-9adf-41ae-8564-e7ea1da0b1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:46.326390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd03b1d-9adf-41ae-8564-e7ea1da0b1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:46.326678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd03b1d-9adf-41ae-8564-e7ea1da0b1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:46.326956 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd03b1d-9adf-41ae-8564-e7ea1da0b1f2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:46.338181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd03b1d-9adf-41ae-8564-e7ea1da0b1f2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:46.340342 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd03b1d-9adf-41ae-8564-e7ea1da0b1f2 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-7cd03b1d-9adf-41ae-8564-e7ea1da0b1f2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:46.358194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:46.359203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:46.360186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:46.360186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:46.360186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:46.360186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:46.360186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:46.360186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:46.360186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:46.360186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:46.360186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:45:46.360186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:46.360186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 364/729] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:45:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:46.366301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511825c3-9030-4449-ab45-2fa58b4c8925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:46.366928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511825c3-9030-4449-ab45-2fa58b4c8925 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:46.367210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511825c3-9030-4449-ab45-2fa58b4c8925 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:46.367479 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511825c3-9030-4449-ab45-2fa58b4c8925 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:46.368169 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511825c3-9030-4449-ab45-2fa58b4c8925 None admin] RBAC: Adding query filter params (name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:46.368483 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511825c3-9030-4449-ab45-2fa58b4c8925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:46.368875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd03b1d-9adf-41ae-8564-e7ea1da0b1f2 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:46.369845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511825c3-9030-4449-ab45-2fa58b4c8925 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:46.402300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 366/730] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:46.404835 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511825c3-9030-4449-ab45-2fa58b4c8925 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:46.491973 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd03b1d-9adf-41ae-8564-e7ea1da0b1f2 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:46.500323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:46.529910 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900453d7-862a-4eae-a722-d8fd3e3225b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:46.530946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900453d7-862a-4eae-a722-d8fd3e3225b5 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:46.531488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900453d7-862a-4eae-a722-d8fd3e3225b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:46.531975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900453d7-862a-4eae-a722-d8fd3e3225b5 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:46.533612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900453d7-862a-4eae-a722-d8fd3e3225b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:46.534135 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900453d7-862a-4eae-a722-d8fd3e3225b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:46.536048 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900453d7-862a-4eae-a722-d8fd3e3225b5 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:46.576448 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 365/731] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Sep 1 13:45:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:46.578827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:46.595085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900453d7-862a-4eae-a722-d8fd3e3225b5 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:46.665170 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511825c3-9030-4449-ab45-2fa58b4c8925 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:46.702132 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a651e-ce40-4dbd-915e-6ce208b0f739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:46.702770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a651e-ce40-4dbd-915e-6ce208b0f739 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:46.703050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a651e-ce40-4dbd-915e-6ce208b0f739 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:46.703323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a651e-ce40-4dbd-915e-6ce208b0f739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:46.714376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a651e-ce40-4dbd-915e-6ce208b0f739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:46.715813 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a651e-ce40-4dbd-915e-6ce208b0f739 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-588a651e-ce40-4dbd-915e-6ce208b0f739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:46.736353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:46.737503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:46.738827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:46.738827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:46.738827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:46.738999 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900453d7-862a-4eae-a722-d8fd3e3225b5 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:46.739082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 367/732] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:46.739082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583dea2-7834-4b18-811b-75454f91d567 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:46.739520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583dea2-7834-4b18-811b-75454f91d567 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:46.739618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583dea2-7834-4b18-811b-75454f91d567 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:46.743949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 368/733] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:46.744767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583dea2-7834-4b18-811b-75454f91d567 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:46.766835 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:46.786185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb7d68-2331-4939-ae36-3d8eaf8cfc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:46.786801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb7d68-2331-4939-ae36-3d8eaf8cfc49 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:46.787088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb7d68-2331-4939-ae36-3d8eaf8cfc49 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:46.787368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb7d68-2331-4939-ae36-3d8eaf8cfc49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:46.855591 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb7d68-2331-4939-ae36-3d8eaf8cfc49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:46.856988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb7d68-2331-4939-ae36-3d8eaf8cfc49 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:46.859216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583dea2-7834-4b18-811b-75454f91d567 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:46.862775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:46.894622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7036340-ec40-489a-be9d-add4763a6c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:46.895224 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7036340-ec40-489a-be9d-add4763a6c46 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:46.895500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7036340-ec40-489a-be9d-add4763a6c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:46.895772 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7036340-ec40-489a-be9d-add4763a6c46 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:46.896434 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7036340-ec40-489a-be9d-add4763a6c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:46.896732 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7036340-ec40-489a-be9d-add4763a6c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:46.898096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7036340-ec40-489a-be9d-add4763a6c46 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:46.909235 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 369/734] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:46.910654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfae249-ee00-4f92-ac41-a983f5d15804 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:46.911086 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfae249-ee00-4f92-ac41-a983f5d15804 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:46.911513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfae249-ee00-4f92-ac41-a983f5d15804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:46.929438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6dfae249-ee00-4f92-ac41-a983f5d15804 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:46.930618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6dfae249-ee00-4f92-ac41-a983f5d15804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:46.957141 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 366/735] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 13:45:46.958447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c02f72-9721-4fcf-af27-0953f61df801 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:46.958745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c02f72-9721-4fcf-af27-0953f61df801 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:46.959015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c02f72-9721-4fcf-af27-0953f61df801 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:46.960421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 367/736] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:46.961334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7811a-997a-4e7a-a614-5f2c62ad127e None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:46.961608 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7811a-997a-4e7a-a614-5f2c62ad127e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:46.961885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7811a-997a-4e7a-a614-5f2c62ad127e None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:46.968179 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 368/737] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:46.968179 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7811a-997a-4e7a-a614-5f2c62ad127e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:46.986598 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:47.000188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 370/738] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:47.000943 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfae249-ee00-4f92-ac41-a983f5d15804 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:47.073537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7811a-997a-4e7a-a614-5f2c62ad127e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:47.113005 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:47.119781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3786bf7-f7bf-44e0-83d3-dd81783b062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:47.120451 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3786bf7-f7bf-44e0-83d3-dd81783b062a None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:47.120716 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfae249-ee00-4f92-ac41-a983f5d15804 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:47.120814 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3786bf7-f7bf-44e0-83d3-dd81783b062a None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:47.124639 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3786bf7-f7bf-44e0-83d3-dd81783b062a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:47.130081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3786bf7-f7bf-44e0-83d3-dd81783b062a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:47.131495 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3786bf7-f7bf-44e0-83d3-dd81783b062a None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-e3786bf7-f7bf-44e0-83d3-dd81783b062a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:47.144469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:47.145435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:47.146367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:47.146367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:47.146367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:47.146367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:47.146367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:47.146367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:47.146367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:47.146367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:47.146367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:45:47.146367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:47.146367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 369/739] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 13:45:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:47.146963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec5600-996d-4233-8dc6-5725a7ec3264 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:47.147031 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec5600-996d-4233-8dc6-5725a7ec3264 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:47.147622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec5600-996d-4233-8dc6-5725a7ec3264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:47.164523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf4cf5-44f2-4954-9c6f-6940d7bfe731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:47.165167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf4cf5-44f2-4954-9c6f-6940d7bfe731 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:47.168261 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf4cf5-44f2-4954-9c6f-6940d7bfe731 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:47.168261 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf4cf5-44f2-4954-9c6f-6940d7bfe731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:47.168454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-89ec5600-996d-4233-8dc6-5725a7ec3264 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:47.168855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-89ec5600-996d-4233-8dc6-5725a7ec3264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:47.179497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf4cf5-44f2-4954-9c6f-6940d7bfe731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:47.181140 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf4cf5-44f2-4954-9c6f-6940d7bfe731 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-d7cf4cf5-44f2-4954-9c6f-6940d7bfe731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:47.196861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:47.197820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:47.198733 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:47.198733 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:47.198733 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:47.198733 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 371/740] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:47.199265 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21abd1-8294-49c0-9259-7b310d4a3729 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:47.199672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21abd1-8294-49c0-9259-7b310d4a3729 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:47.199672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21abd1-8294-49c0-9259-7b310d4a3729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:47.220126 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-fc21abd1-8294-49c0-9259-7b310d4a3729 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:47.221654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-fc21abd1-8294-49c0-9259-7b310d4a3729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:47.245036 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 370/741] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:47.246242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec5600-996d-4233-8dc6-5725a7ec3264 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:47.266418 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:47.302659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 372/742] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 13:45:47.303501 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21abd1-8294-49c0-9259-7b310d4a3729 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:47.402835 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:47.405236 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec5600-996d-4233-8dc6-5725a7ec3264 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:47.436000 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21abd1-8294-49c0-9259-7b310d4a3729 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:47.442821 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d5633-b064-45d1-bff9-10518197a4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:47.443570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d5633-b064-45d1-bff9-10518197a4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:47.443985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d5633-b064-45d1-bff9-10518197a4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:47.444388 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d5633-b064-45d1-bff9-10518197a4a7 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:47.445355 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d5633-b064-45d1-bff9-10518197a4a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:47.445767 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d5633-b064-45d1-bff9-10518197a4a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:47.447506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d5633-b064-45d1-bff9-10518197a4a7 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:47.469655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 371/743] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Sep 1 13:45:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:47.471280 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d5633-b064-45d1-bff9-10518197a4a7 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:47.483498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfca225-41fb-484f-aaa4-48c96e699f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:47.484341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfca225-41fb-484f-aaa4-48c96e699f87 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:47.484950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfca225-41fb-484f-aaa4-48c96e699f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:47.485127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfca225-41fb-484f-aaa4-48c96e699f87 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:47.485905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfca225-41fb-484f-aaa4-48c96e699f87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:47.486353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfca225-41fb-484f-aaa4-48c96e699f87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:47.487825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfca225-41fb-484f-aaa4-48c96e699f87 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:47.504144 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 373/744] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:47.505157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfca225-41fb-484f-aaa4-48c96e699f87 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:47.554389 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:47.589348 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d5633-b064-45d1-bff9-10518197a4a7 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:47.612803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfca225-41fb-484f-aaa4-48c96e699f87 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:47.623992 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bffe57-6231-473f-933d-26c037b37f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:47.624617 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bffe57-6231-473f-933d-26c037b37f2c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:47.624898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bffe57-6231-473f-933d-26c037b37f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:47.625178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bffe57-6231-473f-933d-26c037b37f2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:47.635420 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bffe57-6231-473f-933d-26c037b37f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-64bffe57-6231-473f-933d-26c037b37f2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:47.640316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:47.641447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:47.642977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:47.642977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:47.642977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:47.642977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:47.642977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:47.642977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:47.642977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:47.642977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:47.642977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:47.642977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:47.642977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:47.642977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:47.646354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b76ac4-cd68-45e1-9168-40dfd3bc3b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:47.646868 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 372/745] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:45:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:47.646978 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b76ac4-cd68-45e1-9168-40dfd3bc3b65 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:47.647223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b76ac4-cd68-45e1-9168-40dfd3bc3b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:47.647491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b76ac4-cd68-45e1-9168-40dfd3bc3b65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:47.647651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bffe57-6231-473f-933d-26c037b37f2c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:47.651116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:47.716326 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b76ac4-cd68-45e1-9168-40dfd3bc3b65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:47.717692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b76ac4-cd68-45e1-9168-40dfd3bc3b65 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:47.751074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bffe57-6231-473f-933d-26c037b37f2c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:47.777152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:47.785688 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91ec1f-d719-4c44-a3bf-09b8a9a90c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:47.786314 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91ec1f-d719-4c44-a3bf-09b8a9a90c0f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:47.786598 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91ec1f-d719-4c44-a3bf-09b8a9a90c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:47.786872 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91ec1f-d719-4c44-a3bf-09b8a9a90c0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:47.793693 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91ec1f-d719-4c44-a3bf-09b8a9a90c0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:47.795142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91ec1f-d719-4c44-a3bf-09b8a9a90c0f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:47.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-db91ec1f-d719-4c44-a3bf-09b8a9a90c0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:47.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:47.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:47.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:47.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:47.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:47.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:47.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:47.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:47.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:47.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:47.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:47.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:47.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:47.807712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:47.808676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:47.809563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:47.809563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:47.809563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:47.809563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:47.809563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:47.809563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:47.809563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:47.809563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:47.809563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 373/746] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:47.809563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91ec1f-d719-4c44-a3bf-09b8a9a90c0f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:47.820979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 374/747] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 13:45:47.821796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b76ac4-cd68-45e1-9168-40dfd3bc3b65 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:47.855555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:47.914634 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91ec1f-d719-4c44-a3bf-09b8a9a90c0f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:47.920113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b76ac4-cd68-45e1-9168-40dfd3bc3b65 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:47.949307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c767f-7d46-4666-8a99-fa0750c11934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:47.949915 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c767f-7d46-4666-8a99-fa0750c11934 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:47.950195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c767f-7d46-4666-8a99-fa0750c11934 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:47.950473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c767f-7d46-4666-8a99-fa0750c11934 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:47.951129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c767f-7d46-4666-8a99-fa0750c11934 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:47.952533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c767f-7d46-4666-8a99-fa0750c11934 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:47.954531 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee2b41-3f10-4f1a-bfdf-04e0a42505b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:47.955136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee2b41-3f10-4f1a-bfdf-04e0a42505b7 None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:47.955420 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee2b41-3f10-4f1a-bfdf-04e0a42505b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:47.955693 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee2b41-3f10-4f1a-bfdf-04e0a42505b7 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:47.956368 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee2b41-3f10-4f1a-bfdf-04e0a42505b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:47.957731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee2b41-3f10-4f1a-bfdf-04e0a42505b7 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:48.066222 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 374/748] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 13:45:47 2022] POST /identity/v3/services => generated 240 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:45:48.067075 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c767f-7d46-4666-8a99-fa0750c11934 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:48.092611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 375/749] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 13:45:47 2022] POST /identity/v3/services => generated 251 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:45:48.093323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee2b41-3f10-4f1a-bfdf-04e0a42505b7 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:48.136998 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:48.227038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:48.241634 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c767f-7d46-4666-8a99-fa0750c11934 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:48.245020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee2b41-3f10-4f1a-bfdf-04e0a42505b7 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:48.290101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35808693-b9c4-438b-beee-fa8330fd319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:48.291009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35808693-b9c4-438b-beee-fa8330fd319b None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:48.291422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35808693-b9c4-438b-beee-fa8330fd319b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:48.291824 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35808693-b9c4-438b-beee-fa8330fd319b None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:48.292757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35808693-b9c4-438b-beee-fa8330fd319b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:48.293224 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35808693-b9c4-438b-beee-fa8330fd319b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:48.294630 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35808693-b9c4-438b-beee-fa8330fd319b None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:48.304554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 375/750] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:48.305410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35808693-b9c4-438b-beee-fa8330fd319b None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:48.309215 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b506c-056c-4af5-a35b-d4e388bd9b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:48.309862 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b506c-056c-4af5-a35b-d4e388bd9b22 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:48.310149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b506c-056c-4af5-a35b-d4e388bd9b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:48.310429 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b506c-056c-4af5-a35b-d4e388bd9b22 None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:48.311197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b506c-056c-4af5-a35b-d4e388bd9b22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:48.311511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b506c-056c-4af5-a35b-d4e388bd9b22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:48.312985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b506c-056c-4af5-a35b-d4e388bd9b22 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:48.331549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 376/751] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:48.335971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b506c-056c-4af5-a35b-d4e388bd9b22 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:48.428531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35808693-b9c4-438b-beee-fa8330fd319b None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:48.431275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:48.468846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76a85c-3ee5-4ad1-8931-a89d4263002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:48.469861 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76a85c-3ee5-4ad1-8931-a89d4263002f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:48.470941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76a85c-3ee5-4ad1-8931-a89d4263002f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:48.471418 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76a85c-3ee5-4ad1-8931-a89d4263002f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:48.471840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b506c-056c-4af5-a35b-d4e388bd9b22 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:48.483290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76a85c-3ee5-4ad1-8931-a89d4263002f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:48.485139 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76a85c-3ee5-4ad1-8931-a89d4263002f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-9d76a85c-3ee5-4ad1-8931-a89d4263002f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:48.500436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:48.501458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:48.502370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:48.502370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:48.502370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:48.504534 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 376/752] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:48.505547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76a85c-3ee5-4ad1-8931-a89d4263002f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:48.510236 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0a9e0-1b26-4927-80b7-fffccf165d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:48.510393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0a9e0-1b26-4927-80b7-fffccf165d40 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:48.510623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0a9e0-1b26-4927-80b7-fffccf165d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:48.510915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0a9e0-1b26-4927-80b7-fffccf165d40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:48.522984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0a9e0-1b26-4927-80b7-fffccf165d40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:48.524541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0a9e0-1b26-4927-80b7-fffccf165d40 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-dbb0a9e0-1b26-4927-80b7-fffccf165d40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:48.540373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:48.541401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:48.542299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:48.542299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:48.542299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:48.542299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 377/753] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:48.542977 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0a9e0-1b26-4927-80b7-fffccf165d40 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:48.546346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:48.619087 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76a85c-3ee5-4ad1-8931-a89d4263002f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:48.655029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052c6b-3069-493f-9028-51b39cb0ae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:48.656037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052c6b-3069-493f-9028-51b39cb0ae42 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:48.656557 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052c6b-3069-493f-9028-51b39cb0ae42 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:48.657033 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052c6b-3069-493f-9028-51b39cb0ae42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:48.658001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8052c6b-3069-493f-9028-51b39cb0ae42 None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=cdebe1b674cc4b2bb6bf962de01a24ac) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:48.658533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8052c6b-3069-493f-9028-51b39cb0ae42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:48.660510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8052c6b-3069-493f-9028-51b39cb0ae42 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:48.664689 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0a9e0-1b26-4927-80b7-fffccf165d40 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:48.676056 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 377/754] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:45:48 2022] GET /identity/v3/role_assignments?user.id=cdebe1b674cc4b2bb6bf962de01a24ac&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:48.677366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052c6b-3069-493f-9028-51b39cb0ae42 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:48.730141 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9b530-42cc-43c1-becb-fa404a7df5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:48.730798 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9b530-42cc-43c1-becb-fa404a7df5df None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:48.731058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9b530-42cc-43c1-becb-fa404a7df5df None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:48.731332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9b530-42cc-43c1-becb-fa404a7df5df None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:48.732021 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9b530-42cc-43c1-becb-fa404a7df5df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:48.732262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:48.732364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9b530-42cc-43c1-becb-fa404a7df5df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:48.733725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9b530-42cc-43c1-becb-fa404a7df5df None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:48.768618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 378/755] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:48.769582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9b530-42cc-43c1-becb-fa404a7df5df None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:48.873503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:48.909249 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052c6b-3069-493f-9028-51b39cb0ae42 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:48.915483 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9b530-42cc-43c1-becb-fa404a7df5df None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:48.979318 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2c895-5549-4d08-af7f-01cf4d93e7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:48.979983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2c895-5549-4d08-af7f-01cf4d93e7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:48.980361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2c895-5549-4d08-af7f-01cf4d93e7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:48.980651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2c895-5549-4d08-af7f-01cf4d93e7e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:48.984549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc27a42-252f-4e26-a821-aae129894b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:48.986347 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc27a42-252f-4e26-a821-aae129894b89 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:48.986832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc27a42-252f-4e26-a821-aae129894b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:48.987329 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc27a42-252f-4e26-a821-aae129894b89 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:48.988214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc27a42-252f-4e26-a821-aae129894b89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:48.988338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2c895-5549-4d08-af7f-01cf4d93e7e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:48.988841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc27a42-252f-4e26-a821-aae129894b89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:48.989723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2c895-5549-4d08-af7f-01cf4d93e7e5 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:48.990602 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc27a42-252f-4e26-a821-aae129894b89 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:49.002727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-e8d2c895-5549-4d08-af7f-01cf4d93e7e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:49.002727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:49.002727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:49.002727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:49.002727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:49.002727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:49.002727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:49.002727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:49.002727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:49.002727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:49.002727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:49.002727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:49.002727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:49.002727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:49.002727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:49.003764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:49.004714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:49.004714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:49.004714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:49.004714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:49.004714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:49.004714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:49.004714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:49.004714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:49.004714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 379/756] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:49.009794 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2c895-5549-4d08-af7f-01cf4d93e7e5 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:49.017346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 378/757] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:49.022913 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc27a42-252f-4e26-a821-aae129894b89 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:49.121183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:49.149671 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc27a42-252f-4e26-a821-aae129894b89 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:49.191891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa093566-bb9d-43a4-b5be-a59e07e58dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:49.191891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa093566-bb9d-43a4-b5be-a59e07e58dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:49.191891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa093566-bb9d-43a4-b5be-a59e07e58dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:49.191891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa093566-bb9d-43a4-b5be-a59e07e58dc0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:49.197043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa093566-bb9d-43a4-b5be-a59e07e58dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:49.198498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa093566-bb9d-43a4-b5be-a59e07e58dc0 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-aa093566-bb9d-43a4-b5be-a59e07e58dc0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:49.210658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:49.211658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:49.212740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:49.212740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:49.212740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:49.212740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:49.212740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:49.212740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:49.212740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:49.212740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:49.212740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:45:49.212740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:49.212740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 379/758] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 13:45:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:49.213663 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2c895-5549-4d08-af7f-01cf4d93e7e5 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:49.219390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa093566-bb9d-43a4-b5be-a59e07e58dc0 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:49.244377 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:49.257085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fbc93-1730-442f-8806-6fab1b29846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:49.258200 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fbc93-1730-442f-8806-6fab1b29846a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:49.258648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fbc93-1730-442f-8806-6fab1b29846a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:49.259065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fbc93-1730-442f-8806-6fab1b29846a None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:49.259952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fbc93-1730-442f-8806-6fab1b29846a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:49.260421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fbc93-1730-442f-8806-6fab1b29846a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:49.262058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fbc93-1730-442f-8806-6fab1b29846a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:49.290057 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 380/759] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:49.295971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fbc93-1730-442f-8806-6fab1b29846a None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:49.336178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa093566-bb9d-43a4-b5be-a59e07e58dc0 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:49.408841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fbc93-1730-442f-8806-6fab1b29846a None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:49.419456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c553f8-ee96-4b75-8231-cf1eb20c585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:49.420149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c553f8-ee96-4b75-8231-cf1eb20c585e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:49.420403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c553f8-ee96-4b75-8231-cf1eb20c585e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:49.420677 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c553f8-ee96-4b75-8231-cf1eb20c585e None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:49.421421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c553f8-ee96-4b75-8231-cf1eb20c585e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:49.421730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c553f8-ee96-4b75-8231-cf1eb20c585e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:49.423250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c553f8-ee96-4b75-8231-cf1eb20c585e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:49.447366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da1780-d2d7-4c4a-8df9-a4ab989f5f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:49.448273 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da1780-d2d7-4c4a-8df9-a4ab989f5f9e None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:49.448701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da1780-d2d7-4c4a-8df9-a4ab989f5f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:49.449117 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da1780-d2d7-4c4a-8df9-a4ab989f5f9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:49.449987 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da1780-d2d7-4c4a-8df9-a4ab989f5f9e None admin] RBAC: Adding query filter params (role.id=530c8dc4a70b4cb48bc4036a57ffa71b, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=98320a8730d245f6b7fa014273604ed5) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:49.450459 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da1780-d2d7-4c4a-8df9-a4ab989f5f9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:49.452060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da1780-d2d7-4c4a-8df9-a4ab989f5f9e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:49.453961 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:49.458939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 381/760] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:45:49 2022] GET /identity/v3/role_assignments?user.id=98320a8730d245f6b7fa014273604ed5&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=530c8dc4a70b4cb48bc4036a57ffa71b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:49.474313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 380/761] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 13:45:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:49.479795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da1780-d2d7-4c4a-8df9-a4ab989f5f9e None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:49.560309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:49.606921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da1780-d2d7-4c4a-8df9-a4ab989f5f9e None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:49.644207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee3a32-1d61-41bb-8b5e-20570531ade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:49.644996 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee3a32-1d61-41bb-8b5e-20570531ade6 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:49.645283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee3a32-1d61-41bb-8b5e-20570531ade6 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:49.645555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee3a32-1d61-41bb-8b5e-20570531ade6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:49.657042 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee3a32-1d61-41bb-8b5e-20570531ade6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:49.659129 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee3a32-1d61-41bb-8b5e-20570531ade6 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-5cee3a32-1d61-41bb-8b5e-20570531ade6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:49.674550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:49.675549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:49.677050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:49.677050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:49.677050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:49.677050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 382/762] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:49.681352 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c553f8-ee96-4b75-8231-cf1eb20c585e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:49.814466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c553f8-ee96-4b75-8231-cf1eb20c585e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:49.863685 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd582b1-66a5-4867-b1fc-fcae215cd1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:49.864717 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd582b1-66a5-4867-b1fc-fcae215cd1af None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:49.865242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd582b1-66a5-4867-b1fc-fcae215cd1af None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:49.865734 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd582b1-66a5-4867-b1fc-fcae215cd1af None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:49.866633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd582b1-66a5-4867-b1fc-fcae215cd1af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:49.867140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd582b1-66a5-4867-b1fc-fcae215cd1af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:49.868774 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd582b1-66a5-4867-b1fc-fcae215cd1af None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:49.881851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 381/763] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:49.890128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee3a32-1d61-41bb-8b5e-20570531ade6 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:50.013217 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee3a32-1d61-41bb-8b5e-20570531ade6 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:50.014804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:50.049531 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c988a-d5ee-4055-96c0-ca3906bcec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:50.050174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c988a-d5ee-4055-96c0-ca3906bcec53 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:50.050457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c988a-d5ee-4055-96c0-ca3906bcec53 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:50.050729 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c988a-d5ee-4055-96c0-ca3906bcec53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:50.057779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c988a-d5ee-4055-96c0-ca3906bcec53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:50.059242 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c988a-d5ee-4055-96c0-ca3906bcec53 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:50.071254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-f95c988a-d5ee-4055-96c0-ca3906bcec53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:50.071254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:50.071254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:50.071254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:50.071254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:50.071254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:50.071254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:50.071254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:50.071254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:50.071254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:50.071254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:50.071254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:50.071254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:50.071254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:50.071254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:50.072218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:50.073397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:50.073397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:50.073397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:50.073397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:50.073397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:50.073397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:50.073397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:50.073397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:50.073397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 383/764] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:50.078382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd582b1-66a5-4867-b1fc-fcae215cd1af None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:50.185036 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:50.248466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd582b1-66a5-4867-b1fc-fcae215cd1af None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:50.291466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c877f25-5130-4596-a5fd-068d4c5059a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:50.292342 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c877f25-5130-4596-a5fd-068d4c5059a6 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:50.292776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c877f25-5130-4596-a5fd-068d4c5059a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:50.293201 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c877f25-5130-4596-a5fd-068d4c5059a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:50.294061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c877f25-5130-4596-a5fd-068d4c5059a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:50.294611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c877f25-5130-4596-a5fd-068d4c5059a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:50.296224 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c877f25-5130-4596-a5fd-068d4c5059a6 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:50.309928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 382/765] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:50.316090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c988a-d5ee-4055-96c0-ca3906bcec53 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:50.448859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ce3c3-ab68-442b-939d-3166d5d5b7e7 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:50.449528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ce3c3-ab68-442b-939d-3166d5d5b7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:50.450012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ce3c3-ab68-442b-939d-3166d5d5b7e7 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:50.451809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 383/766] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:45:50.463393 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4a338-8b38-4506-8053-083b8ccebaaa None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:50.463696 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4a338-8b38-4506-8053-083b8ccebaaa None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:50.463798 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c988a-d5ee-4055-96c0-ca3906bcec53 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:50.464008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4a338-8b38-4506-8053-083b8ccebaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:50.482547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-95a4a338-8b38-4506-8053-083b8ccebaaa None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:50.483736 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-95a4a338-8b38-4506-8053-083b8ccebaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:50.505838 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83367cba-d435-4aad-bd84-a6063048f03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:50.506880 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83367cba-d435-4aad-bd84-a6063048f03c None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:50.507618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83367cba-d435-4aad-bd84-a6063048f03c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:50.508151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83367cba-d435-4aad-bd84-a6063048f03c None admin] PATH_INFO: `/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/4b3c8a90b97246a98612b627b5f8da80/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:50.510708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83367cba-d435-4aad-bd84-a6063048f03c None admin] RBAC: Authorizing `identity:create_grant(project_id=5e7998cc03064a0bb9a9dc6a1475d73c, user_id=4b3c8a90b97246a98612b627b5f8da80, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:50.512593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83367cba-d435-4aad-bd84-a6063048f03c None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:50.560020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 384/767] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:45:50.560020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef208c73-c61f-4eed-be08-db0b534b703d None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:50.560020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef208c73-c61f-4eed-be08-db0b534b703d None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:50.560020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef208c73-c61f-4eed-be08-db0b534b703d None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:50.560478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 385/768] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:50.566630 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37672d3c-c153-4464-83fa-588ac3625826 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:50.566943 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37672d3c-c153-4464-83fa-588ac3625826 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:50.567238 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37672d3c-c153-4464-83fa-588ac3625826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:50.581457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 384/769] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:45:50 2022] PUT /identity/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/4b3c8a90b97246a98612b627b5f8da80/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:45:50.594842 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-37672d3c-c153-4464-83fa-588ac3625826 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:50.602302 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-37672d3c-c153-4464-83fa-588ac3625826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:50.661565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:50.697795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 386/770] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:45:50.960971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83367cba-d435-4aad-bd84-a6063048f03c None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:50.989236 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:51.033200 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37672d3c-c153-4464-83fa-588ac3625826 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:51.083569 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83367cba-d435-4aad-bd84-a6063048f03c None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:51.118269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cd7be-2d7f-439d-862a-a92567cf8e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:51.118908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cd7be-2d7f-439d-862a-a92567cf8e44 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:51.119190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cd7be-2d7f-439d-862a-a92567cf8e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:51.119465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cd7be-2d7f-439d-862a-a92567cf8e44 None admin] PATH_INFO: `/v3/services/network` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:51.120085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cd7be-2d7f-439d-862a-a92567cf8e44 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:51.121456 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cd7be-2d7f-439d-862a-a92567cf8e44 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-842cd7be-2d7f-439d-862a-a92567cf8e44 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:51.131949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:51.133940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:51.135009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:51.135009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:51.135009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:51.135009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:51.135009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:51.135009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:51.135009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:51.135009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:51.135009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:51.135009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:51.135009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:45:51.135009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:45:51.135009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:45:51.135009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:51.135009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 385/771] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:50 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:51.136218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6f8fe-b69f-4dbd-af04-37b4bd73de02 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:51.142485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6f8fe-b69f-4dbd-af04-37b4bd73de02 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:51.142813 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6f8fe-b69f-4dbd-af04-37b4bd73de02 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:51.144603 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 386/772] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:51.145374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6f8fe-b69f-4dbd-af04-37b4bd73de02 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:51.150221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37672d3c-c153-4464-83fa-588ac3625826 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:51.189129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc77b06-3653-4f4d-bdda-c4978ea9be4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:51.189885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc77b06-3653-4f4d-bdda-c4978ea9be4c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:51.190235 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc77b06-3653-4f4d-bdda-c4978ea9be4c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:51.190517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc77b06-3653-4f4d-bdda-c4978ea9be4c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:51.191110 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc77b06-3653-4f4d-bdda-c4978ea9be4c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:51.192615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc77b06-3653-4f4d-bdda-c4978ea9be4c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-edc77b06-3653-4f4d-bdda-c4978ea9be4c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:51.202353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:51.205231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:51.207226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:51.207226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:51.207226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:51.207226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:51.207226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:51.207226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:51.207226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:51.207226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:51.207226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:51.207226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:51.207226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:45:51.207226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:45:51.207226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:45:51.207226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:51.211969 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 387/773] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Sep 1 13:45:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:51.211969 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba123c34-e23e-4d71-8beb-55586932e0ce None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:51.211969 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba123c34-e23e-4d71-8beb-55586932e0ce None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:51.211969 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba123c34-e23e-4d71-8beb-55586932e0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:51.230920 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-ba123c34-e23e-4d71-8beb-55586932e0ce None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:51.232263 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ba123c34-e23e-4d71-8beb-55586932e0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:51.238665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:51.256672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6f8fe-b69f-4dbd-af04-37b4bd73de02 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:51.275323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:51.304554 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d5ab7-515c-4dce-9e04-d17ea49d4d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:51.305483 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d5ab7-515c-4dce-9e04-d17ea49d4d47 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:51.305778 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d5ab7-515c-4dce-9e04-d17ea49d4d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:51.306328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d5ab7-515c-4dce-9e04-d17ea49d4d47 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:51.306972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d5ab7-515c-4dce-9e04-d17ea49d4d47 None admin] RBAC: Adding query filter params (name=network) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:51.307280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d5ab7-515c-4dce-9e04-d17ea49d4d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:51.308999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d5ab7-515c-4dce-9e04-d17ea49d4d47 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:51.310045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 388/774] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:45:51.310952 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba123c34-e23e-4d71-8beb-55586932e0ce None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:51.315938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 387/775] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 13:45:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:51.320136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d5ab7-515c-4dce-9e04-d17ea49d4d47 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:51.455732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba123c34-e23e-4d71-8beb-55586932e0ce None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:51.497084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165966a-66d6-4b80-b563-e0411dc9ea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:51.497626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165966a-66d6-4b80-b563-e0411dc9ea00 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:51.497901 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165966a-66d6-4b80-b563-e0411dc9ea00 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:51.498169 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165966a-66d6-4b80-b563-e0411dc9ea00 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:51.498795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165966a-66d6-4b80-b563-e0411dc9ea00 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:51.499096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165966a-66d6-4b80-b563-e0411dc9ea00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:51.500479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165966a-66d6-4b80-b563-e0411dc9ea00 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:51.514489 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 389/776] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Sep 1 13:45:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:51.522897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165966a-66d6-4b80-b563-e0411dc9ea00 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:51.562135 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:51.583671 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d5ab7-515c-4dce-9e04-d17ea49d4d47 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:51.639567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1b72-4b39-4847-bd45-c8e015c895ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:51.640608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1b72-4b39-4847-bd45-c8e015c895ac None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:51.641114 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1b72-4b39-4847-bd45-c8e015c895ac None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:51.641589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d1b72-4b39-4847-bd45-c8e015c895ac None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:51.642979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1b72-4b39-4847-bd45-c8e015c895ac None admin] RBAC: Adding query filter params (type=network) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:51.643491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1b72-4b39-4847-bd45-c8e015c895ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:51.645300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d1b72-4b39-4847-bd45-c8e015c895ac None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:51.651107 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 388/777] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 13:45:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:45:51.652159 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1b72-4b39-4847-bd45-c8e015c895ac None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:51.656009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165966a-66d6-4b80-b563-e0411dc9ea00 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:51.673364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:51.690958 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d80f6-429d-4ed5-b951-ee1bcd3a59d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:51.691568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d80f6-429d-4ed5-b951-ee1bcd3a59d9 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:51.691846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d80f6-429d-4ed5-b951-ee1bcd3a59d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:51.692144 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d80f6-429d-4ed5-b951-ee1bcd3a59d9 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:51.692772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d80f6-429d-4ed5-b951-ee1bcd3a59d9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:51.693074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d80f6-429d-4ed5-b951-ee1bcd3a59d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:51.694491 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d80f6-429d-4ed5-b951-ee1bcd3a59d9 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:51.700110 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 390/778] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Sep 1 13:45:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:51.700930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d80f6-429d-4ed5-b951-ee1bcd3a59d9 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:51.770038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d1b72-4b39-4847-bd45-c8e015c895ac None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:51.808152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528ef2b-68ca-4505-9f57-df3acdb41e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:51.808946 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528ef2b-68ca-4505-9f57-df3acdb41e78 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:51.809230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528ef2b-68ca-4505-9f57-df3acdb41e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:51.809753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:51.809864 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528ef2b-68ca-4505-9f57-df3acdb41e78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:51.812978 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d80f6-429d-4ed5-b951-ee1bcd3a59d9 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:51.821496 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528ef2b-68ca-4505-9f57-df3acdb41e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-f528ef2b-68ca-4505-9f57-df3acdb41e78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:51.826808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:51.827728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:51.828875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:51.828875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:51.828875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:51.828875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:51.828875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:51.828875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:51.828875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:51.828875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:51.828875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:51.828875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:51.828875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:51.828875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:51.828875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 389/779] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:45:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:51.830645 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528ef2b-68ca-4505-9f57-df3acdb41e78 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:51.856112 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4d8ec-b83d-4e54-b1e1-541c610baa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:51.856808 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4d8ec-b83d-4e54-b1e1-541c610baa86 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:51.857097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4d8ec-b83d-4e54-b1e1-541c610baa86 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:51.857381 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4d8ec-b83d-4e54-b1e1-541c610baa86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:51.858073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4d8ec-b83d-4e54-b1e1-541c610baa86 None admin] RBAC: Adding query filter params (interface=public, service_id=91f2bbc7b1424e278d69780db405e6c9, region_id=RegionOne) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:51.858389 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4d8ec-b83d-4e54-b1e1-541c610baa86 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:51.859758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4d8ec-b83d-4e54-b1e1-541c610baa86 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:51.867651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 391/780] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 13:45:51 2022] GET /identity/v3/endpoints?service_id=91f2bbc7b1424e278d69780db405e6c9&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:51.868891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31180418-43fa-4643-83fa-353db273522a None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:51.869176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31180418-43fa-4643-83fa-353db273522a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:51.869454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31180418-43fa-4643-83fa-353db273522a None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:51.874715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 392/781] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:51.874715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31180418-43fa-4643-83fa-353db273522a None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:51.913369 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:51.948527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528ef2b-68ca-4505-9f57-df3acdb41e78 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:51.985197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6db6b-e3b6-4fe9-8279-181e4de4e21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:51.986364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6db6b-e3b6-4fe9-8279-181e4de4e21c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:51.986652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6db6b-e3b6-4fe9-8279-181e4de4e21c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:51.986932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6db6b-e3b6-4fe9-8279-181e4de4e21c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:51.987643 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6db6b-e3b6-4fe9-8279-181e4de4e21c None admin] RBAC: Adding query filter params (interface=public, service_id=046db985c1484dedad4d6f97e11c4676, region_id=RegionOne) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:51.987988 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6db6b-e3b6-4fe9-8279-181e4de4e21c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:51.989382 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6db6b-e3b6-4fe9-8279-181e4de4e21c None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:52.001927 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 390/782] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 13:45:51 2022] GET /identity/v3/endpoints?service_id=046db985c1484dedad4d6f97e11c4676&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:52.001927 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6db6b-e3b6-4fe9-8279-181e4de4e21c None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:52.101397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31180418-43fa-4643-83fa-353db273522a None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:52.103141 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6db6b-e3b6-4fe9-8279-181e4de4e21c None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:52.138256 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c561f-0d51-471e-95cf-4dbb2bc5a3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:52.138447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1cdfb-2a8f-434f-944d-ccaed1876f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:52.138872 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c561f-0d51-471e-95cf-4dbb2bc5a3ce None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:52.139058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1cdfb-2a8f-434f-944d-ccaed1876f50 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:52.139155 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c561f-0d51-471e-95cf-4dbb2bc5a3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:52.139321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1cdfb-2a8f-434f-944d-ccaed1876f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:52.139423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c561f-0d51-471e-95cf-4dbb2bc5a3ce None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:52.139616 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1cdfb-2a8f-434f-944d-ccaed1876f50 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:52.140035 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c561f-0d51-471e-95cf-4dbb2bc5a3ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:52.140283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1cdfb-2a8f-434f-944d-ccaed1876f50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:52.140587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1cdfb-2a8f-434f-944d-ccaed1876f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:52.141403 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c561f-0d51-471e-95cf-4dbb2bc5a3ce None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:52.141955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1cdfb-2a8f-434f-944d-ccaed1876f50 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:52.143193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:52.156491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 391/783] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 13:45:51 2022] GET /identity/v3/services => generated 772 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:52.156491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478a99e-20b1-44ea-bda9-c6e44e4602d0 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:52.156491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478a99e-20b1-44ea-bda9-c6e44e4602d0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:52.156491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478a99e-20b1-44ea-bda9-c6e44e4602d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:52.170780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 393/784] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:52.170780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1cdfb-2a8f-434f-944d-ccaed1876f50 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:52.174214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e478a99e-20b1-44ea-bda9-c6e44e4602d0 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:52.175464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e478a99e-20b1-44ea-bda9-c6e44e4602d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:52.206444 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:52.268274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 392/785] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:45:52.269429 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478a99e-20b1-44ea-bda9-c6e44e4602d0 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:52.306685 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1cdfb-2a8f-434f-944d-ccaed1876f50 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:52.359852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602f1cb-d19d-4ef9-9d48-368eee341ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:52.360916 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602f1cb-d19d-4ef9-9d48-368eee341ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:52.361206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602f1cb-d19d-4ef9-9d48-368eee341ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:52.361479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602f1cb-d19d-4ef9-9d48-368eee341ad0 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:52.362490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602f1cb-d19d-4ef9-9d48-368eee341ad0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:52.363851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602f1cb-d19d-4ef9-9d48-368eee341ad0 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:52.372029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 394/786] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 13:45:52 2022] GET /identity/v3/services => generated 772 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:52.427508 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478a99e-20b1-44ea-bda9-c6e44e4602d0 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:52.463589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:52.470695 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f59e75-9a9b-45a3-9d80-39d8598ebc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:52.471499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f59e75-9a9b-45a3-9d80-39d8598ebc2e None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:52.471781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f59e75-9a9b-45a3-9d80-39d8598ebc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:52.472082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f59e75-9a9b-45a3-9d80-39d8598ebc2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:52.488266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f59e75-9a9b-45a3-9d80-39d8598ebc2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:52.489746 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f59e75-9a9b-45a3-9d80-39d8598ebc2e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-42f59e75-9a9b-45a3-9d80-39d8598ebc2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:52.506718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:52.508059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:52.509007 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:52.509007 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:52.509007 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:52.509007 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 393/787] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:52.513832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602f1cb-d19d-4ef9-9d48-368eee341ad0 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:52.571227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f59e75-9a9b-45a3-9d80-39d8598ebc2e None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:52.643894 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:52.660423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602f1cb-d19d-4ef9-9d48-368eee341ad0 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:52.703165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f59e75-9a9b-45a3-9d80-39d8598ebc2e None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:52.703362 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7cd1b-9083-40c9-bea7-3814b6506f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:52.703888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7cd1b-9083-40c9-bea7-3814b6506f47 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:52.704213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7cd1b-9083-40c9-bea7-3814b6506f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:52.704491 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7cd1b-9083-40c9-bea7-3814b6506f47 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:52.705134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7cd1b-9083-40c9-bea7-3814b6506f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:52.705442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7cd1b-9083-40c9-bea7-3814b6506f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:52.706806 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7cd1b-9083-40c9-bea7-3814b6506f47 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:52.718730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 395/788] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:52.725009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7cd1b-9083-40c9-bea7-3814b6506f47 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:52.780587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3235ec0-40fa-4708-8059-340a003f4945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:52.781240 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3235ec0-40fa-4708-8059-340a003f4945 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:52.781523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3235ec0-40fa-4708-8059-340a003f4945 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:52.781793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3235ec0-40fa-4708-8059-340a003f4945 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:52.804799 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3235ec0-40fa-4708-8059-340a003f4945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-c3235ec0-40fa-4708-8059-340a003f4945 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:52.816148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:52.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:52.817999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:52.817999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:52.817999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:52.817999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:52.817999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:52.817999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:52.817999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:52.817999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:52.817999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:52.817999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:52.817999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:52.817999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:52.819626 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 394/789] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:45:52.826690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3235ec0-40fa-4708-8059-340a003f4945 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:52.878224 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:52.890312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7cd1b-9083-40c9-bea7-3814b6506f47 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:52.927609 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad90852-c17e-4d4c-92b9-0caeb83e3c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:52.928189 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad90852-c17e-4d4c-92b9-0caeb83e3c70 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:52.928470 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad90852-c17e-4d4c-92b9-0caeb83e3c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:52.928744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad90852-c17e-4d4c-92b9-0caeb83e3c70 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:52.936715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad90852-c17e-4d4c-92b9-0caeb83e3c70 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:52.938203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad90852-c17e-4d4c-92b9-0caeb83e3c70 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:52.939372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3235ec0-40fa-4708-8059-340a003f4945 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-5ad90852-c17e-4d4c-92b9-0caeb83e3c70 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:52.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:52.951131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:52.952114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:52.952114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:52.952114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:52.952114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:52.952114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:52.952114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:52.952114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:52.952114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:52.952114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:45:52.952114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:52.952114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 396/790] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:45:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:45:52.953205 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f56a90-ffe1-49b5-90ab-b8085415bd12 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:52.953284 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f56a90-ffe1-49b5-90ab-b8085415bd12 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:52.953512 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f56a90-ffe1-49b5-90ab-b8085415bd12 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:52.955599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 397/791] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:52.961873 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f56a90-ffe1-49b5-90ab-b8085415bd12 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:52.975680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:52.983334 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcaa0fd-bf66-454a-8e75-b9337be9e2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:52.988255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaa0fd-bf66-454a-8e75-b9337be9e2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:52.988255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaa0fd-bf66-454a-8e75-b9337be9e2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:52.988255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaa0fd-bf66-454a-8e75-b9337be9e2e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:52.988255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcaa0fd-bf66-454a-8e75-b9337be9e2e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:52.988255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcaa0fd-bf66-454a-8e75-b9337be9e2e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:52.988255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcaa0fd-bf66-454a-8e75-b9337be9e2e9 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:52.995652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 395/792] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:52.996916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569b53d-2eb7-427c-82f7-288ff29484f9 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:52.997206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569b53d-2eb7-427c-82f7-288ff29484f9 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:52.997692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569b53d-2eb7-427c-82f7-288ff29484f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:53.017758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-4569b53d-2eb7-427c-82f7-288ff29484f9 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:53.018962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4569b53d-2eb7-427c-82f7-288ff29484f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:53.083719 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f56a90-ffe1-49b5-90ab-b8085415bd12 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:53.088955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 396/793] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:45:53.096525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569b53d-2eb7-427c-82f7-288ff29484f9 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:53.128925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ab70e-2be5-4a7a-a9a3-0d18f94eed8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:53.130622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ab70e-2be5-4a7a-a9a3-0d18f94eed8e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:53.133900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ab70e-2be5-4a7a-a9a3-0d18f94eed8e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:53.134324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ab70e-2be5-4a7a-a9a3-0d18f94eed8e None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:53.135255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ab70e-2be5-4a7a-a9a3-0d18f94eed8e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:53.135728 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ab70e-2be5-4a7a-a9a3-0d18f94eed8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:53.137309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ab70e-2be5-4a7a-a9a3-0d18f94eed8e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:53.164641 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:53.176878 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 398/794] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Sep 1 13:45:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:53.183852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ab70e-2be5-4a7a-a9a3-0d18f94eed8e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:53.257044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:53.293749 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ab70e-2be5-4a7a-a9a3-0d18f94eed8e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:53.331899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cec044-4cb5-41a5-a9a4-b08604c9e114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:53.332954 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cec044-4cb5-41a5-a9a4-b08604c9e114 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:53.333409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cec044-4cb5-41a5-a9a4-b08604c9e114 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:53.333882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cec044-4cb5-41a5-a9a4-b08604c9e114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:53.345599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cec044-4cb5-41a5-a9a4-b08604c9e114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:53.347491 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cec044-4cb5-41a5-a9a4-b08604c9e114 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:53.350694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569b53d-2eb7-427c-82f7-288ff29484f9 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-20cec044-4cb5-41a5-a9a4-b08604c9e114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:53.363544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:53.364545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:53.365436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:53.365436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:53.365436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:53.367276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 399/795] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:53.373116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cec044-4cb5-41a5-a9a4-b08604c9e114 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:53.434359 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e08aef-4d44-4d57-bd13-20a76be6d1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:53.434913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e08aef-4d44-4d57-bd13-20a76be6d1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:53.435180 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e08aef-4d44-4d57-bd13-20a76be6d1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:53.435449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e08aef-4d44-4d57-bd13-20a76be6d1a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:53.448685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e08aef-4d44-4d57-bd13-20a76be6d1a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:53.450309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e08aef-4d44-4d57-bd13-20a76be6d1a6 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-f2e08aef-4d44-4d57-bd13-20a76be6d1a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:53.466353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:53.467555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:53.468552 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:53.468552 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:53.468552 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:53.470193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 397/796] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:53.471324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e08aef-4d44-4d57-bd13-20a76be6d1a6 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:53.500089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cec044-4cb5-41a5-a9a4-b08604c9e114 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:53.522614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:53.537911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36772bbc-1af5-40e4-b695-2a02962fbab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:53.538603 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36772bbc-1af5-40e4-b695-2a02962fbab9 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:53.538943 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36772bbc-1af5-40e4-b695-2a02962fbab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:53.539219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36772bbc-1af5-40e4-b695-2a02962fbab9 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:53.539853 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36772bbc-1af5-40e4-b695-2a02962fbab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:53.540182 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36772bbc-1af5-40e4-b695-2a02962fbab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:53.541654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36772bbc-1af5-40e4-b695-2a02962fbab9 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:53.559857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 400/797] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:53.559857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36772bbc-1af5-40e4-b695-2a02962fbab9 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:53.574022 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:53.590414 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e08aef-4d44-4d57-bd13-20a76be6d1a6 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:53.628199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f3340-6481-446d-b891-93f65987c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:53.629081 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f3340-6481-446d-b891-93f65987c1cb None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:53.629520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f3340-6481-446d-b891-93f65987c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:53.629930 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f3340-6481-446d-b891-93f65987c1cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:53.641040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f3340-6481-446d-b891-93f65987c1cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-504f3340-6481-446d-b891-93f65987c1cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:53.647079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:53.648205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:53.649048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:53.649048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:53.649048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:53.649048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:53.649048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:53.649048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:53.649048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:53.649048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:53.649048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:53.649048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:53.649048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:53.649048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:53.651607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 398/798] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:53.652604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f3340-6481-446d-b891-93f65987c1cb None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:53.680313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36772bbc-1af5-40e4-b695-2a02962fbab9 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:53.719122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a063c-970d-4aaf-9b1d-d73e100b33d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:53.719759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a063c-970d-4aaf-9b1d-d73e100b33d6 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:53.720751 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a063c-970d-4aaf-9b1d-d73e100b33d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:53.721094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a063c-970d-4aaf-9b1d-d73e100b33d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:53.721955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a063c-970d-4aaf-9b1d-d73e100b33d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:53.722376 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a063c-970d-4aaf-9b1d-d73e100b33d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:53.723937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a063c-970d-4aaf-9b1d-d73e100b33d6 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:53.740213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 401/799] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:53.741311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a063c-970d-4aaf-9b1d-d73e100b33d6 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:53.764249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f3340-6481-446d-b891-93f65987c1cb None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:53.789098 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:53.804439 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e03c2-480f-4060-9687-540e4110c219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:53.805383 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e03c2-480f-4060-9687-540e4110c219 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:53.809722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e03c2-480f-4060-9687-540e4110c219 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:53.809722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e03c2-480f-4060-9687-540e4110c219 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:53.813823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e03c2-480f-4060-9687-540e4110c219 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:53.815468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e03c2-480f-4060-9687-540e4110c219 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:53.827423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-e98e03c2-480f-4060-9687-540e4110c219 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:53.827423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:53.827423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:53.827423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:53.827423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:53.827423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:53.827423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:53.827423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:53.827423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:53.827423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:53.827423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:53.827423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:53.827423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:53.827423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:53.827423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:53.828485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:53.829620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:53.829620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:53.829620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:53.829620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:53.829620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:53.829620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:53.829620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:53.829620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:53.836198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 399/800] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:53.837827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e03c2-480f-4060-9687-540e4110c219 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:53.848667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:53.855915 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a063c-970d-4aaf-9b1d-d73e100b33d6 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:53.893196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1874a-f534-4736-9bd4-57ed4ad9ed62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:53.894492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1874a-f534-4736-9bd4-57ed4ad9ed62 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:53.894945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1874a-f534-4736-9bd4-57ed4ad9ed62 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:53.895371 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1874a-f534-4736-9bd4-57ed4ad9ed62 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:53.896570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1874a-f534-4736-9bd4-57ed4ad9ed62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:53.897033 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1874a-f534-4736-9bd4-57ed4ad9ed62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:53.899189 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1874a-f534-4736-9bd4-57ed4ad9ed62 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:53.915073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 402/801] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:53.915073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1874a-f534-4736-9bd4-57ed4ad9ed62 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:53.964633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e03c2-480f-4060-9687-540e4110c219 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:53.999075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f4404-aebd-4680-b2f0-57c096d71e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:54.000091 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f4404-aebd-4680-b2f0-57c096d71e5c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.000601 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f4404-aebd-4680-b2f0-57c096d71e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.001592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f4404-aebd-4680-b2f0-57c096d71e5c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.009982 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f4404-aebd-4680-b2f0-57c096d71e5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:54.011748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f4404-aebd-4680-b2f0-57c096d71e5c None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-674f4404-aebd-4680-b2f0-57c096d71e5c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:54.024167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:54.025128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:54.026070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:54.026070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:54.026070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:54.026070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:54.026070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:54.026070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:54.026070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:54.026070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:54.026070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:45:54.026070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:54.026624 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1874a-f534-4736-9bd4-57ed4ad9ed62 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:54.026911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:54.028644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 400/802] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 13:45:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:54.034139 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f4404-aebd-4680-b2f0-57c096d71e5c None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:54.063163 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcbf51-baa5-4764-9e16-fe5d394399ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:54.064655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcbf51-baa5-4764-9e16-fe5d394399ae None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.065108 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcbf51-baa5-4764-9e16-fe5d394399ae None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.065535 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcbf51-baa5-4764-9e16-fe5d394399ae None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.066377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcbf51-baa5-4764-9e16-fe5d394399ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:54.066863 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcbf51-baa5-4764-9e16-fe5d394399ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:54.068492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efcbf51-baa5-4764-9e16-fe5d394399ae None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:54.083054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 403/803] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:54.084345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcbf51-baa5-4764-9e16-fe5d394399ae None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:54.104144 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:54.140941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f4404-aebd-4680-b2f0-57c096d71e5c None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:54.186846 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da697fea-5bd4-40e7-b313-d98812784e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:54.187665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da697fea-5bd4-40e7-b313-d98812784e70 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.188075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da697fea-5bd4-40e7-b313-d98812784e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.188445 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da697fea-5bd4-40e7-b313-d98812784e70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.195107 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcbf51-baa5-4764-9e16-fe5d394399ae None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:54.199955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da697fea-5bd4-40e7-b313-d98812784e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:54.201422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da697fea-5bd4-40e7-b313-d98812784e70 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-da697fea-5bd4-40e7-b313-d98812784e70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:54.216873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:54.217887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:54.218791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:54.218791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:54.218791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:54.224509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 401/804] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:54.225392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da697fea-5bd4-40e7-b313-d98812784e70 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:54.238357 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c851b-008c-47b8-b4f7-12737399aa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:54.239358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c851b-008c-47b8-b4f7-12737399aa5c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.239953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c851b-008c-47b8-b4f7-12737399aa5c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.240435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c851b-008c-47b8-b4f7-12737399aa5c None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.241456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c851b-008c-47b8-b4f7-12737399aa5c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:54.241975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c851b-008c-47b8-b4f7-12737399aa5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:54.243657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c851b-008c-47b8-b4f7-12737399aa5c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:54.269397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 404/805] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Sep 1 13:45:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:54.270622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c851b-008c-47b8-b4f7-12737399aa5c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:54.295225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:54.332818 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da697fea-5bd4-40e7-b313-d98812784e70 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:54.351435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:54.370923 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7749c89-a033-4a42-9912-1c1c8e5ac750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:54.371584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7749c89-a033-4a42-9912-1c1c8e5ac750 None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.371889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7749c89-a033-4a42-9912-1c1c8e5ac750 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.372156 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7749c89-a033-4a42-9912-1c1c8e5ac750 None admin] PATH_INFO: `/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/cdebe1b674cc4b2bb6bf962de01a24ac/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.374129 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7749c89-a033-4a42-9912-1c1c8e5ac750 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e7998cc03064a0bb9a9dc6a1475d73c, user_id=cdebe1b674cc4b2bb6bf962de01a24ac, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:54.375543 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7749c89-a033-4a42-9912-1c1c8e5ac750 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:54.380083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c851b-008c-47b8-b4f7-12737399aa5c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:54.415054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c7221-ab93-4250-b881-587d5e7d67e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:54.415658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c7221-ab93-4250-b881-587d5e7d67e9 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.415988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c7221-ab93-4250-b881-587d5e7d67e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.416245 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c7221-ab93-4250-b881-587d5e7d67e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.416877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c7221-ab93-4250-b881-587d5e7d67e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:54.417178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c7221-ab93-4250-b881-587d5e7d67e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:54.418528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c7221-ab93-4250-b881-587d5e7d67e9 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:54.429572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 405/806] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:54.430325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c7221-ab93-4250-b881-587d5e7d67e9 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:54.494364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 402/807] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:45:54 2022] PUT /identity/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/cdebe1b674cc4b2bb6bf962de01a24ac/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:45:54.496075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97742fd2-2f75-4f80-b09d-30bf51d117d5 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.496441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97742fd2-2f75-4f80-b09d-30bf51d117d5 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.496810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97742fd2-2f75-4f80-b09d-30bf51d117d5 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.498336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 403/808] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:54.499075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97742fd2-2f75-4f80-b09d-30bf51d117d5 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:54.541519 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:54.577014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c7221-ab93-4250-b881-587d5e7d67e9 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:54.617394 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44d5f8-e6c9-4bdd-b62b-355c69f2407f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:54.618400 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d5f8-e6c9-4bdd-b62b-355c69f2407f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.618975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d5f8-e6c9-4bdd-b62b-355c69f2407f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.619492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d5f8-e6c9-4bdd-b62b-355c69f2407f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.632681 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44d5f8-e6c9-4bdd-b62b-355c69f2407f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:54.634639 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44d5f8-e6c9-4bdd-b62b-355c69f2407f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:54.641622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97742fd2-2f75-4f80-b09d-30bf51d117d5 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-7c44d5f8-e6c9-4bdd-b62b-355c69f2407f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:54.652877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:54.653938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:54.654866 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:54.654866 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:54.654866 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:54.654866 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 406/809] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:54.656286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc48cb-8fd9-427c-a28c-72581bfda4ce None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.656286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc48cb-8fd9-427c-a28c-72581bfda4ce None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.656286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc48cb-8fd9-427c-a28c-72581bfda4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.674758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-41bc48cb-8fd9-427c-a28c-72581bfda4ce None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:54.675979 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-41bc48cb-8fd9-427c-a28c-72581bfda4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:54.687814 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b56d2-4f1d-44f3-ab39-ee369cd1e35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:54.689144 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b56d2-4f1d-44f3-ab39-ee369cd1e35f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.689427 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b56d2-4f1d-44f3-ab39-ee369cd1e35f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.689702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b56d2-4f1d-44f3-ab39-ee369cd1e35f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.698518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b56d2-4f1d-44f3-ab39-ee369cd1e35f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:54.705462 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b56d2-4f1d-44f3-ab39-ee369cd1e35f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-cb0b56d2-4f1d-44f3-ab39-ee369cd1e35f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:54.720651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:54.721677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:54.722631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:54.722631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:54.722631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:54.722631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:54.722631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:54.722631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:54.722631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:54.722631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:54.722631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:45:54.722631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:54.722631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 404/810] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 13:45:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:54.723732 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf05dc-9b58-4646-b75b-140b90cef9c4 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.723732 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf05dc-9b58-4646-b75b-140b90cef9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.724040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf05dc-9b58-4646-b75b-140b90cef9c4 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.727915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 405/811] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:54.727915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf05dc-9b58-4646-b75b-140b90cef9c4 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:54.757334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 407/812] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:45:54.758400 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc48cb-8fd9-427c-a28c-72581bfda4ce None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:54.771263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:54.836559 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf05dc-9b58-4646-b75b-140b90cef9c4 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:54.850213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:54.885267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6032288-d3e7-4f71-ae26-8c61a786a16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:54.886311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6032288-d3e7-4f71-ae26-8c61a786a16c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.886824 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6032288-d3e7-4f71-ae26-8c61a786a16c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.887404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6032288-d3e7-4f71-ae26-8c61a786a16c None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.888132 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6032288-d3e7-4f71-ae26-8c61a786a16c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:54.888500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6032288-d3e7-4f71-ae26-8c61a786a16c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:54.889882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6032288-d3e7-4f71-ae26-8c61a786a16c None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:54.903978 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 406/813] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:54.905061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e9b78-ad94-481f-a5a6-6561d358e187 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.905350 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e9b78-ad94-481f-a5a6-6561d358e187 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.905622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e9b78-ad94-481f-a5a6-6561d358e187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.908227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc48cb-8fd9-427c-a28c-72581bfda4ce None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:54.958492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b77f91-31f7-4ae7-8f8e-1b4dcf86850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:54.959361 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b77f91-31f7-4ae7-8f8e-1b4dcf86850d None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:54.959647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b77f91-31f7-4ae7-8f8e-1b4dcf86850d None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:54.959956 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b77f91-31f7-4ae7-8f8e-1b4dcf86850d None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:54.960802 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b77f91-31f7-4ae7-8f8e-1b4dcf86850d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:54.961116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b77f91-31f7-4ae7-8f8e-1b4dcf86850d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:54.962620 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b77f91-31f7-4ae7-8f8e-1b4dcf86850d None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:54.984848 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 408/814] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 13:45:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:54.988725 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b77f91-31f7-4ae7-8f8e-1b4dcf86850d None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:55.057934 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-8d6e9b78-ad94-481f-a5a6-6561d358e187 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:55.059156 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-8d6e9b78-ad94-481f-a5a6-6561d358e187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:55.119364 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b77f91-31f7-4ae7-8f8e-1b4dcf86850d None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:55.140300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 407/815] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:45:55.140300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e9b78-ad94-481f-a5a6-6561d358e187 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:55.148165 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:55.168251 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5deff98-966e-4c55-821e-fcacdadb5ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:55.168893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deff98-966e-4c55-821e-fcacdadb5ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:55.169172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deff98-966e-4c55-821e-fcacdadb5ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:55.169441 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deff98-966e-4c55-821e-fcacdadb5ee4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:55.181929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:55.196734 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deff98-966e-4c55-821e-fcacdadb5ee4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:55.198793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deff98-966e-4c55-821e-fcacdadb5ee4 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:55.211937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-d5deff98-966e-4c55-821e-fcacdadb5ee4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:55.211937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:55.211937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:55.211937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:55.211937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:55.211937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:55.211937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:55.211937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:55.211937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:55.211937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:55.211937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:55.211937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:55.211937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:55.211937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:55.211937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:55.214532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:55.215645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:55.215645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:55.215645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:55.215645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:55.215645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:55.215645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:55.215645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:55.215645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:55.217713 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 409/816] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:55.218739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5deff98-966e-4c55-821e-fcacdadb5ee4 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:55.296014 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e9b78-ad94-481f-a5a6-6561d358e187 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:55.339971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd17a5-1285-4302-8a8c-023b9a91bb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:55.340945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd17a5-1285-4302-8a8c-023b9a91bb0a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:55.341446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd17a5-1285-4302-8a8c-023b9a91bb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:55.341959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd17a5-1285-4302-8a8c-023b9a91bb0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:55.347796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5deff98-966e-4c55-821e-fcacdadb5ee4 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:55.399226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a146a-2e69-41f2-9471-1e5daa74d239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:55.399785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a146a-2e69-41f2-9471-1e5daa74d239 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:55.400099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a146a-2e69-41f2-9471-1e5daa74d239 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:55.400374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a146a-2e69-41f2-9471-1e5daa74d239 None admin] PATH_INFO: `/v3/services/network` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:55.401365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a146a-2e69-41f2-9471-1e5daa74d239 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:55.402746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a146a-2e69-41f2-9471-1e5daa74d239 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-925a146a-2e69-41f2-9471-1e5daa74d239 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:55.419487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:55.420560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:55.421405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:55.421405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:55.421405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:55.421405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:55.421405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:55.421405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:55.421405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:55.421405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:55.421405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:55.421405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:55.421405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:45:55.421405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:45:55.421405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 13:45:55.421405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:55.421405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 410/817] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:55 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:55.422208 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a146a-2e69-41f2-9471-1e5daa74d239 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:55.429632 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd17a5-1285-4302-8a8c-023b9a91bb0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:55.431582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd17a5-1285-4302-8a8c-023b9a91bb0a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:55.461908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:55.474206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:55.536331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a146a-2e69-41f2-9471-1e5daa74d239 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:55.541088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 408/818] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:45:55.542023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd17a5-1285-4302-8a8c-023b9a91bb0a None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:55.580504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037d50a-0430-4cd5-a2a5-1f89cc732e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:55.581118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d50a-0430-4cd5-a2a5-1f89cc732e45 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:55.581399 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d50a-0430-4cd5-a2a5-1f89cc732e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:55.581668 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037d50a-0430-4cd5-a2a5-1f89cc732e45 None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:55.582371 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037d50a-0430-4cd5-a2a5-1f89cc732e45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:55.582684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037d50a-0430-4cd5-a2a5-1f89cc732e45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:55.584152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037d50a-0430-4cd5-a2a5-1f89cc732e45 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:55.596289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 411/819] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:55.597312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037d50a-0430-4cd5-a2a5-1f89cc732e45 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:55.669868 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd17a5-1285-4302-8a8c-023b9a91bb0a None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:55.701623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:55.711251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b01312-5f85-4608-a227-96dc226c8d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:55.712043 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b01312-5f85-4608-a227-96dc226c8d35 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:55.712364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b01312-5f85-4608-a227-96dc226c8d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:55.712604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b01312-5f85-4608-a227-96dc226c8d35 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:55.713228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b01312-5f85-4608-a227-96dc226c8d35 None admin] RBAC: Adding query filter params (name=network) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:55.713521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b01312-5f85-4608-a227-96dc226c8d35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:55.714908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b01312-5f85-4608-a227-96dc226c8d35 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:55.716120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037d50a-0430-4cd5-a2a5-1f89cc732e45 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:55.719290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:55.719895 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 409/820] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 13:45:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:55.720686 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b01312-5f85-4608-a227-96dc226c8d35 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:55.763216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eda1a3-95eb-4b2d-aa68-e9f74678ae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:55.763846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eda1a3-95eb-4b2d-aa68-e9f74678ae15 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:55.764142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eda1a3-95eb-4b2d-aa68-e9f74678ae15 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:55.764410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eda1a3-95eb-4b2d-aa68-e9f74678ae15 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:55.764986 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eda1a3-95eb-4b2d-aa68-e9f74678ae15 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:55.766336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eda1a3-95eb-4b2d-aa68-e9f74678ae15 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-c1eda1a3-95eb-4b2d-aa68-e9f74678ae15 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:55.776653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:55.777785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:55.778742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:55.778742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:55.778742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:55.778742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:55.778742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:55.778742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:55.778742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:55.778742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:55.778742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:55.778742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:55.778742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:45:55.778742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:45:55.778742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 13:45:55.778742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:55.778742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 412/821] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Sep 1 13:45:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:55.780179 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eda1a3-95eb-4b2d-aa68-e9f74678ae15 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:55.843484 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b01312-5f85-4608-a227-96dc226c8d35 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:55.881237 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec78d7-465a-4e88-9140-30b6e5fddb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:55.882412 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec78d7-465a-4e88-9140-30b6e5fddb99 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:55.882697 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec78d7-465a-4e88-9140-30b6e5fddb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:55.882970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec78d7-465a-4e88-9140-30b6e5fddb99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:55.886716 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eda1a3-95eb-4b2d-aa68-e9f74678ae15 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:55.902046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec78d7-465a-4e88-9140-30b6e5fddb99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:55.903526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec78d7-465a-4e88-9140-30b6e5fddb99 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-01ec78d7-465a-4e88-9140-30b6e5fddb99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:55.918613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:55.919650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:55.920641 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:55.920641 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:55.920641 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:55.920641 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 410/822] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:55.920641 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec78d7-465a-4e88-9140-30b6e5fddb99 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:55.932968 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fe78a-d08f-4277-8646-59b5def70454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:55.933638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fe78a-d08f-4277-8646-59b5def70454 None admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:55.933923 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fe78a-d08f-4277-8646-59b5def70454 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:55.934201 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fe78a-d08f-4277-8646-59b5def70454 None admin] PATH_INFO: `/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/98320a8730d245f6b7fa014273604ed5/roles/530c8dc4a70b4cb48bc4036a57ffa71b` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:55.949573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fe78a-d08f-4277-8646-59b5def70454 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e7998cc03064a0bb9a9dc6a1475d73c, user_id=98320a8730d245f6b7fa014273604ed5, role_id=530c8dc4a70b4cb48bc4036a57ffa71b)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:55.951022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fe78a-d08f-4277-8646-59b5def70454 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:55.973385 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:56.026749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec78d7-465a-4e88-9140-30b6e5fddb99 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:56.033600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 413/823] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:45:55 2022] PUT /identity/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/98320a8730d245f6b7fa014273604ed5/roles/530c8dc4a70b4cb48bc4036a57ffa71b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:45:56.045121 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fe78a-d08f-4277-8646-59b5def70454 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:56.067241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44ab2f-e186-42e4-b442-ae44f80b6907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:56.068041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44ab2f-e186-42e4-b442-ae44f80b6907 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:56.068384 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44ab2f-e186-42e4-b442-ae44f80b6907 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:56.068761 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44ab2f-e186-42e4-b442-ae44f80b6907 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:56.069633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44ab2f-e186-42e4-b442-ae44f80b6907 None admin] RBAC: Adding query filter params (type=network) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:56.070001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44ab2f-e186-42e4-b442-ae44f80b6907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:56.071482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44ab2f-e186-42e4-b442-ae44f80b6907 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:56.076165 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:56.083108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 411/824] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 13:45:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:56.084358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44ab2f-e186-42e4-b442-ae44f80b6907 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:56.196009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fe78a-d08f-4277-8646-59b5def70454 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:56.218627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44ab2f-e186-42e4-b442-ae44f80b6907 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:56.229816 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:56.250801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae63953-146a-4e91-8a5c-803689c101fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:56.253395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae63953-146a-4e91-8a5c-803689c101fb None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:56.254139 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae63953-146a-4e91-8a5c-803689c101fb None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:56.254614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae63953-146a-4e91-8a5c-803689c101fb None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:56.255788 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae63953-146a-4e91-8a5c-803689c101fb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:56.256337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae63953-146a-4e91-8a5c-803689c101fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:56.258231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae63953-146a-4e91-8a5c-803689c101fb None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:56.259286 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be114d7a-430c-4fc8-8ca7-c97360e4ca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:56.260804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be114d7a-430c-4fc8-8ca7-c97360e4ca5b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:56.261431 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be114d7a-430c-4fc8-8ca7-c97360e4ca5b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:56.262077 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be114d7a-430c-4fc8-8ca7-c97360e4ca5b None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:56.263019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be114d7a-430c-4fc8-8ca7-c97360e4ca5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:56.263447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be114d7a-430c-4fc8-8ca7-c97360e4ca5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:56.264945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 414/825] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Sep 1 13:45:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:56.265091 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be114d7a-430c-4fc8-8ca7-c97360e4ca5b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:56.266124 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae63953-146a-4e91-8a5c-803689c101fb None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:56.284768 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 412/826] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:56.285779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be114d7a-430c-4fc8-8ca7-c97360e4ca5b None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:56.362152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:56.381900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae63953-146a-4e91-8a5c-803689c101fb None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:56.402232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be114d7a-430c-4fc8-8ca7-c97360e4ca5b None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:56.420416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fa50b-c318-4fa0-83fd-579743ee002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:56.421019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fa50b-c318-4fa0-83fd-579743ee002c None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:56.421298 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fa50b-c318-4fa0-83fd-579743ee002c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:56.421567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fa50b-c318-4fa0-83fd-579743ee002c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:56.422331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fa50b-c318-4fa0-83fd-579743ee002c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:56.424378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fa50b-c318-4fa0-83fd-579743ee002c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:56.442467 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b675b-fd04-4bc3-85f5-3155322a4ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:56.443202 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b675b-fd04-4bc3-85f5-3155322a4ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:56.443556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b675b-fd04-4bc3-85f5-3155322a4ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:56.443948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b675b-fd04-4bc3-85f5-3155322a4ac7 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:56.444648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b675b-fd04-4bc3-85f5-3155322a4ac7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:56.445022 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b675b-fd04-4bc3-85f5-3155322a4ac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:56.446503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b675b-fd04-4bc3-85f5-3155322a4ac7 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:56.455989 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 413/827] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Sep 1 13:45:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:56.455989 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b675b-fd04-4bc3-85f5-3155322a4ac7 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:56.488621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:56.552926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 415/828] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 13:45:56 2022] POST /identity/v3/endpoints => generated 337 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:45:56.553865 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fa50b-c318-4fa0-83fd-579743ee002c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:56.573718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b675b-fd04-4bc3-85f5-3155322a4ac7 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:56.628236 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011eaf6a-1673-421c-8de6-95ba3025c868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:56.629436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011eaf6a-1673-421c-8de6-95ba3025c868 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:56.629560 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011eaf6a-1673-421c-8de6-95ba3025c868 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:56.629917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011eaf6a-1673-421c-8de6-95ba3025c868 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:56.638365 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011eaf6a-1673-421c-8de6-95ba3025c868 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:56.640211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011eaf6a-1673-421c-8de6-95ba3025c868 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:56.653845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-011eaf6a-1673-421c-8de6-95ba3025c868 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:56.653845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:56.653845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:56.653845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:56.653845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:56.653845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:56.653845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:56.653845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:56.653845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:56.653845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:56.653845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:56.653845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:56.653845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:56.653845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:56.653845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:56.654960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:56.655991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:56.655991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:56.655991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:56.655991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:56.655991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:56.655991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:56.655991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:56.655991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:56.660681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 414/829] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:56.662374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde1a5d-a117-4635-9e2c-91cc7aa3f15e None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:56.662595 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde1a5d-a117-4635-9e2c-91cc7aa3f15e None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:56.662955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde1a5d-a117-4635-9e2c-91cc7aa3f15e None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:56.665272 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 415/830] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:56.666018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde1a5d-a117-4635-9e2c-91cc7aa3f15e None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:56.705627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fa50b-c318-4fa0-83fd-579743ee002c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:56.749276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30955a-eafc-4a7f-8500-d3231da3644e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:56.750131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30955a-eafc-4a7f-8500-d3231da3644e None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:56.751252 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30955a-eafc-4a7f-8500-d3231da3644e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:56.751252 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30955a-eafc-4a7f-8500-d3231da3644e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:56.751655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30955a-eafc-4a7f-8500-d3231da3644e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:56.753835 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30955a-eafc-4a7f-8500-d3231da3644e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:56.767317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:56.785072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:56.798407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde1a5d-a117-4635-9e2c-91cc7aa3f15e None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:56.834353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190167d0-4780-4555-9c46-564ac92b3289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:56.834956 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190167d0-4780-4555-9c46-564ac92b3289 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:56.835230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190167d0-4780-4555-9c46-564ac92b3289 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:56.835498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190167d0-4780-4555-9c46-564ac92b3289 None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:56.836244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190167d0-4780-4555-9c46-564ac92b3289 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:56.836544 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190167d0-4780-4555-9c46-564ac92b3289 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:56.837954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190167d0-4780-4555-9c46-564ac92b3289 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:56.850715 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 416/831] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:56.851984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a31e9e-24c5-444d-ac33-1161ef055da4 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:56.857353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a31e9e-24c5-444d-ac33-1161ef055da4 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:56.857353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a31e9e-24c5-444d-ac33-1161ef055da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:56.860946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 416/832] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 13:45:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:45:56.862039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30955a-eafc-4a7f-8500-d3231da3644e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:56.870551 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-c9a31e9e-24c5-444d-ac33-1161ef055da4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:56.871845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c9a31e9e-24c5-444d-ac33-1161ef055da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:56.957336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 417/833] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:45:56.995592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30955a-eafc-4a7f-8500-d3231da3644e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:57.034266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcdc68-047a-4ffa-aa3e-c945fa4a2398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:57.034875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcdc68-047a-4ffa-aa3e-c945fa4a2398 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:57.035151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcdc68-047a-4ffa-aa3e-c945fa4a2398 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:57.035416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfcdc68-047a-4ffa-aa3e-c945fa4a2398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:57.036180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcdc68-047a-4ffa-aa3e-c945fa4a2398 None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=4b3c8a90b97246a98612b627b5f8da80) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:57.036487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcdc68-047a-4ffa-aa3e-c945fa4a2398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:57.037901 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfcdc68-047a-4ffa-aa3e-c945fa4a2398 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:57.044445 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 417/834] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:45:56 2022] GET /identity/v3/role_assignments?user.id=4b3c8a90b97246a98612b627b5f8da80&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:57.238572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a31e9e-24c5-444d-ac33-1161ef055da4 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:57.322122 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:57.348429 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a31e9e-24c5-444d-ac33-1161ef055da4 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:57.384329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b3e54-fe39-4e31-a44d-e2ad03230cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:57.384974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b3e54-fe39-4e31-a44d-e2ad03230cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:57.385258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b3e54-fe39-4e31-a44d-e2ad03230cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:57.385534 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b3e54-fe39-4e31-a44d-e2ad03230cf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:57.396330 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b3e54-fe39-4e31-a44d-e2ad03230cf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-dd3b3e54-fe39-4e31-a44d-e2ad03230cf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:57.401416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:57.402336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:57.403193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:57.403193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:57.403193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:57.403193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:57.403193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:57.403193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:57.403193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:57.403193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:57.403193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:57.403193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:57.403193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:45:57.403193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:57.403193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 418/835] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:45:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:57.408421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcdc68-047a-4ffa-aa3e-c945fa4a2398 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:57.471717 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:57.514309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfcdc68-047a-4ffa-aa3e-c945fa4a2398 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:57.550223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb1802-eec8-4dfd-8bcf-dda1579b713f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:57.550832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb1802-eec8-4dfd-8bcf-dda1579b713f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:57.551111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb1802-eec8-4dfd-8bcf-dda1579b713f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:57.551385 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb1802-eec8-4dfd-8bcf-dda1579b713f None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:57.552078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb1802-eec8-4dfd-8bcf-dda1579b713f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:57.552384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb1802-eec8-4dfd-8bcf-dda1579b713f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:57.553751 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb1802-eec8-4dfd-8bcf-dda1579b713f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:57.562624 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 418/836] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:45:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:57.568951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b3e54-fe39-4e31-a44d-e2ad03230cf7 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:57.672978 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b3e54-fe39-4e31-a44d-e2ad03230cf7 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:57.708507 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62732d65-f82a-49e6-9e59-02bdb8c3ac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:57.709145 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62732d65-f82a-49e6-9e59-02bdb8c3ac05 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:57.709425 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62732d65-f82a-49e6-9e59-02bdb8c3ac05 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:57.709699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62732d65-f82a-49e6-9e59-02bdb8c3ac05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:57.718228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:57.724420 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62732d65-f82a-49e6-9e59-02bdb8c3ac05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:57.726008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62732d65-f82a-49e6-9e59-02bdb8c3ac05 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-62732d65-f82a-49e6-9e59-02bdb8c3ac05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:57.741211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:57.743436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:57.745638 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:57.745638 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:57.745638 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:57.745638 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 419/837] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:57.748553 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb1802-eec8-4dfd-8bcf-dda1579b713f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:57.861691 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb1802-eec8-4dfd-8bcf-dda1579b713f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:57.881810 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:57.896461 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad6079-5233-4df3-9dad-59458db7b166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:57.907219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad6079-5233-4df3-9dad-59458db7b166 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:57.907219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad6079-5233-4df3-9dad-59458db7b166 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:57.907219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad6079-5233-4df3-9dad-59458db7b166 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:57.907219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad6079-5233-4df3-9dad-59458db7b166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:57.907219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad6079-5233-4df3-9dad-59458db7b166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:57.907219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad6079-5233-4df3-9dad-59458db7b166 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:57.912746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 419/838] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:57.918589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62732d65-f82a-49e6-9e59-02bdb8c3ac05 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:58.023457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62732d65-f82a-49e6-9e59-02bdb8c3ac05 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:58.059134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98645ba-4621-4f8c-9858-f835e471455f None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:58.059684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98645ba-4621-4f8c-9858-f835e471455f None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:58.060140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98645ba-4621-4f8c-9858-f835e471455f None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:58.062246 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 420/839] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:45:58.063669 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdfbbb-b0f0-400c-8515-8f74269153fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:58.064346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdfbbb-b0f0-400c-8515-8f74269153fb None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:58.064629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdfbbb-b0f0-400c-8515-8f74269153fb None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:58.065164 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabdfbbb-b0f0-400c-8515-8f74269153fb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:58.070619 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f92fb-b702-48ba-8aeb-b977a5f09c9f None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:58.070619 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f92fb-b702-48ba-8aeb-b977a5f09c9f None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:58.070924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f92fb-b702-48ba-8aeb-b977a5f09c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:58.076916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdfbbb-b0f0-400c-8515-8f74269153fb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:58.078653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabdfbbb-b0f0-400c-8515-8f74269153fb None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:58.089690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-966f92fb-b702-48ba-8aeb-b977a5f09c9f None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-cabdfbbb-b0f0-400c-8515-8f74269153fb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:58.090588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:58.091532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:58.092619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:58.092619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:58.092619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:58.092619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:58.092619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:58.092619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:58.092619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:58.092619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:58.092619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 13:45:58.092619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:58.094231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-966f92fb-b702-48ba-8aeb-b977a5f09c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:58.096038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 420/840] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:45:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:58.098184 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdfbbb-b0f0-400c-8515-8f74269153fb None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:58.148506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:58.181680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 421/841] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:45:58.214582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabdfbbb-b0f0-400c-8515-8f74269153fb None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:58.250227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32974f41-689c-422b-ad90-40b418be6c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:58.251439 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32974f41-689c-422b-ad90-40b418be6c5a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:58.251771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32974f41-689c-422b-ad90-40b418be6c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:58.252078 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32974f41-689c-422b-ad90-40b418be6c5a None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:58.254567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32974f41-689c-422b-ad90-40b418be6c5a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:58.254567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32974f41-689c-422b-ad90-40b418be6c5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:58.255157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32974f41-689c-422b-ad90-40b418be6c5a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:58.273884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 421/842] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Sep 1 13:45:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:58.279567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f92fb-b702-48ba-8aeb-b977a5f09c9f None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:58.388200 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f92fb-b702-48ba-8aeb-b977a5f09c9f None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:58.399280 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:58.424201 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58e3f1-59fd-44c8-ac26-57e35097a994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:58.424934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58e3f1-59fd-44c8-ac26-57e35097a994 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:58.425207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58e3f1-59fd-44c8-ac26-57e35097a994 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:58.425482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58e3f1-59fd-44c8-ac26-57e35097a994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:58.460085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32974f41-689c-422b-ad90-40b418be6c5a None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:58.496611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58e3f1-59fd-44c8-ac26-57e35097a994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:58.498075 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58e3f1-59fd-44c8-ac26-57e35097a994 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:58.568633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32974f41-689c-422b-ad90-40b418be6c5a None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:58.584270 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:58.605798 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7651acb-fccf-484a-85c3-256187449530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:58.606438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7651acb-fccf-484a-85c3-256187449530 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:58.606719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7651acb-fccf-484a-85c3-256187449530 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:58.606992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7651acb-fccf-484a-85c3-256187449530 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:58.607801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 422/843] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:58 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:45:58.609057 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58e3f1-59fd-44c8-ac26-57e35097a994 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:58.618608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7651acb-fccf-484a-85c3-256187449530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:45:58.621183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-c7651acb-fccf-484a-85c3-256187449530 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:45:58.624486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:58.625452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:58.626328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:58.626328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:58.626328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:58.626328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:58.626328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:45:58.626328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:45:58.626328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:45:58.626328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:45:58.626328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:45:58.626328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:45:58.626328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:45:58.626328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:58.626328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 422/844] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:45:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:58.636850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7651acb-fccf-484a-85c3-256187449530 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:58.732938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58e3f1-59fd-44c8-ac26-57e35097a994 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:58.759210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7651acb-fccf-484a-85c3-256187449530 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:58.780372 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7a68c-6095-4b8f-a89e-3c4af7cad043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:58.781019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7a68c-6095-4b8f-a89e-3c4af7cad043 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:58.781302 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7a68c-6095-4b8f-a89e-3c4af7cad043 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:58.781578 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7a68c-6095-4b8f-a89e-3c4af7cad043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:58.796605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7a68c-6095-4b8f-a89e-3c4af7cad043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:58.798208 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7a68c-6095-4b8f-a89e-3c4af7cad043 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:58.798556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92a526-e0de-44ae-b4ee-929e4c6447dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:58.799433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a526-e0de-44ae-b4ee-929e4c6447dc None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:58.799949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a526-e0de-44ae-b4ee-929e4c6447dc None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:58.800423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92a526-e0de-44ae-b4ee-929e4c6447dc None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:58.801287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92a526-e0de-44ae-b4ee-929e4c6447dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:58.801807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92a526-e0de-44ae-b4ee-929e4c6447dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:58.803373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92a526-e0de-44ae-b4ee-929e4c6447dc None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-d7d7a68c-6095-4b8f-a89e-3c4af7cad043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:58.816926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:58.817951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:58.818850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:58.818850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:58.818850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:58.819786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 423/846] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:45:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:58.820925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92a526-e0de-44ae-b4ee-929e4c6447dc None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:58.821048 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 423/846] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:45:58.822342 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7a68c-6095-4b8f-a89e-3c4af7cad043 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:58.852171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:58.905686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:58.935560 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92a526-e0de-44ae-b4ee-929e4c6447dc None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:58.945234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7a68c-6095-4b8f-a89e-3c4af7cad043 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:58.971964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc159ced-e0c9-4cf0-9d20-ec4e72966612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:58.972598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc159ced-e0c9-4cf0-9d20-ec4e72966612 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:58.972880 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc159ced-e0c9-4cf0-9d20-ec4e72966612 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:58.973152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc159ced-e0c9-4cf0-9d20-ec4e72966612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:58.981015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df480e2a-e4d5-429c-8741-d3111faecebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:58.981618 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df480e2a-e4d5-429c-8741-d3111faecebe None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:58.981906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df480e2a-e4d5-429c-8741-d3111faecebe None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:58.982175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df480e2a-e4d5-429c-8741-d3111faecebe None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:58.982841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df480e2a-e4d5-429c-8741-d3111faecebe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:58.983202 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df480e2a-e4d5-429c-8741-d3111faecebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:58.984526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc159ced-e0c9-4cf0-9d20-ec4e72966612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:58.984639 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df480e2a-e4d5-429c-8741-d3111faecebe None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:58.986260 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc159ced-e0c9-4cf0-9d20-ec4e72966612 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:59.003907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 424/847] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:59.003907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4977ea-d0af-480c-99f7-e9808b81d2bc None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:59.003907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4977ea-d0af-480c-99f7-e9808b81d2bc None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:59.003907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4977ea-d0af-480c-99f7-e9808b81d2bc None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:59.003907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 425/848] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-cc159ced-e0c9-4cf0-9d20-ec4e72966612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:45:59.004354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:59.005216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:45:59.009075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:45:59.009075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:45:59.009075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:45:59.009252 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4977ea-d0af-480c-99f7-e9808b81d2bc None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:59.009325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 424/849] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:59.009325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc159ced-e0c9-4cf0-9d20-ec4e72966612 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:59.105763 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:59.128019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc159ced-e0c9-4cf0-9d20-ec4e72966612 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:59.128575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4977ea-d0af-480c-99f7-e9808b81d2bc None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:59.153571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:59.168563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648919d2-d69c-42eb-a69f-5e43667c7eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:59.169203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648919d2-d69c-42eb-a69f-5e43667c7eec None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:59.169488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648919d2-d69c-42eb-a69f-5e43667c7eec None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:59.169764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648919d2-d69c-42eb-a69f-5e43667c7eec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:59.172484 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435c92f-c72a-4007-b653-7383ec6adba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:59.173118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435c92f-c72a-4007-b653-7383ec6adba4 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:59.173401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435c92f-c72a-4007-b653-7383ec6adba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:59.173668 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435c92f-c72a-4007-b653-7383ec6adba4 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:59.174302 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435c92f-c72a-4007-b653-7383ec6adba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:59.174603 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435c92f-c72a-4007-b653-7383ec6adba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:59.176113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435c92f-c72a-4007-b653-7383ec6adba4 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:59.177198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648919d2-d69c-42eb-a69f-5e43667c7eec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:59.179305 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648919d2-d69c-42eb-a69f-5e43667c7eec None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:59.188108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 425/850] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:59.189793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ff211-ec28-4a74-8bb5-51e320891200 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:59.190072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ff211-ec28-4a74-8bb5-51e320891200 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:59.190339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ff211-ec28-4a74-8bb5-51e320891200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:59.191191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-648919d2-d69c-42eb-a69f-5e43667c7eec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:59.191191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:59.191191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:59.191191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:59.191191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:59.191191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:59.191191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:59.191191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:59.191191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:59.191191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:59.191191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:59.191191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:59.191191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:45:59.191191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:45:59.191191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:59.192363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:59.193658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:45:59.193658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:45:59.193658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:45:59.193658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:45:59.193658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:45:59.193658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:45:59.193658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:45:59.193658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:59.193658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 426/851] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:45:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:45:59.194164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5f792-3c41-452d-8855-f77555cdfc98 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:59.194164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5f792-3c41-452d-8855-f77555cdfc98 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:59.194348 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5f792-3c41-452d-8855-f77555cdfc98 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:59.197658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 427/852] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:45:59.197658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5f792-3c41-452d-8855-f77555cdfc98 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:59.211557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-321ff211-ec28-4a74-8bb5-51e320891200 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:59.212765 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-321ff211-ec28-4a74-8bb5-51e320891200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:59.283575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 426/853] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:45:59.284380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ff211-ec28-4a74-8bb5-51e320891200 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:59.315067 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5f792-3c41-452d-8855-f77555cdfc98 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:59.350607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:59.361972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebfba9-b814-4ea9-9f21-91e0c35df991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:59.362981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebfba9-b814-4ea9-9f21-91e0c35df991 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:59.363322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebfba9-b814-4ea9-9f21-91e0c35df991 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:59.363602 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebfba9-b814-4ea9-9f21-91e0c35df991 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:59.375312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebfba9-b814-4ea9-9f21-91e0c35df991 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:59.377873 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebfba9-b814-4ea9-9f21-91e0c35df991 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-87ebfba9-b814-4ea9-9f21-91e0c35df991 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:45:59.392796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:59.393970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:59.399324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:59.399324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:59.399324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:45:59.399324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:45:59.399324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:45:59.399324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:45:59.399324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:45:59.399324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:45:59.399324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:45:59.399324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:59.400022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 428/854] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 13:45:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:59.400301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ff211-ec28-4a74-8bb5-51e320891200 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:59.400614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce611c88-411e-44c2-b0f1-543877bd1678 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:59.400905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce611c88-411e-44c2-b0f1-543877bd1678 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:59.401185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce611c88-411e-44c2-b0f1-543877bd1678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:59.419043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-ce611c88-411e-44c2-b0f1-543877bd1678 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:45:59.420283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ce611c88-411e-44c2-b0f1-543877bd1678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:45:59.440690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426b46-d9f5-4a93-b8c2-8c730ed2a14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:59.441293 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426b46-d9f5-4a93-b8c2-8c730ed2a14f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:59.441625 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426b46-d9f5-4a93-b8c2-8c730ed2a14f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:59.441886 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9426b46-d9f5-4a93-b8c2-8c730ed2a14f None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:59.442628 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9426b46-d9f5-4a93-b8c2-8c730ed2a14f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:59.442937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9426b46-d9f5-4a93-b8c2-8c730ed2a14f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:59.444426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9426b46-d9f5-4a93-b8c2-8c730ed2a14f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:59.456481 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 427/855] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:45:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:59.457271 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426b46-d9f5-4a93-b8c2-8c730ed2a14f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:59.464117 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:59.495856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 429/856] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:45:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:45:59.496920 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce611c88-411e-44c2-b0f1-543877bd1678 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:59.591682 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9426b46-d9f5-4a93-b8c2-8c730ed2a14f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:59.606360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce611c88-411e-44c2-b0f1-543877bd1678 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:59.621150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:59.630081 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f51925-fb5d-4c6a-8bcd-770d63228639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:59.630694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f51925-fb5d-4c6a-8bcd-770d63228639 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:59.630980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f51925-fb5d-4c6a-8bcd-770d63228639 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:59.634593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f51925-fb5d-4c6a-8bcd-770d63228639 None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:59.634593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f51925-fb5d-4c6a-8bcd-770d63228639 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:59.634593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f51925-fb5d-4c6a-8bcd-770d63228639 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:59.634593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f51925-fb5d-4c6a-8bcd-770d63228639 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:59.642519 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3468ce-7410-462f-8504-838c400564d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:59.643120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3468ce-7410-462f-8504-838c400564d5 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:59.643404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3468ce-7410-462f-8504-838c400564d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:59.643679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3468ce-7410-462f-8504-838c400564d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:59.644441 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3468ce-7410-462f-8504-838c400564d5 None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=cdebe1b674cc4b2bb6bf962de01a24ac) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:45:59.644755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3468ce-7410-462f-8504-838c400564d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:59.646201 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3468ce-7410-462f-8504-838c400564d5 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:59.651860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 430/857] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:45:59 2022] GET /identity/v3/role_assignments?user.id=cdebe1b674cc4b2bb6bf962de01a24ac&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:59.652672 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3468ce-7410-462f-8504-838c400564d5 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:59.653364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 428/858] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Sep 1 13:45:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:45:59.658914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f51925-fb5d-4c6a-8bcd-770d63228639 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:59.702892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:59.790588 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3468ce-7410-462f-8504-838c400564d5 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:59.801315 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f51925-fb5d-4c6a-8bcd-770d63228639 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:45:59.829433 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc40dca-77c6-4a92-830a-be1ff725bc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:59.830077 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc40dca-77c6-4a92-830a-be1ff725bc6a None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:59.830359 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc40dca-77c6-4a92-830a-be1ff725bc6a None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:59.830632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc40dca-77c6-4a92-830a-be1ff725bc6a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:59.831223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc40dca-77c6-4a92-830a-be1ff725bc6a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:59.833194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc40dca-77c6-4a92-830a-be1ff725bc6a None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-bbc40dca-77c6-4a92-830a-be1ff725bc6a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:45:59.843016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:45:59.844130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:45:59.845571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:45:59.845571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:45:59.845571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:45:59.845571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:45:59.845571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:45:59.845571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:45:59.845571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:45:59.845571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:45:59.845571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:45:59.845571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:45:59.845571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:45:59.845571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:45:59.845571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:45:59.845571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:45:59.845571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 431/859] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:45:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:45:59.846616 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc40dca-77c6-4a92-830a-be1ff725bc6a None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:45:59.849209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65026c-a132-4a78-8f88-e668164ba494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:45:59.850131 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65026c-a132-4a78-8f88-e668164ba494 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:45:59.850422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65026c-a132-4a78-8f88-e668164ba494 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:45:59.850742 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65026c-a132-4a78-8f88-e668164ba494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:45:59.922514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:59.936384 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65026c-a132-4a78-8f88-e668164ba494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:45:59.937838 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65026c-a132-4a78-8f88-e668164ba494 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:45:59.963284 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:45:59.966227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc40dca-77c6-4a92-830a-be1ff725bc6a None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:00.002896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98794bc-8526-4aa1-889e-ba0f9e067938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:00.003524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98794bc-8526-4aa1-889e-ba0f9e067938 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:00.003805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98794bc-8526-4aa1-889e-ba0f9e067938 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:00.004214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98794bc-8526-4aa1-889e-ba0f9e067938 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:00.004803 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98794bc-8526-4aa1-889e-ba0f9e067938 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:00.006297 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98794bc-8526-4aa1-889e-ba0f9e067938 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-f98794bc-8526-4aa1-889e-ba0f9e067938 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:00.016966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:00.017932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:00.018941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:00.018941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:00.018941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:00.018941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:00.018941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:00.018941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:00.018941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:00.018941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:00.018941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:00.018941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:00.018941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:00.018941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:00.018941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:46:00.018941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:00.018941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 432/860] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Sep 1 13:45:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:00.019769 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98794bc-8526-4aa1-889e-ba0f9e067938 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:00.045033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 429/861] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:45:59 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 13:46:00.045879 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65026c-a132-4a78-8f88-e668164ba494 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:00.136797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98794bc-8526-4aa1-889e-ba0f9e067938 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:00.139284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:00.160252 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65026c-a132-4a78-8f88-e668164ba494 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:00.189155 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d052ae-87c7-43ea-9fbd-2b143978e0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:00.189768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d052ae-87c7-43ea-9fbd-2b143978e0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:00.190456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d052ae-87c7-43ea-9fbd-2b143978e0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:00.191196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d052ae-87c7-43ea-9fbd-2b143978e0b2 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:00.191828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d052ae-87c7-43ea-9fbd-2b143978e0b2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:00.192166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d052ae-87c7-43ea-9fbd-2b143978e0b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:00.193539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d052ae-87c7-43ea-9fbd-2b143978e0b2 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:00.202666 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 433/862] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:46:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:00.202666 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d052ae-87c7-43ea-9fbd-2b143978e0b2 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:00.205975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b0e8e-1b28-47bd-a3a0-d4c4c4b49a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:00.207115 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b0e8e-1b28-47bd-a3a0-d4c4c4b49a3f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:00.207115 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b0e8e-1b28-47bd-a3a0-d4c4c4b49a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:00.207115 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b0e8e-1b28-47bd-a3a0-d4c4c4b49a3f None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:00.207744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b0e8e-1b28-47bd-a3a0-d4c4c4b49a3f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:00.208096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b0e8e-1b28-47bd-a3a0-d4c4c4b49a3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:00.209461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b0e8e-1b28-47bd-a3a0-d4c4c4b49a3f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:00.214745 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 430/863] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 13:46:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:00.215530 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b0e8e-1b28-47bd-a3a0-d4c4c4b49a3f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:00.237962 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:00.323913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b0e8e-1b28-47bd-a3a0-d4c4c4b49a3f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:00.325153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d052ae-87c7-43ea-9fbd-2b143978e0b2 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:00.358747 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be960237-0314-4ba7-8ff9-1705d4322ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:00.359371 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be960237-0314-4ba7-8ff9-1705d4322ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:00.359647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be960237-0314-4ba7-8ff9-1705d4322ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:00.359941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be960237-0314-4ba7-8ff9-1705d4322ac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:00.362586 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc743c97-c491-40fd-9d11-478cbfeb115e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:00.363198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc743c97-c491-40fd-9d11-478cbfeb115e None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:00.363478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc743c97-c491-40fd-9d11-478cbfeb115e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:00.363754 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc743c97-c491-40fd-9d11-478cbfeb115e None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:00.364436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc743c97-c491-40fd-9d11-478cbfeb115e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:00.364750 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc743c97-c491-40fd-9d11-478cbfeb115e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:00.366105 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc743c97-c491-40fd-9d11-478cbfeb115e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:00.378867 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 431/864] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:46:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:00.379070 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be960237-0314-4ba7-8ff9-1705d4322ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:00.379162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc743c97-c491-40fd-9d11-478cbfeb115e None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:00.379261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be960237-0314-4ba7-8ff9-1705d4322ac5 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-be960237-0314-4ba7-8ff9-1705d4322ac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:46:00.395809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:00.396820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:46:00.397754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:46:00.397754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:00.397754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:00.399417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:00.401578 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 434/865] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:00.402882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be960237-0314-4ba7-8ff9-1705d4322ac5 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:00.491664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc743c97-c491-40fd-9d11-478cbfeb115e None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:00.513724 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:00.540860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be960237-0314-4ba7-8ff9-1705d4322ac5 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:00.541191 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf30ca-6cd0-4c87-8f11-4d8a1de61ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:00.541805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf30ca-6cd0-4c87-8f11-4d8a1de61ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:00.542083 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf30ca-6cd0-4c87-8f11-4d8a1de61ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:00.542349 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf30ca-6cd0-4c87-8f11-4d8a1de61ea4 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:00.542980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf30ca-6cd0-4c87-8f11-4d8a1de61ea4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:00.543279 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf30ca-6cd0-4c87-8f11-4d8a1de61ea4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:00.544711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf30ca-6cd0-4c87-8f11-4d8a1de61ea4 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:00.550839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 432/866] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 13:46:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:00.588925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eae2eb-b4a2-4acf-a48a-bc36b2c9d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:00.589616 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eae2eb-b4a2-4acf-a48a-bc36b2c9d188 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:00.589893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eae2eb-b4a2-4acf-a48a-bc36b2c9d188 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:00.590161 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eae2eb-b4a2-4acf-a48a-bc36b2c9d188 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:00.590806 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eae2eb-b4a2-4acf-a48a-bc36b2c9d188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:00.591106 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eae2eb-b4a2-4acf-a48a-bc36b2c9d188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:00.594275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eae2eb-b4a2-4acf-a48a-bc36b2c9d188 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:00.607590 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 435/867] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:00.613941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf30ca-6cd0-4c87-8f11-4d8a1de61ea4 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:00.701054 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:00.724034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf30ca-6cd0-4c87-8f11-4d8a1de61ea4 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:00.760235 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf516954-cfc0-47f4-b0f5-0961a7999b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:00.760874 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf516954-cfc0-47f4-b0f5-0961a7999b0b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:00.761152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf516954-cfc0-47f4-b0f5-0961a7999b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:00.761420 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf516954-cfc0-47f4-b0f5-0961a7999b0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:00.769611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf516954-cfc0-47f4-b0f5-0961a7999b0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:00.771064 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf516954-cfc0-47f4-b0f5-0961a7999b0b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:00.782648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-bf516954-cfc0-47f4-b0f5-0961a7999b0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:00.782648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:00.782648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:00.782648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:00.782648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:00.782648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:00.782648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:00.782648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:00.782648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:00.782648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:00.782648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:00.782648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:00.782648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:46:00.782648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:46:00.782648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:00.783587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:00.784549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:46:00.784549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:46:00.784549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:46:00.784549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:46:00.784549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:46:00.784549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:46:00.784549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:00.784549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:00.787973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 433/868] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:46:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:00.789894 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eae2eb-b4a2-4acf-a48a-bc36b2c9d188 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:00.898653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eae2eb-b4a2-4acf-a48a-bc36b2c9d188 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:00.937355 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb43d57-0ead-4948-b481-a58f2dfdad2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:00.938377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb43d57-0ead-4948-b481-a58f2dfdad2a None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:00.938868 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb43d57-0ead-4948-b481-a58f2dfdad2a None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:00.939373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb43d57-0ead-4948-b481-a58f2dfdad2a None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:00.940296 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb43d57-0ead-4948-b481-a58f2dfdad2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:00.940827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb43d57-0ead-4948-b481-a58f2dfdad2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:00.942467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb43d57-0ead-4948-b481-a58f2dfdad2a None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:00.952200 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:00.957980 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 436/869] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:46:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:00.964538 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf516954-cfc0-47f4-b0f5-0961a7999b0b None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:01.070635 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf516954-cfc0-47f4-b0f5-0961a7999b0b None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:01.106320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e0807-d7c7-40a5-8d91-dfa6f73d65fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:01.106926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e0807-d7c7-40a5-8d91-dfa6f73d65fa None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:01.107201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e0807-d7c7-40a5-8d91-dfa6f73d65fa None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:01.107519 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e0807-d7c7-40a5-8d91-dfa6f73d65fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:01.108275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e0807-d7c7-40a5-8d91-dfa6f73d65fa None admin] RBAC: Adding query filter params (role.id=530c8dc4a70b4cb48bc4036a57ffa71b, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=98320a8730d245f6b7fa014273604ed5) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:01.108579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e0807-d7c7-40a5-8d91-dfa6f73d65fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:01.109997 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e0807-d7c7-40a5-8d91-dfa6f73d65fa None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:01.119979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 434/870] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:46:00 2022] GET /identity/v3/role_assignments?user.id=98320a8730d245f6b7fa014273604ed5&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=530c8dc4a70b4cb48bc4036a57ffa71b => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:01.737059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cdee0-b974-401f-ad6a-e57c1606693a None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:01.738133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cdee0-b974-401f-ad6a-e57c1606693a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:01.738633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cdee0-b974-401f-ad6a-e57c1606693a None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:01.740455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 437/871] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:01.745711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f231c-b2cf-4988-82b0-a8f769f32e39 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:01.746244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f231c-b2cf-4988-82b0-a8f769f32e39 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:01.746730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f231c-b2cf-4988-82b0-a8f769f32e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:01.753468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:01.765859 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-1c2f231c-b2cf-4988-82b0-a8f769f32e39 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:01.768563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1c2f231c-b2cf-4988-82b0-a8f769f32e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:01.838604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 435/872] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:02.112764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cdee0-b974-401f-ad6a-e57c1606693a None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:02.229231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cdee0-b974-401f-ad6a-e57c1606693a None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:02.264996 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222e689-0613-4fd1-92cb-ced81ebe6cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:02.265628 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222e689-0613-4fd1-92cb-ced81ebe6cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:02.265955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222e689-0613-4fd1-92cb-ced81ebe6cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:02.266230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222e689-0613-4fd1-92cb-ced81ebe6cf4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:02.267462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222e689-0613-4fd1-92cb-ced81ebe6cf4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:02.268984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222e689-0613-4fd1-92cb-ced81ebe6cf4 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-6222e689-0613-4fd1-92cb-ced81ebe6cf4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:02.278239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:02.279308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:02.280281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:02.280281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:02.280281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:02.280281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:02.280281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:02.280281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:02.280281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:02.280281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:02.280281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:02.280281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:02.280281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:02.280281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:02.280281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:46:02.280281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:02.280281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 438/873] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 13:46:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:02.285987 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f231c-b2cf-4988-82b0-a8f769f32e39 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:02.395106 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f231c-b2cf-4988-82b0-a8f769f32e39 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:02.425297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:02.430342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d7e28-216d-452a-9998-daad86c6f9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:02.430952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d7e28-216d-452a-9998-daad86c6f9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:02.431229 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d7e28-216d-452a-9998-daad86c6f9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:02.431498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d7e28-216d-452a-9998-daad86c6f9d4 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:02.432143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d7e28-216d-452a-9998-daad86c6f9d4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:02.436970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d7e28-216d-452a-9998-daad86c6f9d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:02.436970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d7e28-216d-452a-9998-daad86c6f9d4 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:02.438941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 436/874] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 13:46:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:02.444303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222e689-0613-4fd1-92cb-ced81ebe6cf4 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:02.476473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dabcb2-e871-4278-afa2-1013a70cb2dd None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:02.476768 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dabcb2-e871-4278-afa2-1013a70cb2dd None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:02.477214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dabcb2-e871-4278-afa2-1013a70cb2dd None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:02.478868 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 437/875] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:46:02.483617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82034b-3649-4f0c-bd1c-a7e8c185a1f0 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:02.484170 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82034b-3649-4f0c-bd1c-a7e8c185a1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:02.484651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82034b-3649-4f0c-bd1c-a7e8c185a1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:02.508050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-df82034b-3649-4f0c-bd1c-a7e8c185a1f0 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:02.510004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-df82034b-3649-4f0c-bd1c-a7e8c185a1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:02.518512 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:02.560980 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222e689-0613-4fd1-92cb-ced81ebe6cf4 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:02.582048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 438/876] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:02.583313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f41630-9eb2-433b-a6b8-91dcc0f9a7e6 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:02.583597 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f41630-9eb2-433b-a6b8-91dcc0f9a7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:02.583894 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f41630-9eb2-433b-a6b8-91dcc0f9a7e6 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:02.585303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 439/877] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:02.594154 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b4ab5-7e3a-404c-bda9-935e93caebc0 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:02.594508 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b4ab5-7e3a-404c-bda9-935e93caebc0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:02.595300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b4ab5-7e3a-404c-bda9-935e93caebc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:02.612005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04df91-a07e-4baf-aad5-34e9953cf3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:02.613079 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04df91-a07e-4baf-aad5-34e9953cf3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:02.613585 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-891b4ab5-7e3a-404c-bda9-935e93caebc0 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:02.613706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04df91-a07e-4baf-aad5-34e9953cf3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:02.614189 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04df91-a07e-4baf-aad5-34e9953cf3c8 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:02.614809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-891b4ab5-7e3a-404c-bda9-935e93caebc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:02.615260 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04df91-a07e-4baf-aad5-34e9953cf3c8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:02.615769 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04df91-a07e-4baf-aad5-34e9953cf3c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:02.617564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04df91-a07e-4baf-aad5-34e9953cf3c8 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:02.624103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 439/878] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 13:46:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:02.704130 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 440/879] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:02.852681 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04df91-a07e-4baf-aad5-34e9953cf3c8 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:02.961406 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04df91-a07e-4baf-aad5-34e9953cf3c8 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:02.966391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b4ab5-7e3a-404c-bda9-935e93caebc0 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:02.991429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:03.000170 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f94ad-21af-446f-a516-7503dff689bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:03.005855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f94ad-21af-446f-a516-7503dff689bd None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:03.005855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f94ad-21af-446f-a516-7503dff689bd None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:03.005855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f94ad-21af-446f-a516-7503dff689bd None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:03.005855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f94ad-21af-446f-a516-7503dff689bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:03.005855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f94ad-21af-446f-a516-7503dff689bd None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:03.027402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:03.073864 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b4ab5-7e3a-404c-bda9-935e93caebc0 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:03.120640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 440/880] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 13:46:02 2022] POST /identity/v3/services => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:46:03.122304 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fd63b-a14e-4213-80bf-deda10fd6cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:03.123258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fd63b-a14e-4213-80bf-deda10fd6cc7 None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:03.123830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fd63b-a14e-4213-80bf-deda10fd6cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:03.124403 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fd63b-a14e-4213-80bf-deda10fd6cc7 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:03.125352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fd63b-a14e-4213-80bf-deda10fd6cc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:03.128515 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fd63b-a14e-4213-80bf-deda10fd6cc7 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:03.174474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf2a80-3e47-4f5d-a21c-84cb56e907e2 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:03.174769 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf2a80-3e47-4f5d-a21c-84cb56e907e2 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:03.175030 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf2a80-3e47-4f5d-a21c-84cb56e907e2 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:03.176512 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 441/881] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:46:03.182404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d0d06-8bf5-4b81-af0d-18f67b8cde3a None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:03.182892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d0d06-8bf5-4b81-af0d-18f67b8cde3a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:03.183005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d0d06-8bf5-4b81-af0d-18f67b8cde3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:03.202131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-396d0d06-8bf5-4b81-af0d-18f67b8cde3a None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:03.203344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-396d0d06-8bf5-4b81-af0d-18f67b8cde3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:03.252125 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 441/882] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 13:46:02 2022] POST /identity/v3/services => generated 269 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:46:03.301150 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 442/883] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:03.572707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fd63b-a14e-4213-80bf-deda10fd6cc7 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:03.688501 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fd63b-a14e-4213-80bf-deda10fd6cc7 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:03.706685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:03.731487 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23ff1b-02b8-4649-982f-d7cf53148027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:03.732268 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23ff1b-02b8-4649-982f-d7cf53148027 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:03.732553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23ff1b-02b8-4649-982f-d7cf53148027 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:03.732826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23ff1b-02b8-4649-982f-d7cf53148027 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:03.745350 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23ff1b-02b8-4649-982f-d7cf53148027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-7a23ff1b-02b8-4649-982f-d7cf53148027 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:46:03.750611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:03.751590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:03.752981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:03.752981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:03.752981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:03.752981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:03.752981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:46:03.752981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:46:03.752981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:46:03.752981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:46:03.752981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:46:03.752981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:46:03.752981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:46:03.752981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:03.752981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 442/884] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Sep 1 13:46:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:03.757989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d0d06-8bf5-4b81-af0d-18f67b8cde3a None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:03.862881 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d0d06-8bf5-4b81-af0d-18f67b8cde3a None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:03.880143 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:03.901691 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77945baa-9aa4-4d84-989d-b428130bc444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:03.902303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77945baa-9aa4-4d84-989d-b428130bc444 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:03.902584 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77945baa-9aa4-4d84-989d-b428130bc444 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:03.902857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77945baa-9aa4-4d84-989d-b428130bc444 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:03.903527 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77945baa-9aa4-4d84-989d-b428130bc444 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:03.903835 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77945baa-9aa4-4d84-989d-b428130bc444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:03.905222 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77945baa-9aa4-4d84-989d-b428130bc444 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:03.915162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 443/885] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Sep 1 13:46:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:03.920816 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23ff1b-02b8-4649-982f-d7cf53148027 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:04.033077 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23ff1b-02b8-4649-982f-d7cf53148027 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:04.067341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc55a55-5868-4ee8-9d55-5a0318866446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:04.068003 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc55a55-5868-4ee8-9d55-5a0318866446 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:04.068288 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc55a55-5868-4ee8-9d55-5a0318866446 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:04.068563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc55a55-5868-4ee8-9d55-5a0318866446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:04.080067 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc55a55-5868-4ee8-9d55-5a0318866446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:04.081537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc55a55-5868-4ee8-9d55-5a0318866446 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-9dc55a55-5868-4ee8-9d55-5a0318866446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:46:04.096919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:04.097929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:46:04.098919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:46:04.098919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:04.098919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:04.098919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 443/886] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:04.105264 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77945baa-9aa4-4d84-989d-b428130bc444 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:04.220642 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77945baa-9aa4-4d84-989d-b428130bc444 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:04.257345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392c85a-fa04-4ce7-9551-88724364cc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:04.258033 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392c85a-fa04-4ce7-9551-88724364cc34 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:04.258313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392c85a-fa04-4ce7-9551-88724364cc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:04.258576 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392c85a-fa04-4ce7-9551-88724364cc34 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:04.259210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392c85a-fa04-4ce7-9551-88724364cc34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:04.259507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392c85a-fa04-4ce7-9551-88724364cc34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:04.260897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392c85a-fa04-4ce7-9551-88724364cc34 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:04.276056 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 444/887] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:04.281710 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc55a55-5868-4ee8-9d55-5a0318866446 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:04.310008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:04.393578 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc55a55-5868-4ee8-9d55-5a0318866446 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:04.428520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a673eb4-fca6-4e1d-9f97-27e4ce29f3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:04.429075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a673eb4-fca6-4e1d-9f97-27e4ce29f3ae None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:04.429354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a673eb4-fca6-4e1d-9f97-27e4ce29f3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:04.429622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a673eb4-fca6-4e1d-9f97-27e4ce29f3ae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:04.437135 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a673eb4-fca6-4e1d-9f97-27e4ce29f3ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:04.439152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a673eb4-fca6-4e1d-9f97-27e4ce29f3ae None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-6a673eb4-fca6-4e1d-9f97-27e4ce29f3ae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:46:04.450239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:04.451192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:04.452221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:04.452221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:04.452221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:46:04.452221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:46:04.452221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:46:04.452221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:46:04.452221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:46:04.452221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:46:04.452221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:46:04.452221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:04.452221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 444/888] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 13:46:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:46:04.459102 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392c85a-fa04-4ce7-9551-88724364cc34 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:04.496279 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:04.565407 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392c85a-fa04-4ce7-9551-88724364cc34 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:04.601332 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d59d70-9b95-4b75-bdfe-59b925ce1d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:04.602308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d59d70-9b95-4b75-bdfe-59b925ce1d1e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:04.602797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d59d70-9b95-4b75-bdfe-59b925ce1d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:04.603290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d59d70-9b95-4b75-bdfe-59b925ce1d1e None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:04.604260 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d59d70-9b95-4b75-bdfe-59b925ce1d1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:04.604776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d59d70-9b95-4b75-bdfe-59b925ce1d1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:04.606419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d59d70-9b95-4b75-bdfe-59b925ce1d1e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:04.625057 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 445/889] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Sep 1 13:46:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:04.631637 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a673eb4-fca6-4e1d-9f97-27e4ce29f3ae None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:04.645678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf05c5d-e181-4704-9771-ded768eb40ac None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:04.645984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf05c5d-e181-4704-9771-ded768eb40ac None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:04.646239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf05c5d-e181-4704-9771-ded768eb40ac None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:04.647701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 446/890] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:04.652882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13d335-704c-462d-b840-606a49ef3c84 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:04.653168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13d335-704c-462d-b840-606a49ef3c84 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:04.653446 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13d335-704c-462d-b840-606a49ef3c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:04.677166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-ff13d335-704c-462d-b840-606a49ef3c84 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:04.678686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ff13d335-704c-462d-b840-606a49ef3c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:04.736468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:04.754905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a673eb4-fca6-4e1d-9f97-27e4ce29f3ae None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:04.767895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 447/891] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:04.794614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da2031-fccc-45a1-88b4-6272ad03b3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:04.795228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da2031-fccc-45a1-88b4-6272ad03b3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:04.795514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da2031-fccc-45a1-88b4-6272ad03b3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:04.795792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da2031-fccc-45a1-88b4-6272ad03b3b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:04.865255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da2031-fccc-45a1-88b4-6272ad03b3b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:04.866708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da2031-fccc-45a1-88b4-6272ad03b3b3 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:04.952216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:04.968903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 445/892] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:46:04 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:46:04.974171 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13d335-704c-462d-b840-606a49ef3c84 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:05.000261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:05.054352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da2031-fccc-45a1-88b4-6272ad03b3b3 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:05.088255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13d335-704c-462d-b840-606a49ef3c84 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:05.127265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84c132-6faa-4193-8e78-938337cc3e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:05.128328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84c132-6faa-4193-8e78-938337cc3e07 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:05.128882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84c132-6faa-4193-8e78-938337cc3e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:05.129381 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84c132-6faa-4193-8e78-938337cc3e07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:05.141934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84c132-6faa-4193-8e78-938337cc3e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:05.144046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84c132-6faa-4193-8e78-938337cc3e07 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-ad84c132-6faa-4193-8e78-938337cc3e07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:46:05.164151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:05.165207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:46:05.166166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:46:05.166166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:05.166166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:05.166166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 448/893] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:05.173702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84c132-6faa-4193-8e78-938337cc3e07 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:05.190075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da2031-fccc-45a1-88b4-6272ad03b3b3 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:05.231751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d00f1-97d1-47c4-8f6d-8a8f31b6f5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:05.232357 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d00f1-97d1-47c4-8f6d-8a8f31b6f5c1 None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:05.232643 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d00f1-97d1-47c4-8f6d-8a8f31b6f5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:05.232914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d00f1-97d1-47c4-8f6d-8a8f31b6f5c1 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:05.233581 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d00f1-97d1-47c4-8f6d-8a8f31b6f5c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:05.235579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d00f1-97d1-47c4-8f6d-8a8f31b6f5c1 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:05.268123 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:05.292581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84c132-6faa-4193-8e78-938337cc3e07 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:05.340589 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71738ef-eedc-4149-97b0-5802df9cee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:05.341197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71738ef-eedc-4149-97b0-5802df9cee6f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:05.341475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71738ef-eedc-4149-97b0-5802df9cee6f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:05.341746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71738ef-eedc-4149-97b0-5802df9cee6f None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:05.342396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71738ef-eedc-4149-97b0-5802df9cee6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:05.342702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71738ef-eedc-4149-97b0-5802df9cee6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:05.344108 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71738ef-eedc-4149-97b0-5802df9cee6f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:05.357712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 449/894] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:05.359001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32dba3-7759-49c8-96c4-0ec24ade4e42 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:05.359246 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32dba3-7759-49c8-96c4-0ec24ade4e42 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:05.359522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32dba3-7759-49c8-96c4-0ec24ade4e42 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:05.361005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 450/895] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:05.361749 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af5385-f123-46b8-9363-d999b9e37cbe None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:05.362023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af5385-f123-46b8-9363-d999b9e37cbe None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:05.362303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af5385-f123-46b8-9363-d999b9e37cbe None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:05.363720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 451/896] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:05.364327 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af5385-f123-46b8-9363-d999b9e37cbe None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:05.389949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 446/897] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 13:46:05 2022] POST /identity/v3/services => generated 241 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:46:05.392118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5153e7-7d60-4a2d-b069-f061a4f24b06 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:05.392482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5153e7-7d60-4a2d-b069-f061a4f24b06 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:05.392875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5153e7-7d60-4a2d-b069-f061a4f24b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:05.415211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-1c5153e7-7d60-4a2d-b069-f061a4f24b06 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:05.416647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1c5153e7-7d60-4a2d-b069-f061a4f24b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:05.470978 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:05.508508 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af5385-f123-46b8-9363-d999b9e37cbe None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:05.512218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 447/898] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:05.517474 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c82e89-0f42-4c47-a4f1-da86d8f35ebd None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:05.518279 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c82e89-0f42-4c47-a4f1-da86d8f35ebd None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:05.519655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c82e89-0f42-4c47-a4f1-da86d8f35ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:05.546075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e9c82e89-0f42-4c47-a4f1-da86d8f35ebd None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:05.548019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e9c82e89-0f42-4c47-a4f1-da86d8f35ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:05.549195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:05.555857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57d2fd-2366-4275-ae9f-8d1c7eb1cefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:05.556572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57d2fd-2366-4275-ae9f-8d1c7eb1cefd None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:05.556855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57d2fd-2366-4275-ae9f-8d1c7eb1cefd None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:05.557132 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57d2fd-2366-4275-ae9f-8d1c7eb1cefd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:05.566828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57d2fd-2366-4275-ae9f-8d1c7eb1cefd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:05.568353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57d2fd-2366-4275-ae9f-8d1c7eb1cefd None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:05.583565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-0b57d2fd-2366-4275-ae9f-8d1c7eb1cefd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:05.583565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:05.583565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:05.583565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:05.583565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:05.583565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:05.583565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:05.583565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:05.583565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:05.583565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:05.583565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:05.583565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:05.583565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:46:05.583565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:46:05.583565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:05.585130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:05.586415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:46:05.586415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:46:05.586415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:46:05.586415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:46:05.586415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:46:05.586415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:46:05.586415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:05.586415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:05.586415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 452/899] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:46:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:05.589900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57d2fd-2366-4275-ae9f-8d1c7eb1cefd None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:05.637575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 448/900] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:05.706706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57d2fd-2366-4275-ae9f-8d1c7eb1cefd None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:05.741863 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750292f-73d6-48fe-87e7-d9c200702c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:05.742811 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750292f-73d6-48fe-87e7-d9c200702c81 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:05.743261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750292f-73d6-48fe-87e7-d9c200702c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:05.743701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750292f-73d6-48fe-87e7-d9c200702c81 None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:05.744582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750292f-73d6-48fe-87e7-d9c200702c81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:05.745037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750292f-73d6-48fe-87e7-d9c200702c81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:05.746610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750292f-73d6-48fe-87e7-d9c200702c81 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:05.759897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 453/901] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:46:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:05.768266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c82e89-0f42-4c47-a4f1-da86d8f35ebd None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:05.784066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750292f-73d6-48fe-87e7-d9c200702c81 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:05.861131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:05.871939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:05.876931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c82e89-0f42-4c47-a4f1-da86d8f35ebd None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:05.920615 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541ce97-b0c5-4a2b-af61-3fbbd4947dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:05.921304 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541ce97-b0c5-4a2b-af61-3fbbd4947dbf None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:05.921526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541ce97-b0c5-4a2b-af61-3fbbd4947dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:05.921798 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541ce97-b0c5-4a2b-af61-3fbbd4947dbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:05.922674 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541ce97-b0c5-4a2b-af61-3fbbd4947dbf None admin] RBAC: Adding query filter params (role.id=304f77f2646444858d534f43683d186a, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=98320a8730d245f6b7fa014273604ed5) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:05.922990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541ce97-b0c5-4a2b-af61-3fbbd4947dbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:05.924333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750292f-73d6-48fe-87e7-d9c200702c81 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:05.924466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541ce97-b0c5-4a2b-af61-3fbbd4947dbf None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:05.940174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 449/902] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:46:05 2022] GET /identity/v3/role_assignments?user.id=98320a8730d245f6b7fa014273604ed5&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=304f77f2646444858d534f43683d186a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:05.949429 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541ce97-b0c5-4a2b-af61-3fbbd4947dbf None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:05.965968 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c89523-c1ab-48ac-889b-f07cb56ca4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:05.967130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89523-c1ab-48ac-889b-f07cb56ca4af None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:05.967748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89523-c1ab-48ac-889b-f07cb56ca4af None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:05.968177 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89523-c1ab-48ac-889b-f07cb56ca4af None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:05.968886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c89523-c1ab-48ac-889b-f07cb56ca4af None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:05.971004 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c89523-c1ab-48ac-889b-f07cb56ca4af None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-40c89523-c1ab-48ac-889b-f07cb56ca4af None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:05.981648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:05.983126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:05.984073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:05.984073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:05.984073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:05.984073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:05.984073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:05.984073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:05.984073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:05.984073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:05.984073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:05.984073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:05.984073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:05.984073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:05.984073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:46:05.984073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:05.984073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 454/903] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Sep 1 13:46:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:05.989337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c89523-c1ab-48ac-889b-f07cb56ca4af None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:06.069867 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541ce97-b0c5-4a2b-af61-3fbbd4947dbf None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:06.115038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42205e1f-5e2b-41b4-a8d4-36d6cc799ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:06.116000 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42205e1f-5e2b-41b4-a8d4-36d6cc799ebf None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:06.116287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42205e1f-5e2b-41b4-a8d4-36d6cc799ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:06.116564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42205e1f-5e2b-41b4-a8d4-36d6cc799ebf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:06.117156 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42205e1f-5e2b-41b4-a8d4-36d6cc799ebf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:06.119163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42205e1f-5e2b-41b4-a8d4-36d6cc799ebf None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-42205e1f-5e2b-41b4-a8d4-36d6cc799ebf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:06.131303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:06.132692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:06.133541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:06.133541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:06.133541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:06.133541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:06.133541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:06.133541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:06.133541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:06.133541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:06.133541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:06.133541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:06.133541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:06.133541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:06.133541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:46:06.133541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:06.135944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 450/904] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:46:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:46:06.139361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42205e1f-5e2b-41b4-a8d4-36d6cc799ebf None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:06.143095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c89523-c1ab-48ac-889b-f07cb56ca4af None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:06.167628 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:06.183629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:06.195761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd549e-a48c-4f46-ac4f-5eb33cac1210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:06.196427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd549e-a48c-4f46-ac4f-5eb33cac1210 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:06.196711 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd549e-a48c-4f46-ac4f-5eb33cac1210 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:06.196987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd549e-a48c-4f46-ac4f-5eb33cac1210 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:06.197625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd549e-a48c-4f46-ac4f-5eb33cac1210 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:06.197932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd549e-a48c-4f46-ac4f-5eb33cac1210 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:06.199365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd549e-a48c-4f46-ac4f-5eb33cac1210 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:06.211501 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 455/905] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 13:46:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:06.215250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd549e-a48c-4f46-ac4f-5eb33cac1210 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:06.285795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42205e1f-5e2b-41b4-a8d4-36d6cc799ebf None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:06.321236 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeed514-ac75-416d-b376-3043a37cca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:06.321832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeed514-ac75-416d-b376-3043a37cca30 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:06.322555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeed514-ac75-416d-b376-3043a37cca30 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:06.322836 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeed514-ac75-416d-b376-3043a37cca30 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:06.323751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeed514-ac75-416d-b376-3043a37cca30 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:06.324107 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeed514-ac75-416d-b376-3043a37cca30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:06.325957 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeed514-ac75-416d-b376-3043a37cca30 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:06.332840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 451/906] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:46:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:06.339220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeed514-ac75-416d-b376-3043a37cca30 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:06.340328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd549e-a48c-4f46-ac4f-5eb33cac1210 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:06.378803 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b92f60-0a8d-45ee-9bda-b587f429da24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:06.379421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b92f60-0a8d-45ee-9bda-b587f429da24 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:06.379706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b92f60-0a8d-45ee-9bda-b587f429da24 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:06.380052 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b92f60-0a8d-45ee-9bda-b587f429da24 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:06.381019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b92f60-0a8d-45ee-9bda-b587f429da24 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:06.381615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b92f60-0a8d-45ee-9bda-b587f429da24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:06.383379 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b92f60-0a8d-45ee-9bda-b587f429da24 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:06.389044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 456/907] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 13:46:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:06.395833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b92f60-0a8d-45ee-9bda-b587f429da24 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:06.446285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:06.448804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:06.455009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeed514-ac75-416d-b376-3043a37cca30 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:06.490135 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8916ef-b805-4471-940c-70e28b703c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:06.490751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8916ef-b805-4471-940c-70e28b703c56 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:06.491033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8916ef-b805-4471-940c-70e28b703c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:06.491303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8916ef-b805-4471-940c-70e28b703c56 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:06.491972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8916ef-b805-4471-940c-70e28b703c56 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:06.492282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8916ef-b805-4471-940c-70e28b703c56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:06.493644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8916ef-b805-4471-940c-70e28b703c56 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:06.504162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 452/908] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:46:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:06.506364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8916ef-b805-4471-940c-70e28b703c56 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:06.519300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b92f60-0a8d-45ee-9bda-b587f429da24 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:06.565888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914ea7b-2bd3-4f50-9430-4d7728cbe3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:06.566698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914ea7b-2bd3-4f50-9430-4d7728cbe3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:06.566983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914ea7b-2bd3-4f50-9430-4d7728cbe3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:06.567261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914ea7b-2bd3-4f50-9430-4d7728cbe3e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:06.568407 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914ea7b-2bd3-4f50-9430-4d7728cbe3e7 None admin] RBAC: Adding query filter params (interface=public, service_id=2356fad2cc474de19f448d0f817d36ce, region_id=RegionOne) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:06.568869 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914ea7b-2bd3-4f50-9430-4d7728cbe3e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:06.570530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914ea7b-2bd3-4f50-9430-4d7728cbe3e7 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:06.577484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 457/909] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 13:46:06 2022] GET /identity/v3/endpoints?service_id=2356fad2cc474de19f448d0f817d36ce&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:06.583673 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914ea7b-2bd3-4f50-9430-4d7728cbe3e7 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:06.638829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8916ef-b805-4471-940c-70e28b703c56 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:06.675467 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972525fc-fd52-44ff-a59d-3eeffbe81e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:06.676124 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972525fc-fd52-44ff-a59d-3eeffbe81e64 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:06.676456 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972525fc-fd52-44ff-a59d-3eeffbe81e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:06.676734 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972525fc-fd52-44ff-a59d-3eeffbe81e64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:06.677432 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972525fc-fd52-44ff-a59d-3eeffbe81e64 None admin] RBAC: Adding query filter params (interface=public, service_id=f416b47707b74227a3f8fdad18003686, region_id=RegionOne) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:06.677789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972525fc-fd52-44ff-a59d-3eeffbe81e64 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:06.679207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972525fc-fd52-44ff-a59d-3eeffbe81e64 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:06.689213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 453/910] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 13:46:06 2022] GET /identity/v3/endpoints?service_id=f416b47707b74227a3f8fdad18003686&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:06.690090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972525fc-fd52-44ff-a59d-3eeffbe81e64 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:06.712713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:06.725345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914ea7b-2bd3-4f50-9430-4d7728cbe3e7 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:06.737573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:06.765918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cbae6-a56c-4197-b44d-26078a3b1f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:06.766655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cbae6-a56c-4197-b44d-26078a3b1f95 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:06.766992 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cbae6-a56c-4197-b44d-26078a3b1f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:06.767276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cbae6-a56c-4197-b44d-26078a3b1f95 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:06.767896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349cbae6-a56c-4197-b44d-26078a3b1f95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:06.769402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349cbae6-a56c-4197-b44d-26078a3b1f95 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:06.781285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 458/911] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 13:46:06 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:46:06.814618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972525fc-fd52-44ff-a59d-3eeffbe81e64 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:06.853473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8dfa1-8b67-4929-916b-b8f9ea963d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:06.854016 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8dfa1-8b67-4929-916b-b8f9ea963d2d None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:06.854301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8dfa1-8b67-4929-916b-b8f9ea963d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:06.854578 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8dfa1-8b67-4929-916b-b8f9ea963d2d None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:06.855190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8dfa1-8b67-4929-916b-b8f9ea963d2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:06.856612 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8dfa1-8b67-4929-916b-b8f9ea963d2d None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:06.863713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 454/912] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 13:46:06 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:46:07.464997 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dfa2a-c858-4dbe-9a53-6381e1c9c854 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:07.465511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dfa2a-c858-4dbe-9a53-6381e1c9c854 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:07.465511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dfa2a-c858-4dbe-9a53-6381e1c9c854 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:07.467020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 459/913] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:07.472182 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3e1ce-86f0-441f-9632-f3b380ead74b None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:07.472470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3e1ce-86f0-441f-9632-f3b380ead74b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:07.472749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3e1ce-86f0-441f-9632-f3b380ead74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:07.490827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-96d3e1ce-86f0-441f-9632-f3b380ead74b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:07.492023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-96d3e1ce-86f0-441f-9632-f3b380ead74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:07.562279 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 455/914] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:07.832282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dfa2a-c858-4dbe-9a53-6381e1c9c854 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:07.862102 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfdfa6-ba76-4434-8c6e-ce2a5a21b7d7 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:07.862644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfdfa6-ba76-4434-8c6e-ce2a5a21b7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:07.862644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfdfa6-ba76-4434-8c6e-ce2a5a21b7d7 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:07.864237 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 456/915] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:46:07.868944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b761d-09a2-40c3-ba7f-e47b5ecc4d3c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:07.869292 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b761d-09a2-40c3-ba7f-e47b5ecc4d3c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:07.869629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b761d-09a2-40c3-ba7f-e47b5ecc4d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:07.887799 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-017b761d-09a2-40c3-ba7f-e47b5ecc4d3c None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:07.889107 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-017b761d-09a2-40c3-ba7f-e47b5ecc4d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:07.902577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:07.959727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dfa2a-c858-4dbe-9a53-6381e1c9c854 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:07.989129 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 457/916] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:08.002457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53433a54-0a95-42ae-ba69-145db97b9359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:08.003483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53433a54-0a95-42ae-ba69-145db97b9359 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:08.003956 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53433a54-0a95-42ae-ba69-145db97b9359 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:08.004418 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53433a54-0a95-42ae-ba69-145db97b9359 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:08.005174 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53433a54-0a95-42ae-ba69-145db97b9359 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:08.007035 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53433a54-0a95-42ae-ba69-145db97b9359 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-53433a54-0a95-42ae-ba69-145db97b9359 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:08.017481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:08.018684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:08.019555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:08.019555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:08.019555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:08.019555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:08.019555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:08.019555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:08.019555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:08.019555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:08.019555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:08.019555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:08.019555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:08.019555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:08.019555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:46:08.019555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:08.021796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 460/917] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 13:46:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:08.027923 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b761d-09a2-40c3-ba7f-e47b5ecc4d3c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:08.129452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b761d-09a2-40c3-ba7f-e47b5ecc4d3c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:08.176625 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6a459-ef3e-4033-b8aa-7a3f9299f827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:08.177521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a459-ef3e-4033-b8aa-7a3f9299f827 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:08.178005 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a459-ef3e-4033-b8aa-7a3f9299f827 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:08.178482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a459-ef3e-4033-b8aa-7a3f9299f827 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:08.179330 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6a459-ef3e-4033-b8aa-7a3f9299f827 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:08.179832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6a459-ef3e-4033-b8aa-7a3f9299f827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:08.181455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6a459-ef3e-4033-b8aa-7a3f9299f827 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:08.187313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 458/918] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 13:46:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:08.195769 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53433a54-0a95-42ae-ba69-145db97b9359 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:08.232155 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:08.301417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53433a54-0a95-42ae-ba69-145db97b9359 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:08.311926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6a459-ef3e-4033-b8aa-7a3f9299f827 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:08.324265 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:08.347184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe70b7-e795-492f-957f-ed1fc4791a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:08.348435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe70b7-e795-492f-957f-ed1fc4791a9e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:08.349066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe70b7-e795-492f-957f-ed1fc4791a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:08.349558 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe70b7-e795-492f-957f-ed1fc4791a9e None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:08.350922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe70b7-e795-492f-957f-ed1fc4791a9e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:08.351411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe70b7-e795-492f-957f-ed1fc4791a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:08.353276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe70b7-e795-492f-957f-ed1fc4791a9e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:08.359954 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 461/919] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 13:46:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:08.365457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe70b7-e795-492f-957f-ed1fc4791a9e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:08.437217 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6a459-ef3e-4033-b8aa-7a3f9299f827 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:08.481574 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e6e10-6785-4af6-a456-0abd666b88ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:08.482366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e6e10-6785-4af6-a456-0abd666b88ce None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:08.482717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e6e10-6785-4af6-a456-0abd666b88ce None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:08.483259 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e6e10-6785-4af6-a456-0abd666b88ce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:08.491931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:08.496312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe70b7-e795-492f-957f-ed1fc4791a9e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:08.497067 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e6e10-6785-4af6-a456-0abd666b88ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-c26e6e10-6785-4af6-a456-0abd666b88ce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:46:08.503749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:08.511120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:08.511992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:08.511992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:08.511992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:08.511992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:08.511992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:46:08.511992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:46:08.511992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:46:08.511992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:46:08.511992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:46:08.511992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:46:08.511992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:46:08.511992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:08.511992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 459/920] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Sep 1 13:46:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:46:08.513922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e6e10-6785-4af6-a456-0abd666b88ce None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:08.540166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21615840-8a44-483c-857f-1b6e262badc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:08.540828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615840-8a44-483c-857f-1b6e262badc1 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:08.541307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615840-8a44-483c-857f-1b6e262badc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:08.541497 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615840-8a44-483c-857f-1b6e262badc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:08.542163 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21615840-8a44-483c-857f-1b6e262badc1 None admin] RBAC: Adding query filter params (interface=public, service_id=47229f1973bd4e59baf62c7330ac813a, region_id=RegionOne) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:08.542478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21615840-8a44-483c-857f-1b6e262badc1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:08.543850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21615840-8a44-483c-857f-1b6e262badc1 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:08.550562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 462/921] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 13:46:08 2022] GET /identity/v3/endpoints?service_id=47229f1973bd4e59baf62c7330ac813a&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:08.555492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21615840-8a44-483c-857f-1b6e262badc1 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:08.605426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:08.640365 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e6e10-6785-4af6-a456-0abd666b88ce None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:08.679290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21615840-8a44-483c-857f-1b6e262badc1 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:08.686941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339d731-e804-467c-8b6a-1be37066bb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:08.689421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339d731-e804-467c-8b6a-1be37066bb5f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:08.690067 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339d731-e804-467c-8b6a-1be37066bb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:08.691253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339d731-e804-467c-8b6a-1be37066bb5f None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:08.692128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339d731-e804-467c-8b6a-1be37066bb5f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:08.693009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339d731-e804-467c-8b6a-1be37066bb5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:08.694848 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339d731-e804-467c-8b6a-1be37066bb5f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:08.711706 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 460/922] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Sep 1 13:46:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:08.712840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339d731-e804-467c-8b6a-1be37066bb5f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:08.723159 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd68fb-33ec-4c6e-ae82-06a71fc9cb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:08.724075 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd68fb-33ec-4c6e-ae82-06a71fc9cb0a None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:08.724651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd68fb-33ec-4c6e-ae82-06a71fc9cb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:08.725119 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd68fb-33ec-4c6e-ae82-06a71fc9cb0a None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:08.725929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd68fb-33ec-4c6e-ae82-06a71fc9cb0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:08.727473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd68fb-33ec-4c6e-ae82-06a71fc9cb0a None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:08.734101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 463/923] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 13:46:08 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:46:08.828210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339d731-e804-467c-8b6a-1be37066bb5f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:08.835278 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5863ba-4039-4c73-ba6f-f13944817387 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:08.835677 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5863ba-4039-4c73-ba6f-f13944817387 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:08.835895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5863ba-4039-4c73-ba6f-f13944817387 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:08.837268 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 464/924] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:46:08.842984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ae416-9054-4f8d-95b6-520d83b9e0dd None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:08.843379 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ae416-9054-4f8d-95b6-520d83b9e0dd None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:08.843773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ae416-9054-4f8d-95b6-520d83b9e0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:08.863060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-689ae416-9054-4f8d-95b6-520d83b9e0dd None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:08.864312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-689ae416-9054-4f8d-95b6-520d83b9e0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:08.865831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:08.873598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44896081-5346-4ec9-92b9-b04370b16dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:08.874265 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44896081-5346-4ec9-92b9-b04370b16dbc None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:08.874553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44896081-5346-4ec9-92b9-b04370b16dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:08.874819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44896081-5346-4ec9-92b9-b04370b16dbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:08.888094 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44896081-5346-4ec9-92b9-b04370b16dbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:08.889579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44896081-5346-4ec9-92b9-b04370b16dbc None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:08.891467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-44896081-5346-4ec9-92b9-b04370b16dbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:46:08.906391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:08.908018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:46:08.908916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:46:08.908916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:08.908916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:08.908916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 461/925] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:08.909913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3829c-1e82-4c83-956a-7dccb4536450 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:08.910427 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3829c-1e82-4c83-956a-7dccb4536450 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:08.910953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3829c-1e82-4c83-956a-7dccb4536450 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:08.912245 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 462/926] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:08.917212 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3829c-1e82-4c83-956a-7dccb4536450 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:08.943661 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 465/927] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:08.945014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250724ba-a234-41aa-8cc4-25f5a711a8c7 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:08.945405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250724ba-a234-41aa-8cc4-25f5a711a8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:08.945699 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250724ba-a234-41aa-8cc4-25f5a711a8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:08.969773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-250724ba-a234-41aa-8cc4-25f5a711a8c7 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:08.972086 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-250724ba-a234-41aa-8cc4-25f5a711a8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:09.038561 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3829c-1e82-4c83-956a-7dccb4536450 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:09.067986 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 466/928] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:09.078536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d412e3b-4f34-41f8-95ca-5e26455df295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:09.079642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d412e3b-4f34-41f8-95ca-5e26455df295 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:09.080022 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d412e3b-4f34-41f8-95ca-5e26455df295 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:09.080291 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d412e3b-4f34-41f8-95ca-5e26455df295 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:09.080942 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d412e3b-4f34-41f8-95ca-5e26455df295 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:09.081244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d412e3b-4f34-41f8-95ca-5e26455df295 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:09.082605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d412e3b-4f34-41f8-95ca-5e26455df295 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:09.095899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 463/929] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:09.101469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250724ba-a234-41aa-8cc4-25f5a711a8c7 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:09.208971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:09.210970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d412e3b-4f34-41f8-95ca-5e26455df295 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:09.221848 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250724ba-a234-41aa-8cc4-25f5a711a8c7 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:09.256079 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721a23b-49ef-4da2-8890-55bb1b9da65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:09.257110 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721a23b-49ef-4da2-8890-55bb1b9da65d None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:09.257446 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721a23b-49ef-4da2-8890-55bb1b9da65d None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:09.257888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721a23b-49ef-4da2-8890-55bb1b9da65d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:09.265605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721a23b-49ef-4da2-8890-55bb1b9da65d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:09.268032 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721a23b-49ef-4da2-8890-55bb1b9da65d None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:09.272234 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-7721a23b-49ef-4da2-8890-55bb1b9da65d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:46:09.280447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:09.286145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:09.287290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:09.287290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:09.287290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:46:09.287290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:46:09.287290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:46:09.287290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:46:09.287290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:46:09.287290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:46:09.287290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:46:09.287290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:09.287290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 467/930] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 13:46:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:09.288086 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721a23b-49ef-4da2-8890-55bb1b9da65d None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:09.339965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d412e3b-4f34-41f8-95ca-5e26455df295 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:09.386251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77224020-dc0e-4276-a615-3e943c11f3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:09.387173 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77224020-dc0e-4276-a615-3e943c11f3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:09.387460 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77224020-dc0e-4276-a615-3e943c11f3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:09.387737 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77224020-dc0e-4276-a615-3e943c11f3d5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:09.388420 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77224020-dc0e-4276-a615-3e943c11f3d5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:09.389801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77224020-dc0e-4276-a615-3e943c11f3d5 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-77224020-dc0e-4276-a615-3e943c11f3d5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:09.400587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:09.401610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:09.402451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:09.402451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:09.402451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:09.402451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:09.402451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:09.402451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:09.402451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:09.402451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:09.402451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:09.402451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:09.402451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:09.402451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:09.402451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 13:46:09.402451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:09.402451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 464/931] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:46:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:46:09.403806 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77224020-dc0e-4276-a615-3e943c11f3d5 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:09.422740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721a23b-49ef-4da2-8890-55bb1b9da65d None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:09.458549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebe44e-6082-4678-8715-6c544ef245e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:09.459358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebe44e-6082-4678-8715-6c544ef245e6 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:09.459585 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebe44e-6082-4678-8715-6c544ef245e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:09.459855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebe44e-6082-4678-8715-6c544ef245e6 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:09.460608 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebe44e-6082-4678-8715-6c544ef245e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:09.460909 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebe44e-6082-4678-8715-6c544ef245e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:09.462324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebe44e-6082-4678-8715-6c544ef245e6 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:09.481050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 468/932] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Sep 1 13:46:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:09.481874 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebe44e-6082-4678-8715-6c544ef245e6 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:09.491451 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:09.514138 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77224020-dc0e-4276-a615-3e943c11f3d5 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:09.522127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:09.552608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2636bb2-e1f0-4a88-85fe-f435f0b869f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:09.553623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2636bb2-e1f0-4a88-85fe-f435f0b869f0 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:09.554114 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2636bb2-e1f0-4a88-85fe-f435f0b869f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:09.554392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2636bb2-e1f0-4a88-85fe-f435f0b869f0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:09.555134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2636bb2-e1f0-4a88-85fe-f435f0b869f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:09.556478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2636bb2-e1f0-4a88-85fe-f435f0b869f0 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-a2636bb2-e1f0-4a88-85fe-f435f0b869f0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:09.568313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:09.569345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:09.570967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:09.570967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:09.570967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:09.570967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:09.570967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:09.570967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:09.570967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:09.570967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:09.570967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:09.570967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:09.570967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:09.570967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:09.570967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 13:46:09.570967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:09.570967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 465/933] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Sep 1 13:46:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:09.571810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2636bb2-e1f0-4a88-85fe-f435f0b869f0 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:09.593772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebe44e-6082-4678-8715-6c544ef245e6 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:09.630065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12823d15-5ddc-4eff-93fd-b85c936fbc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:09.630670 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12823d15-5ddc-4eff-93fd-b85c936fbc98 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:09.630953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12823d15-5ddc-4eff-93fd-b85c936fbc98 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:09.631229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12823d15-5ddc-4eff-93fd-b85c936fbc98 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:09.632143 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12823d15-5ddc-4eff-93fd-b85c936fbc98 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:09.632455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12823d15-5ddc-4eff-93fd-b85c936fbc98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:09.633818 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12823d15-5ddc-4eff-93fd-b85c936fbc98 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:09.638498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 469/934] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:46:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:09.639270 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12823d15-5ddc-4eff-93fd-b85c936fbc98 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:09.685514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2636bb2-e1f0-4a88-85fe-f435f0b869f0 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:09.718953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:09.720320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49639f-a23d-4e61-8bbc-d263d9179e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:09.720960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49639f-a23d-4e61-8bbc-d263d9179e39 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:09.721247 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49639f-a23d-4e61-8bbc-d263d9179e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:09.721521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49639f-a23d-4e61-8bbc-d263d9179e39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:09.731734 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49639f-a23d-4e61-8bbc-d263d9179e39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:09.733265 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49639f-a23d-4e61-8bbc-d263d9179e39 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-3c49639f-a23d-4e61-8bbc-d263d9179e39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:46:09.749469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:09.750588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:46:09.751497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:46:09.751497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:09.751497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:09.751497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 466/935] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:09.751497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49639f-a23d-4e61-8bbc-d263d9179e39 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:09.760787 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12823d15-5ddc-4eff-93fd-b85c936fbc98 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:09.778111 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:09.799479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12572b-1503-45c2-bbf5-31fc62e028ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:09.800125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12572b-1503-45c2-bbf5-31fc62e028ac None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:09.800413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12572b-1503-45c2-bbf5-31fc62e028ac None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:09.800690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12572b-1503-45c2-bbf5-31fc62e028ac None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:09.801325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12572b-1503-45c2-bbf5-31fc62e028ac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:09.801637 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12572b-1503-45c2-bbf5-31fc62e028ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:09.803005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12572b-1503-45c2-bbf5-31fc62e028ac None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:09.807830 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 470/936] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 13:46:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:09.808563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12572b-1503-45c2-bbf5-31fc62e028ac None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:09.864550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49639f-a23d-4e61-8bbc-d263d9179e39 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:09.901747 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a709483-375e-45fc-bcaa-7d7fa389bef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:09.902432 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a709483-375e-45fc-bcaa-7d7fa389bef0 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:09.902629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a709483-375e-45fc-bcaa-7d7fa389bef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:09.902908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a709483-375e-45fc-bcaa-7d7fa389bef0 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:09.903539 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a709483-375e-45fc-bcaa-7d7fa389bef0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:09.903846 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a709483-375e-45fc-bcaa-7d7fa389bef0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:09.905267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a709483-375e-45fc-bcaa-7d7fa389bef0 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:09.911888 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 467/937] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Sep 1 13:46:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:09.912591 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a709483-375e-45fc-bcaa-7d7fa389bef0 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:09.927494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12572b-1503-45c2-bbf5-31fc62e028ac None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:09.963128 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11c6fe-edfb-4191-8bf7-ad91149da78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:09.963732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11c6fe-edfb-4191-8bf7-ad91149da78a None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:09.964042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11c6fe-edfb-4191-8bf7-ad91149da78a None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:09.964321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11c6fe-edfb-4191-8bf7-ad91149da78a None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:09.964944 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11c6fe-edfb-4191-8bf7-ad91149da78a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:09.965249 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11c6fe-edfb-4191-8bf7-ad91149da78a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:09.966601 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11c6fe-edfb-4191-8bf7-ad91149da78a None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:09.968215 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:09.984258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 471/938] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:09.984258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11c6fe-edfb-4191-8bf7-ad91149da78a None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:10.011531 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:10.026329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a709483-375e-45fc-bcaa-7d7fa389bef0 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:10.063689 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd5a26-2d65-4ffe-b124-acba1030ea3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:10.064837 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd5a26-2d65-4ffe-b124-acba1030ea3c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:10.065116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd5a26-2d65-4ffe-b124-acba1030ea3c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:10.065391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd5a26-2d65-4ffe-b124-acba1030ea3c None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:10.066019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd5a26-2d65-4ffe-b124-acba1030ea3c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:10.066860 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd5a26-2d65-4ffe-b124-acba1030ea3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:10.068300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd5a26-2d65-4ffe-b124-acba1030ea3c None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:10.080119 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 468/939] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 13:46:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:10.080119 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd5a26-2d65-4ffe-b124-acba1030ea3c None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:10.092276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11c6fe-edfb-4191-8bf7-ad91149da78a None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:10.130113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf9a08-e7eb-4276-86cd-8acf365ced82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:10.131022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf9a08-e7eb-4276-86cd-8acf365ced82 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:10.131302 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf9a08-e7eb-4276-86cd-8acf365ced82 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:10.131576 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf9a08-e7eb-4276-86cd-8acf365ced82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:10.132693 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf9a08-e7eb-4276-86cd-8acf365ced82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:10.134442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf9a08-e7eb-4276-86cd-8acf365ced82 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:10.190897 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd5a26-2d65-4ffe-b124-acba1030ea3c None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:10.219898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 472/940] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 13:46:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:46:10.219898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf9a08-e7eb-4276-86cd-8acf365ced82 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:10.247066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39d83b-8375-4cad-b50c-6b1ad2a4c1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:10.247751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39d83b-8375-4cad-b50c-6b1ad2a4c1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:10.248125 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39d83b-8375-4cad-b50c-6b1ad2a4c1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:10.248468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39d83b-8375-4cad-b50c-6b1ad2a4c1e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:10.260602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39d83b-8375-4cad-b50c-6b1ad2a4c1e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:10.263241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39d83b-8375-4cad-b50c-6b1ad2a4c1e3 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:10.279466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-1b39d83b-8375-4cad-b50c-6b1ad2a4c1e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:10.279466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:10.279466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:10.279466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:10.279466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:10.279466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:10.279466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:10.279466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:10.279466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:10.279466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:10.279466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:10.279466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:10.279466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:46:10.279466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:46:10.279466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:10.280454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:10.281346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:46:10.281346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:46:10.281346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:46:10.281346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:46:10.281346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:46:10.281346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:46:10.281346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:10.281346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:10.281346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 469/941] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:46:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:10.289470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39d83b-8375-4cad-b50c-6b1ad2a4c1e3 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:10.291363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:10.328270 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:10.368515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf9a08-e7eb-4276-86cd-8acf365ced82 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:10.412037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bde5f-8594-49ed-8d20-65b6816988c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:10.412660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bde5f-8594-49ed-8d20-65b6816988c1 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:10.412940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bde5f-8594-49ed-8d20-65b6816988c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:10.413214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bde5f-8594-49ed-8d20-65b6816988c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:10.413954 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bde5f-8594-49ed-8d20-65b6816988c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:10.415326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bde5f-8594-49ed-8d20-65b6816988c1 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:10.424840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39d83b-8375-4cad-b50c-6b1ad2a4c1e3 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:10.462472 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb68135-e7b0-407f-91a8-9958c06a0141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:10.463093 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb68135-e7b0-407f-91a8-9958c06a0141 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:10.463378 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb68135-e7b0-407f-91a8-9958c06a0141 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:10.463654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb68135-e7b0-407f-91a8-9958c06a0141 None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:10.464394 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb68135-e7b0-407f-91a8-9958c06a0141 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:10.464707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb68135-e7b0-407f-91a8-9958c06a0141 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:10.466249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb68135-e7b0-407f-91a8-9958c06a0141 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:10.479848 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 470/942] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:46:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:10.485689 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb68135-e7b0-407f-91a8-9958c06a0141 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:10.525649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 473/943] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 13:46:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:46:10.558564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:10.599722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb68135-e7b0-407f-91a8-9958c06a0141 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:10.646082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58210a-3f5e-4783-9c43-0593ba076c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:10.646760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58210a-3f5e-4783-9c43-0593ba076c7d None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:10.647046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58210a-3f5e-4783-9c43-0593ba076c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:10.647322 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58210a-3f5e-4783-9c43-0593ba076c7d None admin] PATH_INFO: `/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/98320a8730d245f6b7fa014273604ed5/roles/304f77f2646444858d534f43683d186a` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:10.649569 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58210a-3f5e-4783-9c43-0593ba076c7d None admin] RBAC: Authorizing `identity:create_grant(project_id=5e7998cc03064a0bb9a9dc6a1475d73c, user_id=98320a8730d245f6b7fa014273604ed5, role_id=304f77f2646444858d534f43683d186a)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:10.651025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58210a-3f5e-4783-9c43-0593ba076c7d None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:10.718174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 471/944] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:46:10 2022] PUT /identity/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/98320a8730d245f6b7fa014273604ed5/roles/304f77f2646444858d534f43683d186a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:46:10.765411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994e2e8-9933-4f48-bea3-7632d19914a2 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:10.765986 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994e2e8-9933-4f48-bea3-7632d19914a2 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:10.766065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994e2e8-9933-4f48-bea3-7632d19914a2 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:10.767924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 474/945] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:10.774058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163b79f-1930-4523-83c7-aad134bce834 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:10.774424 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163b79f-1930-4523-83c7-aad134bce834 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:10.774652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163b79f-1930-4523-83c7-aad134bce834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:10.795436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-4163b79f-1930-4523-83c7-aad134bce834 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:10.796682 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4163b79f-1930-4523-83c7-aad134bce834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:10.873368 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 472/946] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:11.143522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994e2e8-9933-4f48-bea3-7632d19914a2 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:11.261601 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994e2e8-9933-4f48-bea3-7632d19914a2 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:11.269146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:11.297892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc181ee-7402-4ed2-be92-4cc7e7f8329c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:11.298552 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc181ee-7402-4ed2-be92-4cc7e7f8329c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:11.298841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc181ee-7402-4ed2-be92-4cc7e7f8329c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:11.299116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc181ee-7402-4ed2-be92-4cc7e7f8329c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:11.299711 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc181ee-7402-4ed2-be92-4cc7e7f8329c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:11.301107 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc181ee-7402-4ed2-be92-4cc7e7f8329c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-3bc181ee-7402-4ed2-be92-4cc7e7f8329c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:11.310126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:11.311082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:11.311955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:11.311955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:11.311955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:11.311955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:11.311955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:11.311955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:11.311955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:11.311955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:11.311955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:11.311955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:11.311955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:11.311955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:11.311955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:46:11.311955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:11.311955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 475/947] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 13:46:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:11.321584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163b79f-1930-4523-83c7-aad134bce834 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:11.379609 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:11.437951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163b79f-1930-4523-83c7-aad134bce834 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:11.473718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc077e-2fd9-4047-aa53-ef14b8e2137a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:11.474335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc077e-2fd9-4047-aa53-ef14b8e2137a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:11.474622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc077e-2fd9-4047-aa53-ef14b8e2137a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:11.474903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc077e-2fd9-4047-aa53-ef14b8e2137a None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:11.475530 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc077e-2fd9-4047-aa53-ef14b8e2137a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:11.475840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc077e-2fd9-4047-aa53-ef14b8e2137a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:11.477236 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc077e-2fd9-4047-aa53-ef14b8e2137a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:11.482250 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 473/948] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 13:46:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:11.488531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc181ee-7402-4ed2-be92-4cc7e7f8329c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:11.600386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc181ee-7402-4ed2-be92-4cc7e7f8329c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:11.638280 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bd870-8f7a-457f-948b-f59a0a628283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:11.638958 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bd870-8f7a-457f-948b-f59a0a628283 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:11.639248 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bd870-8f7a-457f-948b-f59a0a628283 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:11.639527 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bd870-8f7a-457f-948b-f59a0a628283 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:11.640206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bd870-8f7a-457f-948b-f59a0a628283 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:11.640516 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bd870-8f7a-457f-948b-f59a0a628283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:11.641929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bd870-8f7a-457f-948b-f59a0a628283 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:11.652051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 476/949] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 13:46:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:11.656975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc077e-2fd9-4047-aa53-ef14b8e2137a None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:11.763217 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc077e-2fd9-4047-aa53-ef14b8e2137a None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:11.781205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:11.799707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f65b0-fceb-47c2-8bf0-9a314bc8de3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:11.802399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f65b0-fceb-47c2-8bf0-9a314bc8de3e None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:11.802399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f65b0-fceb-47c2-8bf0-9a314bc8de3e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:11.802399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f65b0-fceb-47c2-8bf0-9a314bc8de3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:11.802399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f65b0-fceb-47c2-8bf0-9a314bc8de3e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:11.802871 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f65b0-fceb-47c2-8bf0-9a314bc8de3e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:11.893437 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 474/950] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 13:46:11 2022] POST /identity/v3/endpoints => generated 349 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:46:12.256125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9e2e0-1c58-4140-87a0-1fc78bf151bb None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:12.257003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9e2e0-1c58-4140-87a0-1fc78bf151bb None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:12.257003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9e2e0-1c58-4140-87a0-1fc78bf151bb None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:12.258590 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 477/951] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:12.266617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d62ec2-512f-4f40-afe3-0cfe7e33640d None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:12.266901 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d62ec2-512f-4f40-afe3-0cfe7e33640d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:12.267173 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d62ec2-512f-4f40-afe3-0cfe7e33640d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:12.287398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-59d62ec2-512f-4f40-afe3-0cfe7e33640d None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:12.288788 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-59d62ec2-512f-4f40-afe3-0cfe7e33640d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:12.368305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 475/952] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:12.637697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9e2e0-1c58-4140-87a0-1fc78bf151bb None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:12.639336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a932f79-f128-431d-b28e-a77a7e569a27 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:12.639635 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a932f79-f128-431d-b28e-a77a7e569a27 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:12.639938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a932f79-f128-431d-b28e-a77a7e569a27 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:12.641618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 476/953] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:12.646994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37fc25-6001-4a88-b161-351688f37b7a None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:12.647276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37fc25-6001-4a88-b161-351688f37b7a None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:12.647554 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37fc25-6001-4a88-b161-351688f37b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:12.666487 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-9d37fc25-6001-4a88-b161-351688f37b7a None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:12.667688 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-9d37fc25-6001-4a88-b161-351688f37b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:12.676890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:12.739840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 477/954] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:12.741401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec609d-71a8-4a8a-ac36-e6b2e63e08ab None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:12.741683 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec609d-71a8-4a8a-ac36-e6b2e63e08ab None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:12.741951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec609d-71a8-4a8a-ac36-e6b2e63e08ab None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:12.743298 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 478/955] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:12.748208 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec7344-35a0-4a48-9a12-dcaededaa748 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:12.748541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec7344-35a0-4a48-9a12-dcaededaa748 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:12.748988 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec7344-35a0-4a48-9a12-dcaededaa748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:12.754799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9e2e0-1c58-4140-87a0-1fc78bf151bb None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:12.768055 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-faec7344-35a0-4a48-9a12-dcaededaa748 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:12.769017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-faec7344-35a0-4a48-9a12-dcaededaa748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:12.793448 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:12.804035 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba7a51-d2ec-4673-86b8-18a06def6ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:12.804897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba7a51-d2ec-4673-86b8-18a06def6ef6 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:12.805481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba7a51-d2ec-4673-86b8-18a06def6ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:12.808900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba7a51-d2ec-4673-86b8-18a06def6ef6 None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:12.808900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba7a51-d2ec-4673-86b8-18a06def6ef6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:12.808900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba7a51-d2ec-4673-86b8-18a06def6ef6 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:12.812386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: WARNING keystone.server.flask.common [None req-62ba7a51-d2ec-4673-86b8-18a06def6ef6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 13:46:12.840284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 479/956] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:12.885194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.sql.core [None req-62ba7a51-d2ec-4673-86b8-18a06def6ef6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 13:46:12.885194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 13:46:12.885194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [parameters: {'id': '8088657c5cf54b01951d491de064346e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 13:46:12.885194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81700) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 13:46:12.894428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-62ba7a51-d2ec-4673-86b8-18a06def6ef6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8088657c5cf54b01951d491de064346e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8088657c5cf54b01951d491de064346e. Sep 01 13:46:12.894428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:12.894428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 13:46:12.894428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 13:46:12.894428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 13:46:12.894428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 13:46:12.894428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 13:46:12.894428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 13:46:12.894428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 13:46:12.894428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application conn.query(q) Sep 01 13:46:12.894428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 13:46:12.894428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 13:46:12.894428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application result.read() Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 13:46:12.895250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application next(self.gen) Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application yield resource Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application next(self.gen) Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise self.value Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application session.commit() Sep 01 13:46:12.896351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self.session.flush() Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application compat.raise_( Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 13:46:12.897498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 13:46:12.898783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 13:46:12.898783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 13:46:12.898783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 13:46:12.898783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 13:46:12.898783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 13:46:12.898783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 13:46:12.898783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 13:46:12.898783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 13:46:12.898783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 13:46:12.898783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 13:46:12.898783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 13:46:12.898783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 13:46:12.898783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 13:46:12.898783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 13:46:12.898783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application conn.query(q) Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application result.read() Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 13:46:12.899858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 13:46:12.901051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 13:46:12.901051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 13:46:12.901051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 13:46:12.901051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 13:46:12.901051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 13:46:12.901051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 13:46:12.901051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 13:46:12.901051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 13:46:12.901051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [parameters: {'id': '8088657c5cf54b01951d491de064346e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 13:46:12.901051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 13:46:12.901051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:12.901051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:12.901051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:12.901051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:12.901051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:12.902085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:12.903326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:12.903326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 13:46:12.903326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 13:46:12.903326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:12.903326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:12.903326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 13:46:12.903326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 13:46:12.903326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8088657c5cf54b01951d491de064346e. Sep 01 13:46:12.903326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:12.910724 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 478/957] 10.222.0.64 () {60 vars in 1140 bytes} [Thu Sep 1 13:46:12 2022] POST /identity/v3/projects => generated 262 bytes in 268 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:12.912777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec7344-35a0-4a48-9a12-dcaededaa748 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:13.015966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba7a51-d2ec-4673-86b8-18a06def6ef6 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:13.026392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec7344-35a0-4a48-9a12-dcaededaa748 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:13.063486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc5587-064f-4e69-a45f-02d051655ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:13.064157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc5587-064f-4e69-a45f-02d051655ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:13.064442 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc5587-064f-4e69-a45f-02d051655ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:13.064719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc5587-064f-4e69-a45f-02d051655ed4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:13.071724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc5587-064f-4e69-a45f-02d051655ed4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:13.073266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc5587-064f-4e69-a45f-02d051655ed4 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:13.085044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-72cc5587-064f-4e69-a45f-02d051655ed4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:13.085044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:13.085044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:13.085044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:13.085044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:13.085044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:13.085044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:13.085044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:13.085044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:13.085044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:13.085044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:13.085044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:13.085044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:46:13.085044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:46:13.085044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:13.086017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:13.086990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:46:13.086990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:46:13.086990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:46:13.086990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:46:13.086990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:46:13.086990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:46:13.086990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:13.086990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:13.091091 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 480/958] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:46:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:13.091954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc5587-064f-4e69-a45f-02d051655ed4 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:13.114131 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:13.139542 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:13.151367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba7a51-d2ec-4673-86b8-18a06def6ef6 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:13.188742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c05ba-523c-4999-9b68-b122e5241329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:13.189432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c05ba-523c-4999-9b68-b122e5241329 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:13.189660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c05ba-523c-4999-9b68-b122e5241329 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:13.189933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c05ba-523c-4999-9b68-b122e5241329 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:13.190518 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c05ba-523c-4999-9b68-b122e5241329 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:13.192111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c05ba-523c-4999-9b68-b122e5241329 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-977c05ba-523c-4999-9b68-b122e5241329 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:13.200833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:13.201900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:13.202761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:13.202761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:13.202761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:13.202761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:13.202761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:13.202761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:13.202761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:13.202761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:13.202761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:13.202761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:13.202761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:13.202761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:13.202761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:46:13.202761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:13.202761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 479/959] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:46:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:46:13.203620 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c05ba-523c-4999-9b68-b122e5241329 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:13.206864 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc5587-064f-4e69-a45f-02d051655ed4 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:13.242800 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b35fc-0da8-423d-a016-ac72fd5b19b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:13.243406 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b35fc-0da8-423d-a016-ac72fd5b19b7 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:13.243687 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b35fc-0da8-423d-a016-ac72fd5b19b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:13.244062 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b35fc-0da8-423d-a016-ac72fd5b19b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:13.244736 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b35fc-0da8-423d-a016-ac72fd5b19b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:13.244998 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b35fc-0da8-423d-a016-ac72fd5b19b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:13.246409 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b35fc-0da8-423d-a016-ac72fd5b19b7 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:13.264318 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 481/960] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 13:46:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:13.265146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b35fc-0da8-423d-a016-ac72fd5b19b7 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:13.335701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c05ba-523c-4999-9b68-b122e5241329 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:13.371026 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:13.380039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a578f-7152-455c-a6c7-7239a94af3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:13.381036 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a578f-7152-455c-a6c7-7239a94af3dc None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:13.381814 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a578f-7152-455c-a6c7-7239a94af3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:13.382276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a578f-7152-455c-a6c7-7239a94af3dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:13.398305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b35fc-0da8-423d-a016-ac72fd5b19b7 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:13.404465 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a578f-7152-455c-a6c7-7239a94af3dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-6d6a578f-7152-455c-a6c7-7239a94af3dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:46:13.412477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:13.414936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:13.415935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:13.415935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:13.415935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:13.415935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:13.415935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:46:13.415935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:46:13.415935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:46:13.415935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:46:13.415935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:46:13.415935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:46:13.415935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:46:13.415935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:13.415935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 480/961] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Sep 1 13:46:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:13.421872 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a578f-7152-455c-a6c7-7239a94af3dc None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:13.439982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:13.452623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f13484-4724-49c8-bdb6-3cecbb031aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:13.454876 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f13484-4724-49c8-bdb6-3cecbb031aef None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:13.454876 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f13484-4724-49c8-bdb6-3cecbb031aef None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:13.454876 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f13484-4724-49c8-bdb6-3cecbb031aef None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:13.455329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f13484-4724-49c8-bdb6-3cecbb031aef None admin] RBAC: Adding query filter params (name=compute) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:13.455842 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f13484-4724-49c8-bdb6-3cecbb031aef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:13.457447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f13484-4724-49c8-bdb6-3cecbb031aef None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:13.467840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 482/962] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 13:46:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:13.469999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f13484-4724-49c8-bdb6-3cecbb031aef None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:13.545411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a578f-7152-455c-a6c7-7239a94af3dc None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:13.598272 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2446dc-2e91-4efc-9180-3722689b78ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:13.599541 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2446dc-2e91-4efc-9180-3722689b78ff None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:13.600242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2446dc-2e91-4efc-9180-3722689b78ff None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:13.600521 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2446dc-2e91-4efc-9180-3722689b78ff None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:13.601220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2446dc-2e91-4efc-9180-3722689b78ff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:13.601529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2446dc-2e91-4efc-9180-3722689b78ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:13.602889 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2446dc-2e91-4efc-9180-3722689b78ff None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:13.607299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f13484-4724-49c8-bdb6-3cecbb031aef None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:13.615342 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 481/963] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Sep 1 13:46:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:13.620768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2446dc-2e91-4efc-9180-3722689b78ff None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:13.655558 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbebbc3-94db-4117-ab6d-4198903f42d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:13.658182 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbebbc3-94db-4117-ab6d-4198903f42d7 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:13.658703 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbebbc3-94db-4117-ab6d-4198903f42d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:13.659196 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbebbc3-94db-4117-ab6d-4198903f42d7 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:13.660070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbebbc3-94db-4117-ab6d-4198903f42d7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:13.660590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbebbc3-94db-4117-ab6d-4198903f42d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:13.662273 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbebbc3-94db-4117-ab6d-4198903f42d7 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:13.676450 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 483/964] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 13:46:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:13.713561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:13.738523 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2446dc-2e91-4efc-9180-3722689b78ff None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:13.777739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e5610-956b-4344-899c-46c23ac1bc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:13.778487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e5610-956b-4344-899c-46c23ac1bc37 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:13.778816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e5610-956b-4344-899c-46c23ac1bc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:13.779089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e5610-956b-4344-899c-46c23ac1bc37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:13.791629 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e5610-956b-4344-899c-46c23ac1bc37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:13.793237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e5610-956b-4344-899c-46c23ac1bc37 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-c34e5610-956b-4344-899c-46c23ac1bc37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:46:13.812443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:13.813522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:46:13.814456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:46:13.814456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:13.814456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:13.816776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 482/965] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:46:13.822281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbebbc3-94db-4117-ab6d-4198903f42d7 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:13.833078 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:13.841774 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f2bc8-75ae-4ce5-8090-467261803860 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:13.842058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f2bc8-75ae-4ce5-8090-467261803860 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:13.842338 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f2bc8-75ae-4ce5-8090-467261803860 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:13.844213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 483/966] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:46:13.849542 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427e185-ab72-41ae-9b1d-d3c18277a80e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:13.849983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427e185-ab72-41ae-9b1d-d3c18277a80e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:13.850366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427e185-ab72-41ae-9b1d-d3c18277a80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:13.872353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-f427e185-ab72-41ae-9b1d-d3c18277a80e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:13.874342 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f427e185-ab72-41ae-9b1d-d3c18277a80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:13.946527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbebbc3-94db-4117-ab6d-4198903f42d7 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:13.982325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 484/967] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:13.982554 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd110644-62db-42e8-948b-de84a3823891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:13.983050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd110644-62db-42e8-948b-de84a3823891 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:13.983360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd110644-62db-42e8-948b-de84a3823891 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:13.983596 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd110644-62db-42e8-948b-de84a3823891 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:13.991906 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd110644-62db-42e8-948b-de84a3823891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:13.991906 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd110644-62db-42e8-948b-de84a3823891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:13.991906 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd110644-62db-42e8-948b-de84a3823891 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:14.003619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 484/968] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:14.009722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427e185-ab72-41ae-9b1d-d3c18277a80e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:14.070618 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:14.114813 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427e185-ab72-41ae-9b1d-d3c18277a80e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:14.149686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d9063-65fd-4c94-a644-351765a64843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:14.150407 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d9063-65fd-4c94-a644-351765a64843 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:14.150744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d9063-65fd-4c94-a644-351765a64843 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:14.151074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d9063-65fd-4c94-a644-351765a64843 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:14.159138 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d9063-65fd-4c94-a644-351765a64843 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:14.160742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d9063-65fd-4c94-a644-351765a64843 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-542d9063-65fd-4c94-a644-351765a64843 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:46:14.172780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:14.174066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:14.175746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:14.175746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:14.175746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:46:14.175746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:46:14.175746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:46:14.175746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:46:14.175746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:46:14.175746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:46:14.175746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 13:46:14.175746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:14.179717 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 485/969] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 13:46:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:14.181741 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd110644-62db-42e8-948b-de84a3823891 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:14.255828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d9063-65fd-4c94-a644-351765a64843 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:14.256040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:14.305860 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd110644-62db-42e8-948b-de84a3823891 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:14.342771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6534e9-7d20-45d2-a0ea-8d2ff54f75d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:14.343388 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6534e9-7d20-45d2-a0ea-8d2ff54f75d8 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:14.343670 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6534e9-7d20-45d2-a0ea-8d2ff54f75d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:14.344516 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6534e9-7d20-45d2-a0ea-8d2ff54f75d8 None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:14.345259 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6534e9-7d20-45d2-a0ea-8d2ff54f75d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:14.345570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6534e9-7d20-45d2-a0ea-8d2ff54f75d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:14.347299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6534e9-7d20-45d2-a0ea-8d2ff54f75d8 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:14.359267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d9063-65fd-4c94-a644-351765a64843 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:14.366153 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 485/970] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Sep 1 13:46:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:14.371383 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6534e9-7d20-45d2-a0ea-8d2ff54f75d8 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:14.379506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:14.398951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277db0f2-39ae-433d-92cb-fd07d6d84b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:14.399698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277db0f2-39ae-433d-92cb-fd07d6d84b0e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:14.400092 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277db0f2-39ae-433d-92cb-fd07d6d84b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:14.400440 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277db0f2-39ae-433d-92cb-fd07d6d84b0e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:14.401101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277db0f2-39ae-433d-92cb-fd07d6d84b0e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:14.402569 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277db0f2-39ae-433d-92cb-fd07d6d84b0e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-277db0f2-39ae-433d-92cb-fd07d6d84b0e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:14.411840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:14.413133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:14.414203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:14.414203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:14.414203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:14.414203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:14.414203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:14.414203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:14.414203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:14.414203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:14.414203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:14.414203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:14.414203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:14.414203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:14.414203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:46:14.414203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:14.415125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 486/971] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 13:46:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:46:14.421095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277db0f2-39ae-433d-92cb-fd07d6d84b0e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:14.490264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6534e9-7d20-45d2-a0ea-8d2ff54f75d8 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:14.517438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:14.533105 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b0d3f-2ff2-4c8b-97ce-dbf98722ea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:14.533727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b0d3f-2ff2-4c8b-97ce-dbf98722ea74 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:14.534009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b0d3f-2ff2-4c8b-97ce-dbf98722ea74 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:14.534281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b0d3f-2ff2-4c8b-97ce-dbf98722ea74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:14.537967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277db0f2-39ae-433d-92cb-fd07d6d84b0e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:14.581988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997beb0d-9802-4f7c-83cc-433037562168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:14.583358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997beb0d-9802-4f7c-83cc-433037562168 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:14.583841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997beb0d-9802-4f7c-83cc-433037562168 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:14.584340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997beb0d-9802-4f7c-83cc-433037562168 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:14.585600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997beb0d-9802-4f7c-83cc-433037562168 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:14.586476 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997beb0d-9802-4f7c-83cc-433037562168 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:14.588314 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997beb0d-9802-4f7c-83cc-433037562168 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:14.600179 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 487/972] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 13:46:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:14.600880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997beb0d-9802-4f7c-83cc-433037562168 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:14.620307 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b0d3f-2ff2-4c8b-97ce-dbf98722ea74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:14.622282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b0d3f-2ff2-4c8b-97ce-dbf98722ea74 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:14.673304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:14.743813 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997beb0d-9802-4f7c-83cc-433037562168 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:14.747638 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 486/973] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:46:14 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 13:46:14.755398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b0d3f-2ff2-4c8b-97ce-dbf98722ea74 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:14.779027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:14.781103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9612b6-4df6-4a1f-965e-30846c1e1cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:14.781756 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9612b6-4df6-4a1f-965e-30846c1e1cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:14.782037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9612b6-4df6-4a1f-965e-30846c1e1cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:14.782510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9612b6-4df6-4a1f-965e-30846c1e1cb4 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:14.783168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9612b6-4df6-4a1f-965e-30846c1e1cb4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:14.783477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9612b6-4df6-4a1f-965e-30846c1e1cb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:14.785599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9612b6-4df6-4a1f-965e-30846c1e1cb4 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:14.792959 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 488/974] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 13:46:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:14.799518 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9612b6-4df6-4a1f-965e-30846c1e1cb4 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:14.862981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b0d3f-2ff2-4c8b-97ce-dbf98722ea74 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:14.901111 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dba368-51c8-48be-938c-780e1e4a802d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:14.901821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dba368-51c8-48be-938c-780e1e4a802d None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:14.902226 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dba368-51c8-48be-938c-780e1e4a802d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:14.902504 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dba368-51c8-48be-938c-780e1e4a802d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:14.914373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dba368-51c8-48be-938c-780e1e4a802d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:14.916076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dba368-51c8-48be-938c-780e1e4a802d None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:14.918879 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9612b6-4df6-4a1f-965e-30846c1e1cb4 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:14.931032 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-60dba368-51c8-48be-938c-780e1e4a802d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:46:14.933465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:14.934648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:46:14.935786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:46:14.935786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:14.935786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:14.937536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 487/975] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:46:14.959605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dba368-51c8-48be-938c-780e1e4a802d None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:14.972895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cbe1f-be4f-4ea2-982e-16b198929393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:14.973513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cbe1f-be4f-4ea2-982e-16b198929393 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:14.973792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cbe1f-be4f-4ea2-982e-16b198929393 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:14.974062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cbe1f-be4f-4ea2-982e-16b198929393 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:14.974766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cbe1f-be4f-4ea2-982e-16b198929393 None admin] RBAC: Adding query filter params (interface=admin, service_id=47229f1973bd4e59baf62c7330ac813a, region_id=RegionOne) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:14.975074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cbe1f-be4f-4ea2-982e-16b198929393 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:14.976587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cbe1f-be4f-4ea2-982e-16b198929393 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:14.982099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 489/976] 10.222.0.64 () {56 vars in 1249 bytes} [Thu Sep 1 13:46:14 2022] GET /identity/v3/endpoints?service_id=47229f1973bd4e59baf62c7330ac813a&interface=admin®ion_id=RegionOne => generated 193 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:14.988884 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cbe1f-be4f-4ea2-982e-16b198929393 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:15.047207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:15.071719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dba368-51c8-48be-938c-780e1e4a802d None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:15.111582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cbe1f-be4f-4ea2-982e-16b198929393 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:15.111794 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8ea11-4af0-4355-b2cf-bdb9060ee46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:15.112336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8ea11-4af0-4355-b2cf-bdb9060ee46d None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:15.112621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8ea11-4af0-4355-b2cf-bdb9060ee46d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:15.112899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8ea11-4af0-4355-b2cf-bdb9060ee46d None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:15.113543 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8ea11-4af0-4355-b2cf-bdb9060ee46d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:15.113853 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8ea11-4af0-4355-b2cf-bdb9060ee46d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:15.115819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f8ea11-4af0-4355-b2cf-bdb9060ee46d None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:15.128560 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 488/977] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:15.134438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8ea11-4af0-4355-b2cf-bdb9060ee46d None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:15.162458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f81c8-4584-42f5-8633-8365df68cf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:15.163532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f81c8-4584-42f5-8633-8365df68cf13 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:15.164059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f81c8-4584-42f5-8633-8365df68cf13 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:15.164593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f81c8-4584-42f5-8633-8365df68cf13 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:15.165499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f81c8-4584-42f5-8633-8365df68cf13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:15.167059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f81c8-4584-42f5-8633-8365df68cf13 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:15.174990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 490/978] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 13:46:14 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:46:15.268316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8ea11-4af0-4355-b2cf-bdb9060ee46d None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:15.309298 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658f887-b3b4-4b7f-a0eb-93bc51fdf2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:15.309876 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658f887-b3b4-4b7f-a0eb-93bc51fdf2df None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:15.310158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658f887-b3b4-4b7f-a0eb-93bc51fdf2df None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:15.310431 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658f887-b3b4-4b7f-a0eb-93bc51fdf2df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:15.313661 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:15.318605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658f887-b3b4-4b7f-a0eb-93bc51fdf2df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:15.320091 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658f887-b3b4-4b7f-a0eb-93bc51fdf2df None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:15.332408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-f658f887-b3b4-4b7f-a0eb-93bc51fdf2df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:15.332408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:15.332408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:15.332408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:15.332408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:15.332408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:15.332408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:15.332408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:15.332408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:15.332408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:15.332408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:15.332408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:15.332408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:46:15.332408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:46:15.332408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:15.333337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:15.334239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:46:15.334239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:46:15.334239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:46:15.334239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:46:15.334239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:46:15.334239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:46:15.334239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:15.334239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:15.334239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 489/979] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:15.341034 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f81c8-4584-42f5-8633-8365df68cf13 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:15.389391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:15.417812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a616191-e1a7-46c3-a25b-44a9a8aace85 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:15.418368 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a616191-e1a7-46c3-a25b-44a9a8aace85 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:15.418449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a616191-e1a7-46c3-a25b-44a9a8aace85 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:15.420440 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 490/980] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:46:15.430578 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660db1e7-e07f-4cdb-85c8-793fdf9c34ce None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:15.430874 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660db1e7-e07f-4cdb-85c8-793fdf9c34ce None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:15.431138 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660db1e7-e07f-4cdb-85c8-793fdf9c34ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:15.455356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-660db1e7-e07f-4cdb-85c8-793fdf9c34ce None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:15.457067 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-660db1e7-e07f-4cdb-85c8-793fdf9c34ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:15.466381 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f81c8-4584-42f5-8633-8365df68cf13 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:15.502211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bd521-add3-46a7-8abe-575b4f0f2d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:15.503216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bd521-add3-46a7-8abe-575b4f0f2d00 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:15.503697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bd521-add3-46a7-8abe-575b4f0f2d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:15.504201 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bd521-add3-46a7-8abe-575b4f0f2d00 None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:15.505089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bd521-add3-46a7-8abe-575b4f0f2d00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:15.505591 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bd521-add3-46a7-8abe-575b4f0f2d00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:15.507485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bd521-add3-46a7-8abe-575b4f0f2d00 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:15.520524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 491/981] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:15.529887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bd521-add3-46a7-8abe-575b4f0f2d00 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:15.540010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 491/982] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:15.644738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bd521-add3-46a7-8abe-575b4f0f2d00 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:15.646248 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:15.681213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f610c-b147-449d-95ae-6680bace11de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:15.681814 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f610c-b147-449d-95ae-6680bace11de None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:15.682094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f610c-b147-449d-95ae-6680bace11de None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:15.682370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f610c-b147-449d-95ae-6680bace11de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:15.683095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f610c-b147-449d-95ae-6680bace11de None admin] RBAC: Adding query filter params (role.id=304f77f2646444858d534f43683d186a, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=98320a8730d245f6b7fa014273604ed5) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:15.683401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f610c-b147-449d-95ae-6680bace11de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:15.684859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f610c-b147-449d-95ae-6680bace11de None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:15.691718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 492/983] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:46:15 2022] GET /identity/v3/role_assignments?user.id=98320a8730d245f6b7fa014273604ed5&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=304f77f2646444858d534f43683d186a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:15.820757 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660db1e7-e07f-4cdb-85c8-793fdf9c34ce None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:15.871642 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8f589-5373-4e38-91c0-c8a0d7c8daeb None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:15.871989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8f589-5373-4e38-91c0-c8a0d7c8daeb None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:15.872253 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8f589-5373-4e38-91c0-c8a0d7c8daeb None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:15.873646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 493/984] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:15.881049 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1904a-a137-4a51-94ba-fb4f5eb4e91e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:15.882041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1904a-a137-4a51-94ba-fb4f5eb4e91e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:15.882515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1904a-a137-4a51-94ba-fb4f5eb4e91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:15.917036 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-e4a1904a-a137-4a51-94ba-fb4f5eb4e91e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:15.919148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e4a1904a-a137-4a51-94ba-fb4f5eb4e91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:15.949370 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660db1e7-e07f-4cdb-85c8-793fdf9c34ce None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:15.983423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:15.993899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208e701-5736-4adc-b558-a0c36402ed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:15.998699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208e701-5736-4adc-b558-a0c36402ed9e None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:15.998699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208e701-5736-4adc-b558-a0c36402ed9e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:15.998699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208e701-5736-4adc-b558-a0c36402ed9e None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:15.998699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208e701-5736-4adc-b558-a0c36402ed9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:15.998699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208e701-5736-4adc-b558-a0c36402ed9e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:16.002516 dv-cinder-852211-7-smb devstack@keystone.service[81699]: WARNING keystone.server.flask.common [None req-9208e701-5736-4adc-b558-a0c36402ed9e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 13:46:16.010244 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 494/985] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:16.063614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.sql.core [None req-9208e701-5736-4adc-b558-a0c36402ed9e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 13:46:16.063614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 13:46:16.063614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [parameters: {'user_id': '8fe2dae9af374ffeb2abae6ec0516f17', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 13:46:16.063614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81699) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 13:46:16.080751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-9208e701-5736-4adc-b558-a0c36402ed9e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 13:46:16.080751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:16.080751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 13:46:16.080751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 13:46:16.080751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 13:46:16.080751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 13:46:16.080751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 13:46:16.080751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 13:46:16.080751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 13:46:16.080751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application conn.query(q) Sep 01 13:46:16.080751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 13:46:16.080751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 13:46:16.080751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 13:46:16.080751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application result.read() Sep 01 13:46:16.080751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 13:46:16.081696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application next(self.gen) Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application yield resource Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application next(self.gen) Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise self.value Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application session.commit() Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 13:46:16.082665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self.session.flush() Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application compat.raise_( Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 13:46:16.083570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 13:46:16.084513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application conn.query(q) Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application result.read() Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 13:46:16.085362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 13:46:16.086216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 13:46:16.086216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 13:46:16.086216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 13:46:16.086216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 13:46:16.086216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 13:46:16.086216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 13:46:16.086216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [parameters: {'user_id': '8fe2dae9af374ffeb2abae6ec0516f17', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 13:46:16.086216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 13:46:16.086216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:16.086216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:16.086216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:16.086216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:16.086216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:16.086216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:16.086216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 13:46:16.087034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 13:46:16.089875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 13:46:16.089875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 13:46:16.089875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 13:46:16.089875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 13:46:16.089875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 13:46:16.089875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:16.089875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 492/986] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Sep 1 13:46:15 2022] POST /identity/v3/users => generated 160 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:16.090795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1904a-a137-4a51-94ba-fb4f5eb4e91e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:16.190949 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:16.199825 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1904a-a137-4a51-94ba-fb4f5eb4e91e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:16.238765 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6363df4-cd5e-44cf-b4e3-df3867117fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:16.239401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6363df4-cd5e-44cf-b4e3-df3867117fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:16.239680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6363df4-cd5e-44cf-b4e3-df3867117fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:16.239977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6363df4-cd5e-44cf-b4e3-df3867117fb4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:16.247655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6363df4-cd5e-44cf-b4e3-df3867117fb4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:16.249183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6363df4-cd5e-44cf-b4e3-df3867117fb4 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-a6363df4-cd5e-44cf-b4e3-df3867117fb4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:46:16.263366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:16.264429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:16.265373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:16.265373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:16.265373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:46:16.265373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:46:16.265373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:46:16.265373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:46:16.265373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:46:16.265373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:46:16.265373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 13:46:16.265373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:16.265373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 495/987] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:46:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:16.273771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208e701-5736-4adc-b558-a0c36402ed9e None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:16.319648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6363df4-cd5e-44cf-b4e3-df3867117fb4 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:16.385725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208e701-5736-4adc-b558-a0c36402ed9e None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:16.423731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4c23a-abf4-4ebb-9862-90dc53e8b051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:16.424493 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4c23a-abf4-4ebb-9862-90dc53e8b051 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:16.424690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4c23a-abf4-4ebb-9862-90dc53e8b051 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:16.424861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4c23a-abf4-4ebb-9862-90dc53e8b051 None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:16.425549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4c23a-abf4-4ebb-9862-90dc53e8b051 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:16.425730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6363df4-cd5e-44cf-b4e3-df3867117fb4 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:16.426157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4c23a-abf4-4ebb-9862-90dc53e8b051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:16.427608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4c23a-abf4-4ebb-9862-90dc53e8b051 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:16.466719 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba4045-d099-4d77-aa6a-f720121b6679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:16.467326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4045-d099-4d77-aa6a-f720121b6679 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:16.467604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4045-d099-4d77-aa6a-f720121b6679 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:16.467889 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4045-d099-4d77-aa6a-f720121b6679 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:16.468559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba4045-d099-4d77-aa6a-f720121b6679 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:16.469910 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba4045-d099-4d77-aa6a-f720121b6679 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:16.479261 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 493/988] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Sep 1 13:46:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:16.538948 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 496/989] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 13:46:16 2022] POST /identity/v3/services => generated 242 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:46:17.242239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51576048-eb5f-42de-a4c3-76453941d03c None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:17.242582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51576048-eb5f-42de-a4c3-76453941d03c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:17.242785 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51576048-eb5f-42de-a4c3-76453941d03c None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:17.244345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 494/990] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:17.249336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dfc30-b7c2-4098-a4c1-9de451b5a0d6 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:17.249629 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dfc30-b7c2-4098-a4c1-9de451b5a0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:17.254148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dfc30-b7c2-4098-a4c1-9de451b5a0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:17.269876 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-e87dfc30-b7c2-4098-a4c1-9de451b5a0d6 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:17.271022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e87dfc30-b7c2-4098-a4c1-9de451b5a0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:17.279338 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:17.352321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 497/991] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:17.624471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51576048-eb5f-42de-a4c3-76453941d03c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:17.678056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:17.707454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c9a46-c496-401e-b121-a39d63069410 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:17.708115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c9a46-c496-401e-b121-a39d63069410 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:17.708115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c9a46-c496-401e-b121-a39d63069410 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:17.709551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 498/992] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:17.714118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5d67f-1fb2-4195-bb6d-a3e6f5425a38 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:17.714413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5d67f-1fb2-4195-bb6d-a3e6f5425a38 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:17.714697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5d67f-1fb2-4195-bb6d-a3e6f5425a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:17.734724 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-c5b5d67f-1fb2-4195-bb6d-a3e6f5425a38 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:17.735257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51576048-eb5f-42de-a4c3-76453941d03c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:17.735957 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c5b5d67f-1fb2-4195-bb6d-a3e6f5425a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:17.774268 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9110ac6-9a3c-4ed1-a320-e71efe6c71d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:17.775175 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9110ac6-9a3c-4ed1-a320-e71efe6c71d3 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:17.775453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9110ac6-9a3c-4ed1-a320-e71efe6c71d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:17.775722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9110ac6-9a3c-4ed1-a320-e71efe6c71d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:17.776329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9110ac6-9a3c-4ed1-a320-e71efe6c71d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:17.777680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9110ac6-9a3c-4ed1-a320-e71efe6c71d3 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-f9110ac6-9a3c-4ed1-a320-e71efe6c71d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:17.786654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:17.787660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:17.788566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:17.788566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:17.788566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:17.788566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:17.788566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:17.788566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:17.788566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:17.788566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:17.788566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:17.788566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:17.788566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:17.788566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:17.788566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 13:46:17.788566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:17.788566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 495/993] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Sep 1 13:46:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:17.793707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9110ac6-9a3c-4ed1-a320-e71efe6c71d3 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:17.813039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 499/994] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:17.897062 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9110ac6-9a3c-4ed1-a320-e71efe6c71d3 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:17.908657 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:17.932481 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d2f3f-3a87-4fbd-8cba-663ec51a8137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:17.933086 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d2f3f-3a87-4fbd-8cba-663ec51a8137 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:17.933363 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d2f3f-3a87-4fbd-8cba-663ec51a8137 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:17.933630 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d2f3f-3a87-4fbd-8cba-663ec51a8137 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:17.934250 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d2f3f-3a87-4fbd-8cba-663ec51a8137 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:17.934550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d2f3f-3a87-4fbd-8cba-663ec51a8137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:17.935924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d2f3f-3a87-4fbd-8cba-663ec51a8137 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:17.940797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 496/995] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 13:46:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:17.946418 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5d67f-1fb2-4195-bb6d-a3e6f5425a38 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:18.016440 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:18.049411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5d67f-1fb2-4195-bb6d-a3e6f5425a38 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:18.081610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d2f3f-3a87-4fbd-8cba-663ec51a8137 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:18.084335 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afb670-6fc2-4434-a91f-bc3a9ce5bbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:18.084945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afb670-6fc2-4434-a91f-bc3a9ce5bbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:18.085242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afb670-6fc2-4434-a91f-bc3a9ce5bbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:18.085492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afb670-6fc2-4434-a91f-bc3a9ce5bbb3 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:18.086122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afb670-6fc2-4434-a91f-bc3a9ce5bbb3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:18.086423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afb670-6fc2-4434-a91f-bc3a9ce5bbb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:18.087777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afb670-6fc2-4434-a91f-bc3a9ce5bbb3 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:18.092890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 500/996] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Sep 1 13:46:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:18.098992 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afb670-6fc2-4434-a91f-bc3a9ce5bbb3 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:18.206113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afb670-6fc2-4434-a91f-bc3a9ce5bbb3 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:18.209939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d2f3f-3a87-4fbd-8cba-663ec51a8137 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:18.246154 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:18.253567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20706d8-52ea-4986-9d1b-8d58327a954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:18.254622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20706d8-52ea-4986-9d1b-8d58327a954c None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:18.255084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20706d8-52ea-4986-9d1b-8d58327a954c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:18.255540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20706d8-52ea-4986-9d1b-8d58327a954c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:18.257018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20706d8-52ea-4986-9d1b-8d58327a954c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:18.258131 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e58e5c-61e9-4c1a-9ab3-367cc1b0458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:18.259083 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e58e5c-61e9-4c1a-9ab3-367cc1b0458e None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:18.259304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20706d8-52ea-4986-9d1b-8d58327a954c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:18.259518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e58e5c-61e9-4c1a-9ab3-367cc1b0458e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:18.259980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e58e5c-61e9-4c1a-9ab3-367cc1b0458e None admin] PATH_INFO: `/v3/services/image` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:18.260903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e58e5c-61e9-4c1a-9ab3-367cc1b0458e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:18.263270 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e58e5c-61e9-4c1a-9ab3-367cc1b0458e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-d3e58e5c-61e9-4c1a-9ab3-367cc1b0458e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:18.274803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:18.276088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:18.277096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:18.277096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:18.277096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:18.277096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:18.277096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:18.277096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:18.277096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:18.277096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:18.277096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:18.277096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:18.277096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:18.277096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:18.277096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:46:18.277096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:18.277096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 497/997] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Sep 1 13:46:18 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:46:18.282250 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e58e5c-61e9-4c1a-9ab3-367cc1b0458e None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:18.320447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:18.378929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e58e5c-61e9-4c1a-9ab3-367cc1b0458e None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:18.403891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 501/998] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 13:46:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:46:18.436924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601d8f1-a6b4-4174-95fd-a6cc076047e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:18.437490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601d8f1-a6b4-4174-95fd-a6cc076047e8 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:18.437772 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601d8f1-a6b4-4174-95fd-a6cc076047e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:18.438096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601d8f1-a6b4-4174-95fd-a6cc076047e8 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:18.438752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601d8f1-a6b4-4174-95fd-a6cc076047e8 None admin] RBAC: Adding query filter params (name=image) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:18.439065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601d8f1-a6b4-4174-95fd-a6cc076047e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:18.440535 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601d8f1-a6b4-4174-95fd-a6cc076047e8 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:18.451060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 498/999] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:18.452798 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20706d8-52ea-4986-9d1b-8d58327a954c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:18.480329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e5945-e907-4f32-8afb-ccc9c8237ab2 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:18.480609 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e5945-e907-4f32-8afb-ccc9c8237ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:18.480884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e5945-e907-4f32-8afb-ccc9c8237ab2 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:18.482413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 499/1000] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:46:18.487742 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e89b-4299-4ec9-9f44-ac855bdcc84b None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:18.488062 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e89b-4299-4ec9-9f44-ac855bdcc84b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:18.488352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e89b-4299-4ec9-9f44-ac855bdcc84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:18.507841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-1b67e89b-4299-4ec9-9f44-ac855bdcc84b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:18.509459 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1b67e89b-4299-4ec9-9f44-ac855bdcc84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:18.578908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20706d8-52ea-4986-9d1b-8d58327a954c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:18.588348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 500/1001] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:18 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:18.617503 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4d2f7-6636-492e-a95d-53954fa1b35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:18.618115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4d2f7-6636-492e-a95d-53954fa1b35c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:18.618397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4d2f7-6636-492e-a95d-53954fa1b35c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:18.618674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4d2f7-6636-492e-a95d-53954fa1b35c None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:18.619308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4d2f7-6636-492e-a95d-53954fa1b35c None admin] RBAC: Adding query filter params (type=image) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:18.619611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4d2f7-6636-492e-a95d-53954fa1b35c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:18.621025 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4d2f7-6636-492e-a95d-53954fa1b35c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:18.626133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 502/1002] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:18 2022] GET /identity/v3/services?type=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:18.857194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67e89b-4299-4ec9-9f44-ac855bdcc84b None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:18.886730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:18.961163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67e89b-4299-4ec9-9f44-ac855bdcc84b None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:18.995287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6f5b1-5b19-4b10-a69c-b998fb2c65ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:18.995947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6f5b1-5b19-4b10-a69c-b998fb2c65ed None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:18.996231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6f5b1-5b19-4b10-a69c-b998fb2c65ed None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:18.996505 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6f5b1-5b19-4b10-a69c-b998fb2c65ed None admin] PATH_INFO: `/v3/services/compute` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:18.997079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6f5b1-5b19-4b10-a69c-b998fb2c65ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:18.998436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6f5b1-5b19-4b10-a69c-b998fb2c65ed None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-51f6f5b1-5b19-4b10-a69c-b998fb2c65ed None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:19.007621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:19.008648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:19.009518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:19.009518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:19.009518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:19.009518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:19.009518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:19.009518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:19.009518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:19.009518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:19.009518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:19.009518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:19.009518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:19.009518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:19.009518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:46:19.009518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:19.011953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 501/1003] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:46:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:19.014657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4d2f7-6636-492e-a95d-53954fa1b35c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:19.076950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:19.121463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4d2f7-6636-492e-a95d-53954fa1b35c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:19.160322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac72d1-635c-4bb9-be65-7303a1b5ec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:19.160936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac72d1-635c-4bb9-be65-7303a1b5ec83 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:19.161230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac72d1-635c-4bb9-be65-7303a1b5ec83 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:19.161582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac72d1-635c-4bb9-be65-7303a1b5ec83 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:19.162177 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac72d1-635c-4bb9-be65-7303a1b5ec83 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:19.162871 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac72d1-635c-4bb9-be65-7303a1b5ec83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:19.167214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac72d1-635c-4bb9-be65-7303a1b5ec83 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:19.175958 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 503/1004] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 13:46:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:19.177149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6f5b1-5b19-4b10-a69c-b998fb2c65ed None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:19.273893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:19.283675 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6f5b1-5b19-4b10-a69c-b998fb2c65ed None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:19.317320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e810d-d624-487e-951d-255efbe9cd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:19.317945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e810d-d624-487e-951d-255efbe9cd47 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:19.318659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e810d-d624-487e-951d-255efbe9cd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:19.319296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e810d-d624-487e-951d-255efbe9cd47 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:19.320503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e810d-d624-487e-951d-255efbe9cd47 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:19.320837 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e810d-d624-487e-951d-255efbe9cd47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:19.322198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e810d-d624-487e-951d-255efbe9cd47 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:19.332435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 502/1005] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 13:46:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:19.333662 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac72d1-635c-4bb9-be65-7303a1b5ec83 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:19.433062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac72d1-635c-4bb9-be65-7303a1b5ec83 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:19.453004 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:19.467570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344b012-3a5a-4a8c-81f9-2c98d121afff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:19.468202 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344b012-3a5a-4a8c-81f9-2c98d121afff None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:19.468484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344b012-3a5a-4a8c-81f9-2c98d121afff None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:19.468783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344b012-3a5a-4a8c-81f9-2c98d121afff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:19.469480 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344b012-3a5a-4a8c-81f9-2c98d121afff None admin] RBAC: Adding query filter params (interface=public, service_id=25436ae2618c44dda78761af9963cc38, region_id=RegionOne) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:19.469795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344b012-3a5a-4a8c-81f9-2c98d121afff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:19.471176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344b012-3a5a-4a8c-81f9-2c98d121afff None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:19.480154 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 504/1006] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 13:46:19 2022] GET /identity/v3/endpoints?service_id=25436ae2618c44dda78761af9963cc38&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:19.482747 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e810d-d624-487e-951d-255efbe9cd47 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:19.589969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e810d-d624-487e-951d-255efbe9cd47 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:19.623951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824e10b-3c2a-471f-adf3-c23f254ed7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:19.624560 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824e10b-3c2a-471f-adf3-c23f254ed7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:19.625335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824e10b-3c2a-471f-adf3-c23f254ed7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:19.625629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824e10b-3c2a-471f-adf3-c23f254ed7f5 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:19.626231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824e10b-3c2a-471f-adf3-c23f254ed7f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:19.627580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824e10b-3c2a-471f-adf3-c23f254ed7f5 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:19.640119 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 503/1007] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 13:46:19 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:46:20.353805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed7762-d1e2-4e2c-9c0a-f67183b11d8d None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:20.354326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed7762-d1e2-4e2c-9c0a-f67183b11d8d None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:20.354326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed7762-d1e2-4e2c-9c0a-f67183b11d8d None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:20.355829 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 505/1008] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:20.361053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c066b-0421-4efd-8214-cd9d2e4e2058 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:20.361652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c066b-0421-4efd-8214-cd9d2e4e2058 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:20.361652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c066b-0421-4efd-8214-cd9d2e4e2058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:20.380613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-690c066b-0421-4efd-8214-cd9d2e4e2058 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:20.382059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-690c066b-0421-4efd-8214-cd9d2e4e2058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:20.397320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:20.451578 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 504/1009] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:20 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:20.539888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdf387-995d-47f5-8c31-20a7282cae96 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:20.540224 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdf387-995d-47f5-8c31-20a7282cae96 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:20.540476 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdf387-995d-47f5-8c31-20a7282cae96 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:20.541969 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 506/1010] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:20.547459 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef62a-e6dc-4d6d-b6ae-501b7bb3d8e1 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:20.547753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef62a-e6dc-4d6d-b6ae-501b7bb3d8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:20.548058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef62a-e6dc-4d6d-b6ae-501b7bb3d8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:20.566562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6feef62a-e6dc-4d6d-b6ae-501b7bb3d8e1 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:20.567750 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6feef62a-e6dc-4d6d-b6ae-501b7bb3d8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:20.636646 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 505/1011] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:20 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:20.718388 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdf387-995d-47f5-8c31-20a7282cae96 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:20.824985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdf387-995d-47f5-8c31-20a7282cae96 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:20.857985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ad6c9-eb3b-47ae-b569-ba0d81a3e059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:20.858606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ad6c9-eb3b-47ae-b569-ba0d81a3e059 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:20.858888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ad6c9-eb3b-47ae-b569-ba0d81a3e059 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:20.859183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ad6c9-eb3b-47ae-b569-ba0d81a3e059 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:20.860823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ad6c9-eb3b-47ae-b569-ba0d81a3e059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:20.862279 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ad6c9-eb3b-47ae-b569-ba0d81a3e059 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:20.864023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 507/1012] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:20.869677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feef62a-e6dc-4d6d-b6ae-501b7bb3d8e1 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:20.902421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ad6c9-eb3b-47ae-b569-ba0d81a3e059 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:20.956767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:20.958671 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:20.977258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feef62a-e6dc-4d6d-b6ae-501b7bb3d8e1 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:21.011323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ad6c9-eb3b-47ae-b569-ba0d81a3e059 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:21.013401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ed612-27a3-430b-bde3-3f9a387030ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:21.014017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ed612-27a3-430b-bde3-3f9a387030ea None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:21.014297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ed612-27a3-430b-bde3-3f9a387030ea None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:21.014578 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ed612-27a3-430b-bde3-3f9a387030ea None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:21.015228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ed612-27a3-430b-bde3-3f9a387030ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:21.016779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ed612-27a3-430b-bde3-3f9a387030ea None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:21.047920 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ad74b-13a1-48ec-9627-6f57800a8ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:21.048803 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ad74b-13a1-48ec-9627-6f57800a8ae6 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:21.049093 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ad74b-13a1-48ec-9627-6f57800a8ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:21.049368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ad74b-13a1-48ec-9627-6f57800a8ae6 None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:21.050020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ad74b-13a1-48ec-9627-6f57800a8ae6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:21.051376 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ad74b-13a1-48ec-9627-6f57800a8ae6 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:21.115897 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 506/1013] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 13:46:20 2022] POST /identity/v3/projects => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:46:21.144301 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 508/1014] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 13:46:20 2022] POST /identity/v3/services => generated 242 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:46:21.563236 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de595aa3-03c4-4aa7-919f-b7898a4baf21 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:21.563792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de595aa3-03c4-4aa7-919f-b7898a4baf21 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:21.563792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de595aa3-03c4-4aa7-919f-b7898a4baf21 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:21.565295 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 507/1015] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:21.570335 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac2aae-a817-469b-b820-d50d384c3a69 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:21.570730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac2aae-a817-469b-b820-d50d384c3a69 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:21.570893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac2aae-a817-469b-b820-d50d384c3a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:21.589357 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-38ac2aae-a817-469b-b820-d50d384c3a69 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:21.590551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-38ac2aae-a817-469b-b820-d50d384c3a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:21.669943 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 509/1016] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:21 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:21.936118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de595aa3-03c4-4aa7-919f-b7898a4baf21 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:22.039724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de595aa3-03c4-4aa7-919f-b7898a4baf21 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:22.068367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:22.073698 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d4b7f-edf2-4d81-892d-02af312f3ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:22.074325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d4b7f-edf2-4d81-892d-02af312f3ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:22.074600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d4b7f-edf2-4d81-892d-02af312f3ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:22.074869 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d4b7f-edf2-4d81-892d-02af312f3ab6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:22.075443 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d4b7f-edf2-4d81-892d-02af312f3ab6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:22.076821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d4b7f-edf2-4d81-892d-02af312f3ab6 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-ef2d4b7f-edf2-4d81-892d-02af312f3ab6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:22.087101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:22.089712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:22.090577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:22.090577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:22.090577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:22.090577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:22.090577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:22.090577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:22.090577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:22.090577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:22.090577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:22.090577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:22.090577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:22.090577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:22.090577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 13:46:22.090577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:22.090577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 508/1017] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:46:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:22.094669 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac2aae-a817-469b-b820-d50d384c3a69 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:22.135033 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:22.203316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac2aae-a817-469b-b820-d50d384c3a69 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:22.238398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338998f4-1bdb-4286-a953-9fdd8c34d57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:22.239186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338998f4-1bdb-4286-a953-9fdd8c34d57e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:22.239559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338998f4-1bdb-4286-a953-9fdd8c34d57e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:22.239957 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338998f4-1bdb-4286-a953-9fdd8c34d57e None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:22.240694 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338998f4-1bdb-4286-a953-9fdd8c34d57e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:22.241098 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338998f4-1bdb-4286-a953-9fdd8c34d57e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:22.242626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338998f4-1bdb-4286-a953-9fdd8c34d57e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:22.253847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 510/1018] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 13:46:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:22.256955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d4b7f-edf2-4d81-892d-02af312f3ab6 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:22.360539 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d4b7f-edf2-4d81-892d-02af312f3ab6 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:22.394009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f199e4a-4293-4815-bf90-36ed9846a04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:22.394676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f199e4a-4293-4815-bf90-36ed9846a04c None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:22.395021 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f199e4a-4293-4815-bf90-36ed9846a04c None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:22.395355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f199e4a-4293-4815-bf90-36ed9846a04c None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:22.396164 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f199e4a-4293-4815-bf90-36ed9846a04c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:22.396531 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f199e4a-4293-4815-bf90-36ed9846a04c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:22.397940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f199e4a-4293-4815-bf90-36ed9846a04c None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:22.407827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 509/1019] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Sep 1 13:46:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:22.409449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338998f4-1bdb-4286-a953-9fdd8c34d57e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:22.511556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338998f4-1bdb-4286-a953-9fdd8c34d57e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:22.513048 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:22.547384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26f13e-316a-48fc-8430-08ea2f088975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:22.548207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26f13e-316a-48fc-8430-08ea2f088975 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:22.548463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26f13e-316a-48fc-8430-08ea2f088975 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:22.548852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26f13e-316a-48fc-8430-08ea2f088975 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:22.549797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26f13e-316a-48fc-8430-08ea2f088975 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:22.551845 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26f13e-316a-48fc-8430-08ea2f088975 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:22.627534 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 511/1020] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 13:46:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:46:23.098346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad6e00-9f5a-46a3-ab94-f0dc83008227 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:23.098873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad6e00-9f5a-46a3-ab94-f0dc83008227 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:23.098873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad6e00-9f5a-46a3-ab94-f0dc83008227 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:23.100307 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 510/1021] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:23.105422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2fa9-859f-46b5-ad07-60e40263826e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:23.105717 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2fa9-859f-46b5-ad07-60e40263826e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:23.105993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba2fa9-859f-46b5-ad07-60e40263826e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:23.114447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3532cf-ebc4-498c-94ba-c28294ea6d31 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:23.114732 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3532cf-ebc4-498c-94ba-c28294ea6d31 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:23.115008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3532cf-ebc4-498c-94ba-c28294ea6d31 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:23.116408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 511/1022] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:23.121166 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27644a72-615f-400f-9afd-eee55718b06a None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:23.121451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27644a72-615f-400f-9afd-eee55718b06a None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:23.121728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27644a72-615f-400f-9afd-eee55718b06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:23.124312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-ffba2fa9-859f-46b5-ad07-60e40263826e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:23.126042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ffba2fa9-859f-46b5-ad07-60e40263826e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:23.141835 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-27644a72-615f-400f-9afd-eee55718b06a None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:23.143245 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-27644a72-615f-400f-9afd-eee55718b06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:23.206599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:23.211899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 512/1023] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:23.220506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 512/1024] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:23.480018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba2fa9-859f-46b5-ad07-60e40263826e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:23.487980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27644a72-615f-400f-9afd-eee55718b06a None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:23.580304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:23.597458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba2fa9-859f-46b5-ad07-60e40263826e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:23.600803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27644a72-615f-400f-9afd-eee55718b06a None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:23.640127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9208-279c-4ac2-a40e-ea67dd5bedd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:23.641251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9208-279c-4ac2-a40e-ea67dd5bedd1 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:23.641533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9208-279c-4ac2-a40e-ea67dd5bedd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:23.641805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9208-279c-4ac2-a40e-ea67dd5bedd1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:23.641930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456d6f9-55fb-4dea-97d1-b1eb786b43a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:23.642452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c9208-279c-4ac2-a40e-ea67dd5bedd1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:23.642552 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456d6f9-55fb-4dea-97d1-b1eb786b43a8 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:23.642756 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456d6f9-55fb-4dea-97d1-b1eb786b43a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:23.643032 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456d6f9-55fb-4dea-97d1-b1eb786b43a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:23.643752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c9208-279c-4ac2-a40e-ea67dd5bedd1 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:23.644184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456d6f9-55fb-4dea-97d1-b1eb786b43a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:23.645687 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456d6f9-55fb-4dea-97d1-b1eb786b43a8 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:23.647440 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 513/1025] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:23.652766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456d6f9-55fb-4dea-97d1-b1eb786b43a8 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-dc2c9208-279c-4ac2-a40e-ea67dd5bedd1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:23.653336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:23.654296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:23.657713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:23.657713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:23.657713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:23.657713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:23.657713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:23.657713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:23.657713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:23.657713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:23.657713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:23.657713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:23.657713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:23.657713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:23.657713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:46:23.657713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:23.657713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 513/1026] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Sep 1 13:46:23 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:46:23.660928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9208-279c-4ac2-a40e-ea67dd5bedd1 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:23.726821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:23.761291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456d6f9-55fb-4dea-97d1-b1eb786b43a8 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:23.777647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9208-279c-4ac2-a40e-ea67dd5bedd1 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:23.799548 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba048ac7-2ca9-469f-889c-8ec8c28c3337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:23.800212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048ac7-2ca9-469f-889c-8ec8c28c3337 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:23.800495 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048ac7-2ca9-469f-889c-8ec8c28c3337 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:23.800768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048ac7-2ca9-469f-889c-8ec8c28c3337 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:23.801426 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba048ac7-2ca9-469f-889c-8ec8c28c3337 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:23.802878 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba048ac7-2ca9-469f-889c-8ec8c28c3337 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:23.815628 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872a92d-99bd-42cb-80e8-3d66282044af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:23.816590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872a92d-99bd-42cb-80e8-3d66282044af None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:23.816878 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872a92d-99bd-42cb-80e8-3d66282044af None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:23.817150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872a92d-99bd-42cb-80e8-3d66282044af None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:23.817856 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872a92d-99bd-42cb-80e8-3d66282044af None admin] RBAC: Adding query filter params (name=image) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:23.823159 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872a92d-99bd-42cb-80e8-3d66282044af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:23.823159 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872a92d-99bd-42cb-80e8-3d66282044af None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:23.824905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 514/1027] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:23.830578 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872a92d-99bd-42cb-80e8-3d66282044af None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:23.934691 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872a92d-99bd-42cb-80e8-3d66282044af None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:23.951708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:23.968348 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 514/1028] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:46:23 2022] POST /identity/v3/users => generated 285 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 13:46:23.969433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ece8e-b996-4a36-a007-98ac0bef290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:23.970092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ece8e-b996-4a36-a007-98ac0bef290f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:23.970372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ece8e-b996-4a36-a007-98ac0bef290f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:23.970644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ece8e-b996-4a36-a007-98ac0bef290f None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:23.971279 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ece8e-b996-4a36-a007-98ac0bef290f None admin] RBAC: Adding query filter params (type=image) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:23.971584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ece8e-b996-4a36-a007-98ac0bef290f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:23.973020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ece8e-b996-4a36-a007-98ac0bef290f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:23.979079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 515/1029] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:23.985131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba048ac7-2ca9-469f-889c-8ec8c28c3337 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:23.998517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:24.100067 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba048ac7-2ca9-469f-889c-8ec8c28c3337 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:24.138759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf4fe0-9e95-4c9d-af49-9bf17187b9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:24.139377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf4fe0-9e95-4c9d-af49-9bf17187b9ef None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:24.139666 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf4fe0-9e95-4c9d-af49-9bf17187b9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:24.139972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf4fe0-9e95-4c9d-af49-9bf17187b9ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:24.141388 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf4fe0-9e95-4c9d-af49-9bf17187b9ef None admin] RBAC: Adding query filter params (interface=public, service_id=b93aa6cf9186427f89a368cca419fe74, region_id=RegionOne) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:24.141707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf4fe0-9e95-4c9d-af49-9bf17187b9ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:24.143087 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf4fe0-9e95-4c9d-af49-9bf17187b9ef None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:24.149594 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 515/1030] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 13:46:23 2022] GET /identity/v3/endpoints?service_id=b93aa6cf9186427f89a368cca419fe74&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:24.155146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ece8e-b996-4a36-a007-98ac0bef290f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:24.266684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ece8e-b996-4a36-a007-98ac0bef290f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:24.301744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b0eb9-9da0-4ffe-9ddf-c7bfc0ce6c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:24.302365 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b0eb9-9da0-4ffe-9ddf-c7bfc0ce6c97 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:24.302646 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b0eb9-9da0-4ffe-9ddf-c7bfc0ce6c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:24.302918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b0eb9-9da0-4ffe-9ddf-c7bfc0ce6c97 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:24.303525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b0eb9-9da0-4ffe-9ddf-c7bfc0ce6c97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:24.304977 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b0eb9-9da0-4ffe-9ddf-c7bfc0ce6c97 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:24.319966 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 516/1031] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 13:46:24 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 13:46:24.658873 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa2e36-0f03-4327-bf58-5d3df5af5938 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:24.659435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa2e36-0f03-4327-bf58-5d3df5af5938 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:24.659435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa2e36-0f03-4327-bf58-5d3df5af5938 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:24.660916 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 516/1032] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:24.665864 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33185f06-d582-4826-8d91-a22b398b97be None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:24.666158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33185f06-d582-4826-8d91-a22b398b97be None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:24.666430 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33185f06-d582-4826-8d91-a22b398b97be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:24.684381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-33185f06-d582-4826-8d91-a22b398b97be None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:24.685562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-33185f06-d582-4826-8d91-a22b398b97be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:24.729742 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:24.755395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 517/1033] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:25.020496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa2e36-0f03-4327-bf58-5d3df5af5938 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:25.091787 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:25.127043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa2e36-0f03-4327-bf58-5d3df5af5938 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:25.169602 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98f11c-ddb9-42c9-bca9-7ee2f4cd83c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:25.170636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98f11c-ddb9-42c9-bca9-7ee2f4cd83c7 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:25.170636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98f11c-ddb9-42c9-bca9-7ee2f4cd83c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:25.170804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c98f11c-ddb9-42c9-bca9-7ee2f4cd83c7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:25.181111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c98f11c-ddb9-42c9-bca9-7ee2f4cd83c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-4c98f11c-ddb9-42c9-bca9-7ee2f4cd83c7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:46:25.186321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:25.187290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:25.188187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:25.188187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:25.188187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:25.188187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:25.188187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:46:25.188187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:46:25.188187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:46:25.188187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:46:25.188187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:46:25.188187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:46:25.188187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:46:25.188187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:25.189401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 517/1034] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Sep 1 13:46:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:25.193688 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33185f06-d582-4826-8d91-a22b398b97be None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:25.295857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33185f06-d582-4826-8d91-a22b398b97be None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:25.332556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69223a5d-004d-4598-b66e-4c3529e5f41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:25.333165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69223a5d-004d-4598-b66e-4c3529e5f41b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:25.333510 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69223a5d-004d-4598-b66e-4c3529e5f41b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:25.333708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69223a5d-004d-4598-b66e-4c3529e5f41b None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:25.334364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69223a5d-004d-4598-b66e-4c3529e5f41b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:25.334667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69223a5d-004d-4598-b66e-4c3529e5f41b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:25.336050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69223a5d-004d-4598-b66e-4c3529e5f41b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:25.345202 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 518/1035] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Sep 1 13:46:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:25.350620 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98f11c-ddb9-42c9-bca9-7ee2f4cd83c7 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:25.453021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c98f11c-ddb9-42c9-bca9-7ee2f4cd83c7 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:25.482017 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:25.487831 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d816e-bd9f-4bb1-91e5-36d906cc490b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:25.488541 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d816e-bd9f-4bb1-91e5-36d906cc490b None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:25.488823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d816e-bd9f-4bb1-91e5-36d906cc490b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:25.489078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d816e-bd9f-4bb1-91e5-36d906cc490b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:25.499464 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d816e-bd9f-4bb1-91e5-36d906cc490b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:25.501008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d816e-bd9f-4bb1-91e5-36d906cc490b None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-d89d816e-bd9f-4bb1-91e5-36d906cc490b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:46:25.515006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:25.515971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:46:25.517021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:46:25.517021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:25.517021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:25.520168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 518/1036] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:25.521918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69223a5d-004d-4598-b66e-4c3529e5f41b None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:25.562043 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:25.624052 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69223a5d-004d-4598-b66e-4c3529e5f41b None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:25.658668 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee51010-ef1f-4e53-a457-d93030425c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:25.659273 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee51010-ef1f-4e53-a457-d93030425c6d None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:25.659549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee51010-ef1f-4e53-a457-d93030425c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:25.659816 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee51010-ef1f-4e53-a457-d93030425c6d None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:25.660470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee51010-ef1f-4e53-a457-d93030425c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:25.660770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee51010-ef1f-4e53-a457-d93030425c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:25.662119 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee51010-ef1f-4e53-a457-d93030425c6d None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:25.674647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 519/1037] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:25.680025 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d816e-bd9f-4bb1-91e5-36d906cc490b None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:25.780130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d816e-bd9f-4bb1-91e5-36d906cc490b None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:25.813753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b023d7-8042-4b1b-a5e2-928461f0bc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:25.814230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b023d7-8042-4b1b-a5e2-928461f0bc2e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:25.814506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b023d7-8042-4b1b-a5e2-928461f0bc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:25.814773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b023d7-8042-4b1b-a5e2-928461f0bc2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:25.822544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b023d7-8042-4b1b-a5e2-928461f0bc2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:25.824010 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b023d7-8042-4b1b-a5e2-928461f0bc2e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-03b023d7-8042-4b1b-a5e2-928461f0bc2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:46:25.835633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:25.836612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:25.837596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:25.837596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:25.837596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:46:25.837596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:46:25.837596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:46:25.837596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:46:25.837596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:46:25.837596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:46:25.837596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:46:25.837596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:25.840184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 519/1038] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 13:46:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:25.842388 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee51010-ef1f-4e53-a457-d93030425c6d None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:25.942334 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:25.946501 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee51010-ef1f-4e53-a457-d93030425c6d None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:25.960752 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ccfd7-9386-4746-b43b-eae5cc8c4c85 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:25.961064 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ccfd7-9386-4746-b43b-eae5cc8c4c85 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:25.961311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ccfd7-9386-4746-b43b-eae5cc8c4c85 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:25.962638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 520/1039] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:46:25.967618 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2dbce-d267-462b-a119-fa10eced9ed3 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:25.968020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2dbce-d267-462b-a119-fa10eced9ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:25.968421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2dbce-d267-462b-a119-fa10eced9ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:25.987112 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b12b9-1ac3-4a56-ba19-c543fc584116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:25.987619 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-b5a2dbce-d267-462b-a119-fa10eced9ed3 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:25.987729 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b12b9-1ac3-4a56-ba19-c543fc584116 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:25.988018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b12b9-1ac3-4a56-ba19-c543fc584116 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:25.988291 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b12b9-1ac3-4a56-ba19-c543fc584116 None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:25.988855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b5a2dbce-d267-462b-a119-fa10eced9ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:25.989038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b12b9-1ac3-4a56-ba19-c543fc584116 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:25.989308 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b12b9-1ac3-4a56-ba19-c543fc584116 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:25.990725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b12b9-1ac3-4a56-ba19-c543fc584116 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:26.009180 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 520/1040] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 13:46:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:26.014539 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b12b9-1ac3-4a56-ba19-c543fc584116 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:26.037941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:26.075966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 521/1041] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:26.119381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b12b9-1ac3-4a56-ba19-c543fc584116 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:26.159077 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efcd45-2eea-4dd4-a3f9-49aeed8687c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:26.159697 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efcd45-2eea-4dd4-a3f9-49aeed8687c7 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:26.160015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efcd45-2eea-4dd4-a3f9-49aeed8687c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:26.160290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efcd45-2eea-4dd4-a3f9-49aeed8687c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:26.191103 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:26.234894 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efcd45-2eea-4dd4-a3f9-49aeed8687c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:26.236419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efcd45-2eea-4dd4-a3f9-49aeed8687c7 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:26.268446 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ad8a6-611f-43c9-95e3-9d0822abb0c4 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:26.268739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ad8a6-611f-43c9-95e3-9d0822abb0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:26.269019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ad8a6-611f-43c9-95e3-9d0822abb0c4 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:26.270368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 522/1042] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:46:26.275187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6064e4d-c069-4678-bf80-6f535bb74a70 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:26.275471 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6064e4d-c069-4678-bf80-6f535bb74a70 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:26.275748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6064e4d-c069-4678-bf80-6f535bb74a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:26.294737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-d6064e4d-c069-4678-bf80-6f535bb74a70 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:26.296026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d6064e4d-c069-4678-bf80-6f535bb74a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:26.344443 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 521/1043] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:46:26 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 13:46:26.345583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efcd45-2eea-4dd4-a3f9-49aeed8687c7 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:26.365205 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 523/1044] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:26.366060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6064e4d-c069-4678-bf80-6f535bb74a70 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:26.419341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:26.466333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efcd45-2eea-4dd4-a3f9-49aeed8687c7 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:26.475404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6064e4d-c069-4678-bf80-6f535bb74a70 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:26.478199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:26.504564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb0f77-aaf6-4497-9a4b-b1257c3ec3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:26.505196 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb0f77-aaf6-4497-9a4b-b1257c3ec3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:26.505476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb0f77-aaf6-4497-9a4b-b1257c3ec3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:26.505750 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb0f77-aaf6-4497-9a4b-b1257c3ec3d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:26.510757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdc964-ad80-48c4-a51a-b5be28d42a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:26.511579 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdc964-ad80-48c4-a51a-b5be28d42a4a None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:26.512211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdc964-ad80-48c4-a51a-b5be28d42a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:26.512687 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdc964-ad80-48c4-a51a-b5be28d42a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:26.516335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb0f77-aaf6-4497-9a4b-b1257c3ec3d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-78bb0f77-aaf6-4497-9a4b-b1257c3ec3d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:46:26.521163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:26.522100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:26.523571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:26.523571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:26.523571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:26.523571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:26.523571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:46:26.523571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:46:26.523571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:46:26.523571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:46:26.523571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:46:26.523571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:46:26.523571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:46:26.523571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:26.523571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 522/1045] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:46:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:26.526021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdc964-ad80-48c4-a51a-b5be28d42a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:26.527508 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdc964-ad80-48c4-a51a-b5be28d42a4a None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:26.528135 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb0f77-aaf6-4497-9a4b-b1257c3ec3d5 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-f6bdc964-ad80-48c4-a51a-b5be28d42a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:46:26.544898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:26.545846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:46:26.547317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:46:26.547317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:26.547317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:26.551307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 524/1046] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:26.552172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdc964-ad80-48c4-a51a-b5be28d42a4a None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:26.640688 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb0f77-aaf6-4497-9a4b-b1257c3ec3d5 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:26.657185 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:26.658568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdc964-ad80-48c4-a51a-b5be28d42a4a None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:26.675026 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e4a39-e018-4498-a469-aea56c4be9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:26.675631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e4a39-e018-4498-a469-aea56c4be9ef None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:26.675942 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e4a39-e018-4498-a469-aea56c4be9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:26.676215 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e4a39-e018-4498-a469-aea56c4be9ef None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:26.686530 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e4a39-e018-4498-a469-aea56c4be9ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:26.686843 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e4a39-e018-4498-a469-aea56c4be9ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:26.688238 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e4a39-e018-4498-a469-aea56c4be9ef None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:26.694257 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d27a7-4590-42c4-b020-2917ed49c99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:26.694879 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d27a7-4590-42c4-b020-2917ed49c99a None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:26.695140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d27a7-4590-42c4-b020-2917ed49c99a None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:26.695404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d27a7-4590-42c4-b020-2917ed49c99a None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:26.696125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d27a7-4590-42c4-b020-2917ed49c99a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:26.696431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d27a7-4590-42c4-b020-2917ed49c99a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:26.697786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d27a7-4590-42c4-b020-2917ed49c99a None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:26.698627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 523/1047] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:46:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:26.699465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e4a39-e018-4498-a469-aea56c4be9ef None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:26.718533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 525/1048] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:26.719451 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d27a7-4590-42c4-b020-2917ed49c99a None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:26.740192 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:26.801579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e4a39-e018-4498-a469-aea56c4be9ef None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:26.822360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d27a7-4590-42c4-b020-2917ed49c99a None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:26.835026 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d208ad-f784-4918-875c-bf3785f04139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:26.835656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d208ad-f784-4918-875c-bf3785f04139 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:26.835963 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d208ad-f784-4918-875c-bf3785f04139 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:26.836248 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d208ad-f784-4918-875c-bf3785f04139 None admin] PATH_INFO: `/v3/services/image` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:26.836825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d208ad-f784-4918-875c-bf3785f04139 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:26.838190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d208ad-f784-4918-875c-bf3785f04139 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-56d208ad-f784-4918-875c-bf3785f04139 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:26.847438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:26.848540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:26.849457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:26.849457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:26.849457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:26.849457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:26.849457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:26.849457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:26.849457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:26.849457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:26.849457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:26.849457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:26.849457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:46:26.849457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:46:26.849457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 13:46:26.849457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:26.849457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 524/1049] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Sep 1 13:46:26 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:26.850260 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d208ad-f784-4918-875c-bf3785f04139 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:26.861523 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d9029-9e7f-4515-b115-3f83cd7bdd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:26.862231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d9029-9e7f-4515-b115-3f83cd7bdd8e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:26.862514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d9029-9e7f-4515-b115-3f83cd7bdd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:26.862784 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d9029-9e7f-4515-b115-3f83cd7bdd8e None admin] PATH_INFO: `/v3/users/c9b92b6cfc804747a36751332437bb36` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:26.875843 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d9029-9e7f-4515-b115-3f83cd7bdd8e None admin] RBAC: Authorizing `identity:get_user(user_id=c9b92b6cfc804747a36751332437bb36)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:26.877430 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d9029-9e7f-4515-b115-3f83cd7bdd8e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:26.879009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 526/1050] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:46:26 2022] GET /identity/v3/users/c9b92b6cfc804747a36751332437bb36 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:26.879760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d9029-9e7f-4515-b115-3f83cd7bdd8e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:26.898186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:26.956377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:26.957044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d208ad-f784-4918-875c-bf3785f04139 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:26.981231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d9029-9e7f-4515-b115-3f83cd7bdd8e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:26.993156 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0c09d-0554-4c0b-829a-b3acad38dd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:26.993789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0c09d-0554-4c0b-829a-b3acad38dd04 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:26.994070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0c09d-0554-4c0b-829a-b3acad38dd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:26.994341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0c09d-0554-4c0b-829a-b3acad38dd04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:27.000957 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0c09d-0554-4c0b-829a-b3acad38dd04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:27.002396 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0c09d-0554-4c0b-829a-b3acad38dd04 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:27.013817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-fbf0c09d-0554-4c0b-829a-b3acad38dd04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:27.013817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:27.013817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:27.013817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:27.013817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:27.013817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:27.013817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:27.013817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:27.013817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:27.013817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:27.013817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:27.013817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:27.013817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:46:27.013817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:46:27.013817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:27.014738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:27.015640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:46:27.015640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:46:27.015640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:46:27.015640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:46:27.015640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:46:27.015640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:46:27.015640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:27.015640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:27.015640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 525/1051] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:46:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:27.016179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0c09d-0554-4c0b-829a-b3acad38dd04 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:27.021373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f068ac-4207-4183-8d00-b37d9a5a91de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:27.021984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f068ac-4207-4183-8d00-b37d9a5a91de None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:27.022285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f068ac-4207-4183-8d00-b37d9a5a91de None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:27.022537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f068ac-4207-4183-8d00-b37d9a5a91de None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:27.023164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f068ac-4207-4183-8d00-b37d9a5a91de None admin] RBAC: Adding query filter params (name=image) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:27.023469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f068ac-4207-4183-8d00-b37d9a5a91de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:27.024864 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f068ac-4207-4183-8d00-b37d9a5a91de None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:27.030039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 527/1052] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:27.031346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f068ac-4207-4183-8d00-b37d9a5a91de None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:27.126489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0c09d-0554-4c0b-829a-b3acad38dd04 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:27.128047 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:27.128924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f068ac-4207-4183-8d00-b37d9a5a91de None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:27.160700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8d51d-2c3c-4be1-af8f-eb21ab4ba39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:27.161239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8d51d-2c3c-4be1-af8f-eb21ab4ba39d None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:27.161519 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8d51d-2c3c-4be1-af8f-eb21ab4ba39d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:27.161795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8d51d-2c3c-4be1-af8f-eb21ab4ba39d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:27.165727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7839e-22c5-4a39-af36-ee45417bc988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:27.166406 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7839e-22c5-4a39-af36-ee45417bc988 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:27.166686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7839e-22c5-4a39-af36-ee45417bc988 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:27.166953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7839e-22c5-4a39-af36-ee45417bc988 None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:27.167632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7839e-22c5-4a39-af36-ee45417bc988 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:27.167966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7839e-22c5-4a39-af36-ee45417bc988 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:27.169485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7839e-22c5-4a39-af36-ee45417bc988 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:27.177157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:27.182920 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 528/1053] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:46:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:27.183717 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7839e-22c5-4a39-af36-ee45417bc988 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:27.234056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8d51d-2c3c-4be1-af8f-eb21ab4ba39d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:27.235518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8d51d-2c3c-4be1-af8f-eb21ab4ba39d None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:27.283838 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7839e-22c5-4a39-af36-ee45417bc988 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:27.318690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016129b-d305-4cef-9362-8f0588cad66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:27.319291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016129b-d305-4cef-9362-8f0588cad66f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:27.319571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016129b-d305-4cef-9362-8f0588cad66f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:27.319842 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016129b-d305-4cef-9362-8f0588cad66f None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:27.320494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016129b-d305-4cef-9362-8f0588cad66f None admin] RBAC: Adding query filter params (type=image) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:27.320797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016129b-d305-4cef-9362-8f0588cad66f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:27.322191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016129b-d305-4cef-9362-8f0588cad66f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:27.327228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 529/1054] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:27.328588 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016129b-d305-4cef-9362-8f0588cad66f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:27.342603 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 526/1055] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:46:27 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:46:27.342603 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8d51d-2c3c-4be1-af8f-eb21ab4ba39d None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:27.342603 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:27.390817 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:27.431321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016129b-d305-4cef-9362-8f0588cad66f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:27.438196 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8d51d-2c3c-4be1-af8f-eb21ab4ba39d None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:27.464401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f189fc-8083-4ba1-855e-eeafe5e67af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:27.465008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f189fc-8083-4ba1-855e-eeafe5e67af6 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:27.465292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f189fc-8083-4ba1-855e-eeafe5e67af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:27.465568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f189fc-8083-4ba1-855e-eeafe5e67af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:27.466287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f189fc-8083-4ba1-855e-eeafe5e67af6 None admin] RBAC: Adding query filter params (role.id=304f77f2646444858d534f43683d186a, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=4b3c8a90b97246a98612b627b5f8da80) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:27.466600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f189fc-8083-4ba1-855e-eeafe5e67af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:27.468044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f189fc-8083-4ba1-855e-eeafe5e67af6 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:27.472219 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85858d3c-21a2-46c3-8d63-22d8a6090b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:27.472826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85858d3c-21a2-46c3-8d63-22d8a6090b2f None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:27.473109 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85858d3c-21a2-46c3-8d63-22d8a6090b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:27.473386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85858d3c-21a2-46c3-8d63-22d8a6090b2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:27.473878 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 530/1056] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:46:27 2022] GET /identity/v3/role_assignments?user.id=4b3c8a90b97246a98612b627b5f8da80&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=304f77f2646444858d534f43683d186a => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:27.474081 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85858d3c-21a2-46c3-8d63-22d8a6090b2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:27.474655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f189fc-8083-4ba1-855e-eeafe5e67af6 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:27.475443 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85858d3c-21a2-46c3-8d63-22d8a6090b2f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:27.580297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 527/1057] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 13:46:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:46:27.594879 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f189fc-8083-4ba1-855e-eeafe5e67af6 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:27.630478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:27.649561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8101a18-d005-4049-9a95-7a679c68f7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:27.650209 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8101a18-d005-4049-9a95-7a679c68f7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:27.650494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8101a18-d005-4049-9a95-7a679c68f7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:27.650766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8101a18-d005-4049-9a95-7a679c68f7b9 None admin] PATH_INFO: `/v3/projects/24613962ddd04231b9f5950dfa698130` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:27.651967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8101a18-d005-4049-9a95-7a679c68f7b9 None admin] RBAC: Authorizing `identity:get_project(project_id=24613962ddd04231b9f5950dfa698130)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:27.653436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8101a18-d005-4049-9a95-7a679c68f7b9 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:27.655402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 531/1058] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:46:27 2022] GET /identity/v3/projects/24613962ddd04231b9f5950dfa698130 => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:27.661478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85858d3c-21a2-46c3-8d63-22d8a6090b2f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:27.729418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:27.774030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85858d3c-21a2-46c3-8d63-22d8a6090b2f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:27.808996 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e50c64-742f-49fd-8e97-349503ca2809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:27.809621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e50c64-742f-49fd-8e97-349503ca2809 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:27.809905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e50c64-742f-49fd-8e97-349503ca2809 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:27.810179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e50c64-742f-49fd-8e97-349503ca2809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:27.810901 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e50c64-742f-49fd-8e97-349503ca2809 None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=24613962ddd04231b9f5950dfa698130, user.id=c9b92b6cfc804747a36751332437bb36) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:27.811218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e50c64-742f-49fd-8e97-349503ca2809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:27.813222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e50c64-742f-49fd-8e97-349503ca2809 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:27.823902 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 528/1059] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:46:27 2022] GET /identity/v3/role_assignments?user.id=c9b92b6cfc804747a36751332437bb36&scope.project.id=24613962ddd04231b9f5950dfa698130&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:29.386646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12536-63d0-4871-bf18-ca16a3dccfb2 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:29.387196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12536-63d0-4871-bf18-ca16a3dccfb2 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:29.387196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b12536-63d0-4871-bf18-ca16a3dccfb2 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:29.388590 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 532/1060] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:29.393684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0ffa9-fbb0-42d7-aaf9-c19761b3e9d2 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:29.394099 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0ffa9-fbb0-42d7-aaf9-c19761b3e9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:29.394262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0ffa9-fbb0-42d7-aaf9-c19761b3e9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:29.412765 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-5dd0ffa9-fbb0-42d7-aaf9-c19761b3e9d2 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:29.413941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-5dd0ffa9-fbb0-42d7-aaf9-c19761b3e9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:29.480878 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 529/1061] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:29.533888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92f681-5137-4ac3-890c-9489cde3b862 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:29.534207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92f681-5137-4ac3-890c-9489cde3b862 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:29.534449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92f681-5137-4ac3-890c-9489cde3b862 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:29.535955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 533/1062] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:29.540828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f4802-52a3-44f0-a40b-c13d506277cd None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:29.541124 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f4802-52a3-44f0-a40b-c13d506277cd None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:29.541402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f4802-52a3-44f0-a40b-c13d506277cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:29.560219 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-f26f4802-52a3-44f0-a40b-c13d506277cd None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:29.561405 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f26f4802-52a3-44f0-a40b-c13d506277cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:29.608925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:29.633433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 530/1063] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:29.746722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ea32f-f2c1-484c-a8bc-8be3e4c5fd4c None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:29.747081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ea32f-f2c1-484c-a8bc-8be3e4c5fd4c None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:29.747174 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ea32f-f2c1-484c-a8bc-8be3e4c5fd4c None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:29.752133 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f4802-52a3-44f0-a40b-c13d506277cd None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:29.752277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 534/1064] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:29.757565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71865e57-6413-4e97-a511-7d6550a66288 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:29.757860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71865e57-6413-4e97-a511-7d6550a66288 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:29.758133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71865e57-6413-4e97-a511-7d6550a66288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:29.776377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-71865e57-6413-4e97-a511-7d6550a66288 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:29.777550 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-71865e57-6413-4e97-a511-7d6550a66288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:29.848675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 535/1065] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:29.857438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f4802-52a3-44f0-a40b-c13d506277cd None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:29.893196 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec34c45-1236-40a0-9aa8-c71582cc4736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:29.893826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec34c45-1236-40a0-9aa8-c71582cc4736 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:29.894102 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec34c45-1236-40a0-9aa8-c71582cc4736 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:29.894370 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec34c45-1236-40a0-9aa8-c71582cc4736 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:29.900582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71865e57-6413-4e97-a511-7d6550a66288 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:29.906762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec34c45-1236-40a0-9aa8-c71582cc4736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-0ec34c45-1236-40a0-9aa8-c71582cc4736 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:46:29.911652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:29.912700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:29.913580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:29.913580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:29.913580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:29.913580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:29.913580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:46:29.913580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:46:29.913580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:46:29.913580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:46:29.913580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:46:29.913580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:46:29.913580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:46:29.913580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:29.913580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 531/1066] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Sep 1 13:46:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:46:29.918575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec34c45-1236-40a0-9aa8-c71582cc4736 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:29.962597 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:30.008149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71865e57-6413-4e97-a511-7d6550a66288 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:30.022370 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec34c45-1236-40a0-9aa8-c71582cc4736 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:30.029876 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:30.045826 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c111d-6602-4b30-8994-56a692c15cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:30.047244 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c111d-6602-4b30-8994-56a692c15cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:30.047704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c111d-6602-4b30-8994-56a692c15cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:30.048273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c111d-6602-4b30-8994-56a692c15cb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:30.062385 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51557318-855d-4d83-87f0-00234d6ff811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:30.062992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51557318-855d-4d83-87f0-00234d6ff811 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:30.063281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51557318-855d-4d83-87f0-00234d6ff811 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:30.063559 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51557318-855d-4d83-87f0-00234d6ff811 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:30.064263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51557318-855d-4d83-87f0-00234d6ff811 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:30.064568 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51557318-855d-4d83-87f0-00234d6ff811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:30.065944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51557318-855d-4d83-87f0-00234d6ff811 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:30.080498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 532/1067] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Sep 1 13:46:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:30.081803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51557318-855d-4d83-87f0-00234d6ff811 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:30.128055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c111d-6602-4b30-8994-56a692c15cb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:30.129500 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c111d-6602-4b30-8994-56a692c15cb7 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:30.183385 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51557318-855d-4d83-87f0-00234d6ff811 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:30.185718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:30.216807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc48c6b-5077-488f-84c3-2371f973f6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:30.217431 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc48c6b-5077-488f-84c3-2371f973f6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:30.217710 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc48c6b-5077-488f-84c3-2371f973f6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:30.217985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc48c6b-5077-488f-84c3-2371f973f6f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:30.229328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc48c6b-5077-488f-84c3-2371f973f6f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:30.230794 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc48c6b-5077-488f-84c3-2371f973f6f6 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:30.236022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 536/1068] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:46:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 13:46:30.236878 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c111d-6602-4b30-8994-56a692c15cb7 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-4cc48c6b-5077-488f-84c3-2371f973f6f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:46:30.249061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:30.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:46:30.251348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:46:30.251348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:30.251348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:30.254925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 533/1069] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:30.255670 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc48c6b-5077-488f-84c3-2371f973f6f6 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:30.260074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:30.353995 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc48c6b-5077-488f-84c3-2371f973f6f6 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:30.387048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f14677-602b-42a7-ba43-81e02b8d9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:30.387677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f14677-602b-42a7-ba43-81e02b8d9a07 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:30.387985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f14677-602b-42a7-ba43-81e02b8d9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:30.393279 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f14677-602b-42a7-ba43-81e02b8d9a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:30.399234 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f14677-602b-42a7-ba43-81e02b8d9a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:30.400703 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f14677-602b-42a7-ba43-81e02b8d9a07 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-c2f14677-602b-42a7-ba43-81e02b8d9a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:46:30.423804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:30.432541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:46:30.433517 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:46:30.433517 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:30.433517 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:30.433517 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 534/1070] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:30.433517 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f14677-602b-42a7-ba43-81e02b8d9a07 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:30.439143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:30.565323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c111d-6602-4b30-8994-56a692c15cb7 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:30.600160 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc2465-45fc-479d-8c63-e3d1bdb82e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:30.600348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f14677-602b-42a7-ba43-81e02b8d9a07 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:30.600793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc2465-45fc-479d-8c63-e3d1bdb82e57 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:30.601074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc2465-45fc-479d-8c63-e3d1bdb82e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:30.601348 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc2465-45fc-479d-8c63-e3d1bdb82e57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:30.612559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc2465-45fc-479d-8c63-e3d1bdb82e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-13fc2465-45fc-479d-8c63-e3d1bdb82e57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:46:30.617482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:30.618431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:30.619551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:30.619551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:30.619551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:30.619551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:30.619551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:46:30.619551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:46:30.619551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:46:30.619551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:46:30.619551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:46:30.619551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:46:30.619551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:46:30.619551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:30.619551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 537/1071] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:46:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:30.619551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc2465-45fc-479d-8c63-e3d1bdb82e57 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:30.637087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6fec0-1b44-4173-968c-0f8c107acf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:30.637720 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6fec0-1b44-4173-968c-0f8c107acf09 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:30.638024 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6fec0-1b44-4173-968c-0f8c107acf09 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:30.638302 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6fec0-1b44-4173-968c-0f8c107acf09 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:30.638942 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6fec0-1b44-4173-968c-0f8c107acf09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:30.639247 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6fec0-1b44-4173-968c-0f8c107acf09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:30.640666 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6fec0-1b44-4173-968c-0f8c107acf09 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:30.652423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 535/1072] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:30.653205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6fec0-1b44-4173-968c-0f8c107acf09 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:30.706409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:30.721729 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:30.725769 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc2465-45fc-479d-8c63-e3d1bdb82e57 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:30.760618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6fec0-1b44-4173-968c-0f8c107acf09 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:30.761213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9691274-3bc8-4d79-bc07-bb7bcfb6d102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:30.761823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9691274-3bc8-4d79-bc07-bb7bcfb6d102 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:30.762108 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9691274-3bc8-4d79-bc07-bb7bcfb6d102 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:30.762383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9691274-3bc8-4d79-bc07-bb7bcfb6d102 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:30.763020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9691274-3bc8-4d79-bc07-bb7bcfb6d102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:30.763329 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9691274-3bc8-4d79-bc07-bb7bcfb6d102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:30.764759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9691274-3bc8-4d79-bc07-bb7bcfb6d102 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:30.791902 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 538/1073] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:30.791902 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9691274-3bc8-4d79-bc07-bb7bcfb6d102 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:30.804562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa575ed-f69b-4497-9849-434432d24a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:30.805246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa575ed-f69b-4497-9849-434432d24a83 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:30.805530 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa575ed-f69b-4497-9849-434432d24a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:30.806165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa575ed-f69b-4497-9849-434432d24a83 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:30.806914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa575ed-f69b-4497-9849-434432d24a83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:30.807232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa575ed-f69b-4497-9849-434432d24a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:30.808848 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa575ed-f69b-4497-9849-434432d24a83 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:30.820990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 536/1074] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:46:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:30.827663 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa575ed-f69b-4497-9849-434432d24a83 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:30.912851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9691274-3bc8-4d79-bc07-bb7bcfb6d102 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:30.942235 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa575ed-f69b-4497-9849-434432d24a83 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:30.957737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a565e-ebca-490b-b97e-e39e1e8354bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:30.958569 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a565e-ebca-490b-b97e-e39e1e8354bf None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:30.958994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a565e-ebca-490b-b97e-e39e1e8354bf None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:30.959269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a565e-ebca-490b-b97e-e39e1e8354bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:30.969221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a565e-ebca-490b-b97e-e39e1e8354bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:30.970817 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a565e-ebca-490b-b97e-e39e1e8354bf None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:30.974480 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:30.978148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-ea7a565e-ebca-490b-b97e-e39e1e8354bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:46:30.984122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:30.988832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:30.990054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:30.990054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:30.990054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:46:30.990054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:46:30.990054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:46:30.990054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:46:30.990054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:46:30.990054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:46:30.990054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:46:30.990054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:30.990054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 539/1075] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 13:46:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:30.991709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9c77e-4cac-4c46-a84f-3e8f848fbc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:30.991709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9c77e-4cac-4c46-a84f-3e8f848fbc9d None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:30.991709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9c77e-4cac-4c46-a84f-3e8f848fbc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:30.991709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9c77e-4cac-4c46-a84f-3e8f848fbc9d None admin] PATH_INFO: `/v3/users/c9b92b6cfc804747a36751332437bb36` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:30.992066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9c77e-4cac-4c46-a84f-3e8f848fbc9d None admin] RBAC: Authorizing `identity:get_user(user_id=c9b92b6cfc804747a36751332437bb36)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:30.992066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9c77e-4cac-4c46-a84f-3e8f848fbc9d None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:30.992066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 537/1076] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:46:30 2022] GET /identity/v3/users/c9b92b6cfc804747a36751332437bb36 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:30.993151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a565e-ebca-490b-b97e-e39e1e8354bf None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:30.997187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9c77e-4cac-4c46-a84f-3e8f848fbc9d None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:31.118951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a565e-ebca-490b-b97e-e39e1e8354bf None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:31.120388 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9c77e-4cac-4c46-a84f-3e8f848fbc9d None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:31.164141 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba20ef-dda5-4ead-8fa5-d2b5f14dc583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:31.164751 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba20ef-dda5-4ead-8fa5-d2b5f14dc583 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:31.165028 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba20ef-dda5-4ead-8fa5-d2b5f14dc583 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:31.165296 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba20ef-dda5-4ead-8fa5-d2b5f14dc583 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:31.166023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba20ef-dda5-4ead-8fa5-d2b5f14dc583 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:31.166325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba20ef-dda5-4ead-8fa5-d2b5f14dc583 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:31.167741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba20ef-dda5-4ead-8fa5-d2b5f14dc583 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:31.178253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ed54a-b42a-44c0-b716-c89beebe474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:31.178253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ed54a-b42a-44c0-b716-c89beebe474f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:31.178253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ed54a-b42a-44c0-b716-c89beebe474f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:31.178253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ed54a-b42a-44c0-b716-c89beebe474f None admin] PATH_INFO: `/v3/projects/24613962ddd04231b9f5950dfa698130` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:31.178648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ed54a-b42a-44c0-b716-c89beebe474f None admin] RBAC: Authorizing `identity:get_project(project_id=24613962ddd04231b9f5950dfa698130)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:31.181221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ed54a-b42a-44c0-b716-c89beebe474f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:31.182855 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 538/1077] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:46:30 2022] GET /identity/v3/projects/24613962ddd04231b9f5950dfa698130 => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:31.185288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 540/1078] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 13:46:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:31.190505 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ed54a-b42a-44c0-b716-c89beebe474f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:31.190702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba20ef-dda5-4ead-8fa5-d2b5f14dc583 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:31.251510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:31.259090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:31.294281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ed54a-b42a-44c0-b716-c89beebe474f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:31.294563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba20ef-dda5-4ead-8fa5-d2b5f14dc583 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:31.329118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07750891-bc03-459b-b08a-954767251432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:31.329342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09caa3-b2ef-479c-8e55-0e94a6c7e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:31.329734 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07750891-bc03-459b-b08a-954767251432 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:31.329834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09caa3-b2ef-479c-8e55-0e94a6c7e4aa None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:31.330016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07750891-bc03-459b-b08a-954767251432 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:31.330125 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09caa3-b2ef-479c-8e55-0e94a6c7e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:31.330287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07750891-bc03-459b-b08a-954767251432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:31.330426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09caa3-b2ef-479c-8e55-0e94a6c7e4aa None admin] PATH_INFO: `/v3/projects/24613962ddd04231b9f5950dfa698130/users/c9b92b6cfc804747a36751332437bb36/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:31.332347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09caa3-b2ef-479c-8e55-0e94a6c7e4aa None admin] RBAC: Authorizing `identity:create_grant(project_id=24613962ddd04231b9f5950dfa698130, user_id=c9b92b6cfc804747a36751332437bb36, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:31.333770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09caa3-b2ef-479c-8e55-0e94a6c7e4aa None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:31.340405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07750891-bc03-459b-b08a-954767251432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:31.341828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07750891-bc03-459b-b08a-954767251432 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-07750891-bc03-459b-b08a-954767251432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:46:31.356773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:31.357799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:46:31.359689 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:46:31.359689 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:31.359689 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:31.359689 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 541/1079] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:31.364267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07750891-bc03-459b-b08a-954767251432 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:31.434506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 539/1080] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:46:31 2022] PUT /identity/v3/projects/24613962ddd04231b9f5950dfa698130/users/c9b92b6cfc804747a36751332437bb36/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 13:46:31.466342 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07750891-bc03-459b-b08a-954767251432 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:31.479278 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:31.510217 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed74709-2b45-4abd-88b9-972e3dc1ee4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:31.510844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed74709-2b45-4abd-88b9-972e3dc1ee4a None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:31.511126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed74709-2b45-4abd-88b9-972e3dc1ee4a None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:31.511402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed74709-2b45-4abd-88b9-972e3dc1ee4a None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:31.512161 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed74709-2b45-4abd-88b9-972e3dc1ee4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:31.512487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed74709-2b45-4abd-88b9-972e3dc1ee4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:31.514495 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed74709-2b45-4abd-88b9-972e3dc1ee4a None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:31.528195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 542/1081] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:31.534776 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09caa3-b2ef-479c-8e55-0e94a6c7e4aa None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:31.638055 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09caa3-b2ef-479c-8e55-0e94a6c7e4aa None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:31.675933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:31.691624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecf6e8-aef3-4930-929a-acf1379de28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:31.691624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecf6e8-aef3-4930-929a-acf1379de28b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:31.691624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecf6e8-aef3-4930-929a-acf1379de28b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:31.691624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecf6e8-aef3-4930-929a-acf1379de28b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:31.693058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecf6e8-aef3-4930-929a-acf1379de28b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:31.694575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecf6e8-aef3-4930-929a-acf1379de28b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:31.706488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-fdecf6e8-aef3-4930-929a-acf1379de28b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:31.706488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:31.706488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:31.706488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:31.706488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:31.706488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:31.706488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:31.706488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:31.706488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:31.706488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:31.706488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:31.706488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:31.706488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:46:31.706488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:46:31.706488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:31.707399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:31.708361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:46:31.708361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:46:31.708361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:46:31.708361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:46:31.708361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:46:31.708361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:46:31.708361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:31.708361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:31.708361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 540/1082] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:31.713562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed74709-2b45-4abd-88b9-972e3dc1ee4a None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:31.812972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed74709-2b45-4abd-88b9-972e3dc1ee4a None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:31.852582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93940735-841e-4b1f-833a-9b13b21c7b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:31.853382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93940735-841e-4b1f-833a-9b13b21c7b7b None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:31.853488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93940735-841e-4b1f-833a-9b13b21c7b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:31.853773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93940735-841e-4b1f-833a-9b13b21c7b7b None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:31.854496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93940735-841e-4b1f-833a-9b13b21c7b7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:31.854809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93940735-841e-4b1f-833a-9b13b21c7b7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:31.856314 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93940735-841e-4b1f-833a-9b13b21c7b7b None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:31.878576 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 543/1083] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:31.883180 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecf6e8-aef3-4930-929a-acf1379de28b None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:31.990449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecf6e8-aef3-4930-929a-acf1379de28b None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:32.023830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc9351-870b-49e9-8ba7-55f28c87e28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:32.024512 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc9351-870b-49e9-8ba7-55f28c87e28a None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:32.024793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc9351-870b-49e9-8ba7-55f28c87e28a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:32.025067 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc9351-870b-49e9-8ba7-55f28c87e28a None admin] PATH_INFO: `/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/4b3c8a90b97246a98612b627b5f8da80/roles/304f77f2646444858d534f43683d186a` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:32.027207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc9351-870b-49e9-8ba7-55f28c87e28a None admin] RBAC: Authorizing `identity:create_grant(project_id=5e7998cc03064a0bb9a9dc6a1475d73c, user_id=4b3c8a90b97246a98612b627b5f8da80, role_id=304f77f2646444858d534f43683d186a)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:32.028659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc9351-870b-49e9-8ba7-55f28c87e28a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:32.119294 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 541/1084] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:46:31 2022] PUT /identity/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/4b3c8a90b97246a98612b627b5f8da80/roles/304f77f2646444858d534f43683d186a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:46:33.347781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a5237-aebb-4903-bf75-6d1568eeab99 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:33.348386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a5237-aebb-4903-bf75-6d1568eeab99 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:33.348386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a5237-aebb-4903-bf75-6d1568eeab99 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:33.349847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 544/1085] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:33.354782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44dd72-8b38-4499-9732-4e6f499cd390 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:33.355229 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44dd72-8b38-4499-9732-4e6f499cd390 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:33.355347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44dd72-8b38-4499-9732-4e6f499cd390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:33.373090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-dd44dd72-8b38-4499-9732-4e6f499cd390 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:33.374305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-dd44dd72-8b38-4499-9732-4e6f499cd390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:33.416381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:33.440475 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 542/1086] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:33.713260 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a5237-aebb-4903-bf75-6d1568eeab99 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:33.744274 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:33.814414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a5237-aebb-4903-bf75-6d1568eeab99 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:33.847108 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f5004-9e0b-4d5f-b53c-c78e54f8c886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:33.847726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5004-9e0b-4d5f-b53c-c78e54f8c886 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:33.848037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5004-9e0b-4d5f-b53c-c78e54f8c886 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:33.848309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f5004-9e0b-4d5f-b53c-c78e54f8c886 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:33.860343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f5004-9e0b-4d5f-b53c-c78e54f8c886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-2e8f5004-9e0b-4d5f-b53c-c78e54f8c886 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:46:33.865055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:33.866059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:33.866993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:33.866993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:33.866993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:33.866993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:33.866993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:46:33.866993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:46:33.866993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:46:33.866993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:46:33.866993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:46:33.866993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:46:33.866993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:46:33.866993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:33.866993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 545/1087] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:46:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:33.872150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44dd72-8b38-4499-9732-4e6f499cd390 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:33.970401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44dd72-8b38-4499-9732-4e6f499cd390 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:33.996155 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40ab79-ca3f-43cc-b2b0-46526001509f None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:33.996450 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40ab79-ca3f-43cc-b2b0-46526001509f None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:33.996733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40ab79-ca3f-43cc-b2b0-46526001509f None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:33.998073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 546/1088] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:46:34.002815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d52c04-17d0-4620-9858-67f05588587b None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:34.003099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d52c04-17d0-4620-9858-67f05588587b None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:34.003370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d52c04-17d0-4620-9858-67f05588587b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:34.005534 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9569be-bbae-4962-96b3-870a6e87c43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:34.006398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9569be-bbae-4962-96b3-870a6e87c43f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:34.006679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9569be-bbae-4962-96b3-870a6e87c43f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:34.006950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9569be-bbae-4962-96b3-870a6e87c43f None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:34.007610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9569be-bbae-4962-96b3-870a6e87c43f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:34.007948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9569be-bbae-4962-96b3-870a6e87c43f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:34.009306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9569be-bbae-4962-96b3-870a6e87c43f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:34.019330 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 543/1089] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:46:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:34.022809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-d5d52c04-17d0-4620-9858-67f05588587b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:34.024043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d5d52c04-17d0-4620-9858-67f05588587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:34.025017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9569be-bbae-4962-96b3-870a6e87c43f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:34.064859 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:34.090509 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 547/1090] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:34.126955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9569be-bbae-4962-96b3-870a6e87c43f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:34.160965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309787ce-e26d-4f30-b3c9-bc050965b077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:34.161607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309787ce-e26d-4f30-b3c9-bc050965b077 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:34.161891 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309787ce-e26d-4f30-b3c9-bc050965b077 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:34.162170 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309787ce-e26d-4f30-b3c9-bc050965b077 None admin] PATH_INFO: `/v3/users/c9b92b6cfc804747a36751332437bb36` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:34.163300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309787ce-e26d-4f30-b3c9-bc050965b077 None admin] RBAC: Authorizing `identity:get_user(user_id=c9b92b6cfc804747a36751332437bb36)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:34.164761 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309787ce-e26d-4f30-b3c9-bc050965b077 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:34.171353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 544/1091] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:46:34 2022] GET /identity/v3/users/c9b92b6cfc804747a36751332437bb36 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:34.172398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d52c04-17d0-4620-9858-67f05588587b None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:34.193392 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:34.271520 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d52c04-17d0-4620-9858-67f05588587b None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:34.306894 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc016ac5-f111-4069-b427-dd691fa81d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:34.307501 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc016ac5-f111-4069-b427-dd691fa81d37 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:34.307780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc016ac5-f111-4069-b427-dd691fa81d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:34.308077 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc016ac5-f111-4069-b427-dd691fa81d37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:34.359187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309787ce-e26d-4f30-b3c9-bc050965b077 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:34.374549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc016ac5-f111-4069-b427-dd691fa81d37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:34.376114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc016ac5-f111-4069-b427-dd691fa81d37 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:34.396924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:34.459331 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309787ce-e26d-4f30-b3c9-bc050965b077 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:34.466257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:34.475448 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 548/1092] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:46:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:46:34.481482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc016ac5-f111-4069-b427-dd691fa81d37 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:34.494346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe7f17-1292-4ceb-8904-fe0dba7f570f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:34.495041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe7f17-1292-4ceb-8904-fe0dba7f570f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:34.495383 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe7f17-1292-4ceb-8904-fe0dba7f570f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:34.495907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe7f17-1292-4ceb-8904-fe0dba7f570f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:34.507580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe7f17-1292-4ceb-8904-fe0dba7f570f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-75fe7f17-1292-4ceb-8904-fe0dba7f570f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:46:34.512402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:34.513344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:34.514210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:34.514210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:34.514210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:34.514210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:34.514210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:46:34.514210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:46:34.514210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:46:34.514210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:46:34.514210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:46:34.514210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:46:34.514210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 13:46:34.514210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:34.514210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 545/1093] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Sep 1 13:46:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:46:34.519323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe7f17-1292-4ceb-8904-fe0dba7f570f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:34.580068 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc016ac5-f111-4069-b427-dd691fa81d37 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:34.601906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:34.616086 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83304b-2db6-42fe-ae57-49d18869b8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:34.616716 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83304b-2db6-42fe-ae57-49d18869b8ce None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:34.616999 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83304b-2db6-42fe-ae57-49d18869b8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:34.617271 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83304b-2db6-42fe-ae57-49d18869b8ce None admin] PATH_INFO: `/v3/projects/24613962ddd04231b9f5950dfa698130` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:34.618377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83304b-2db6-42fe-ae57-49d18869b8ce None admin] RBAC: Authorizing `identity:get_project(project_id=24613962ddd04231b9f5950dfa698130)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:34.618483 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe7f17-1292-4ceb-8904-fe0dba7f570f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:34.619801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83304b-2db6-42fe-ae57-49d18869b8ce None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:34.621485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 549/1094] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:46:34 2022] GET /identity/v3/projects/24613962ddd04231b9f5950dfa698130 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:34.627571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83304b-2db6-42fe-ae57-49d18869b8ce None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:34.654815 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a7109-0f32-4d8f-a4c6-dbe78a5a20e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:34.655961 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a7109-0f32-4d8f-a4c6-dbe78a5a20e2 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:34.656245 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a7109-0f32-4d8f-a4c6-dbe78a5a20e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:34.656521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a7109-0f32-4d8f-a4c6-dbe78a5a20e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:34.657176 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a7109-0f32-4d8f-a4c6-dbe78a5a20e2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:34.657484 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a7109-0f32-4d8f-a4c6-dbe78a5a20e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:34.658880 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a7109-0f32-4d8f-a4c6-dbe78a5a20e2 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:34.666811 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 546/1095] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Sep 1 13:46:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:34.673010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a7109-0f32-4d8f-a4c6-dbe78a5a20e2 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:34.700496 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:34.728727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83304b-2db6-42fe-ae57-49d18869b8ce None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:34.762856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412a179-ca36-40c4-8b1c-bb6c80966f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:34.763454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412a179-ca36-40c4-8b1c-bb6c80966f9e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:34.763736 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412a179-ca36-40c4-8b1c-bb6c80966f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:34.764054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412a179-ca36-40c4-8b1c-bb6c80966f9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:34.765264 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412a179-ca36-40c4-8b1c-bb6c80966f9e None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=24613962ddd04231b9f5950dfa698130, user.id=c9b92b6cfc804747a36751332437bb36) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:34.765606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412a179-ca36-40c4-8b1c-bb6c80966f9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:34.767047 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412a179-ca36-40c4-8b1c-bb6c80966f9e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:34.772786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 550/1096] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:46:34 2022] GET /identity/v3/role_assignments?user.id=c9b92b6cfc804747a36751332437bb36&scope.project.id=24613962ddd04231b9f5950dfa698130&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:34.772922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a7109-0f32-4d8f-a4c6-dbe78a5a20e2 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:34.811307 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a5828-078e-4446-bcd7-cec6a9e6d1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:34.812015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a5828-078e-4446-bcd7-cec6a9e6d1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:34.812291 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a5828-078e-4446-bcd7-cec6a9e6d1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:34.812558 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a5828-078e-4446-bcd7-cec6a9e6d1d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:34.824922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a5828-078e-4446-bcd7-cec6a9e6d1d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:34.826395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a5828-078e-4446-bcd7-cec6a9e6d1d4 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-db5a5828-078e-4446-bcd7-cec6a9e6d1d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:46:34.842186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:34.844030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:46:34.845478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:46:34.845478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:34.845478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:34.845478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 547/1097] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:46:34.849889 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412a179-ca36-40c4-8b1c-bb6c80966f9e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:34.906065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:34.953966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412a179-ca36-40c4-8b1c-bb6c80966f9e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:34.987968 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0672be5-a3fc-4ca8-ad33-76c1a061ea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:34.988608 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0672be5-a3fc-4ca8-ad33-76c1a061ea6f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:34.988883 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0672be5-a3fc-4ca8-ad33-76c1a061ea6f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:34.989146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0672be5-a3fc-4ca8-ad33-76c1a061ea6f None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:34.989775 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0672be5-a3fc-4ca8-ad33-76c1a061ea6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:34.990074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0672be5-a3fc-4ca8-ad33-76c1a061ea6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:34.991418 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0672be5-a3fc-4ca8-ad33-76c1a061ea6f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:35.002842 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 551/1098] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:35.008907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a5828-078e-4446-bcd7-cec6a9e6d1d4 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:35.090533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:35.109750 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a5828-078e-4446-bcd7-cec6a9e6d1d4 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:35.144580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba965d5d-345b-4c2b-9280-5e4a10cd1f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:35.145193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba965d5d-345b-4c2b-9280-5e4a10cd1f28 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:35.145469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba965d5d-345b-4c2b-9280-5e4a10cd1f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:35.145734 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba965d5d-345b-4c2b-9280-5e4a10cd1f28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:35.153580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba965d5d-345b-4c2b-9280-5e4a10cd1f28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:35.155027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba965d5d-345b-4c2b-9280-5e4a10cd1f28 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-ba965d5d-345b-4c2b-9280-5e4a10cd1f28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:46:35.166346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:35.167338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:35.168343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:35.168343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:35.168343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:46:35.168343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:46:35.168343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:46:35.168343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:46:35.168343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:46:35.168343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:46:35.168343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 13:46:35.168343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:35.168343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 548/1099] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Sep 1 13:46:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:35.173526 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0672be5-a3fc-4ca8-ad33-76c1a061ea6f None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:35.281782 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0672be5-a3fc-4ca8-ad33-76c1a061ea6f None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:35.294929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:35.315837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d977b26-cc2e-4293-a4d6-d6d5e38cc5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:35.316477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d977b26-cc2e-4293-a4d6-d6d5e38cc5fc None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:35.316757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d977b26-cc2e-4293-a4d6-d6d5e38cc5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:35.317029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d977b26-cc2e-4293-a4d6-d6d5e38cc5fc None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:35.317798 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d977b26-cc2e-4293-a4d6-d6d5e38cc5fc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:35.318106 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d977b26-cc2e-4293-a4d6-d6d5e38cc5fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:35.319531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d977b26-cc2e-4293-a4d6-d6d5e38cc5fc None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:35.337474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 552/1100] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Sep 1 13:46:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:35.342946 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba965d5d-345b-4c2b-9280-5e4a10cd1f28 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:35.442976 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba965d5d-345b-4c2b-9280-5e4a10cd1f28 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:35.475407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343b365-08d1-4a47-abb1-bc0c5647b37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:35.476039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343b365-08d1-4a47-abb1-bc0c5647b37d None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:35.476322 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343b365-08d1-4a47-abb1-bc0c5647b37d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:35.476592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343b365-08d1-4a47-abb1-bc0c5647b37d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:35.487187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:35.549691 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343b365-08d1-4a47-abb1-bc0c5647b37d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:35.551155 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343b365-08d1-4a47-abb1-bc0c5647b37d None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:35.647821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 549/1101] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:46:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:46:35.653567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d977b26-cc2e-4293-a4d6-d6d5e38cc5fc None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:35.753101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d977b26-cc2e-4293-a4d6-d6d5e38cc5fc None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:35.786941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1d8aa-ec6b-4bce-a19a-1462dd508405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:35.787569 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1d8aa-ec6b-4bce-a19a-1462dd508405 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:35.787848 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1d8aa-ec6b-4bce-a19a-1462dd508405 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:35.788153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1d8aa-ec6b-4bce-a19a-1462dd508405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:35.798668 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1d8aa-ec6b-4bce-a19a-1462dd508405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:35.800132 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1d8aa-ec6b-4bce-a19a-1462dd508405 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-e9a1d8aa-ec6b-4bce-a19a-1462dd508405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:46:35.815026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:35.816051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:46:35.816945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:46:35.816945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:46:35.816945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:35.820320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 553/1102] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:46:35.822597 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343b365-08d1-4a47-abb1-bc0c5647b37d None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:35.863248 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:35.922281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343b365-08d1-4a47-abb1-bc0c5647b37d None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:35.956348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b85e8f-ba70-43bc-a787-0128fbb58942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:35.956950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b85e8f-ba70-43bc-a787-0128fbb58942 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:35.957249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b85e8f-ba70-43bc-a787-0128fbb58942 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:35.957502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b85e8f-ba70-43bc-a787-0128fbb58942 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:35.958132 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b85e8f-ba70-43bc-a787-0128fbb58942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:35.958435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b85e8f-ba70-43bc-a787-0128fbb58942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:35.959783 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b85e8f-ba70-43bc-a787-0128fbb58942 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:35.970917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 550/1103] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:35.976539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1d8aa-ec6b-4bce-a19a-1462dd508405 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:36.001260 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:36.075204 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1d8aa-ec6b-4bce-a19a-1462dd508405 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:36.108368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc6474-f0d2-4adc-bca4-c3a8fbf7eaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:36.109030 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6474-f0d2-4adc-bca4-c3a8fbf7eaee None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:36.109345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6474-f0d2-4adc-bca4-c3a8fbf7eaee None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:36.109620 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc6474-f0d2-4adc-bca4-c3a8fbf7eaee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:36.116465 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc6474-f0d2-4adc-bca4-c3a8fbf7eaee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:36.117910 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc6474-f0d2-4adc-bca4-c3a8fbf7eaee None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:36.131234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-a0dc6474-f0d2-4adc-bca4-c3a8fbf7eaee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:36.131234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:36.131234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:36.131234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:36.131234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:36.131234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:36.131234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:36.131234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:36.131234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:36.131234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:36.131234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:36.131234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:36.131234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:46:36.131234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:46:36.131234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:36.132312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:36.133384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:46:36.133384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:46:36.133384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:46:36.133384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:46:36.133384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:46:36.133384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:46:36.133384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:46:36.133384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:46:36.133384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 554/1104] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:46:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:36.138296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b85e8f-ba70-43bc-a787-0128fbb58942 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:36.239449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:36.242447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b85e8f-ba70-43bc-a787-0128fbb58942 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:36.276172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56de15-c915-487a-9217-a73db9973684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:36.276784 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56de15-c915-487a-9217-a73db9973684 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:36.277068 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56de15-c915-487a-9217-a73db9973684 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:36.277340 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56de15-c915-487a-9217-a73db9973684 None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:36.278085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56de15-c915-487a-9217-a73db9973684 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:36.278655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56de15-c915-487a-9217-a73db9973684 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:36.280802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56de15-c915-487a-9217-a73db9973684 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:36.292856 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 551/1105] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:46:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:36.299453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc6474-f0d2-4adc-bca4-c3a8fbf7eaee None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:36.382920 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:36.400616 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc6474-f0d2-4adc-bca4-c3a8fbf7eaee None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:36.434676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d5c92-9545-465e-8d00-29c780902d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:36.435279 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d5c92-9545-465e-8d00-29c780902d09 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:36.435561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d5c92-9545-465e-8d00-29c780902d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:36.435835 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d5c92-9545-465e-8d00-29c780902d09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:36.436613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d5c92-9545-465e-8d00-29c780902d09 None admin] RBAC: Adding query filter params (role.id=304f77f2646444858d534f43683d186a, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=4b3c8a90b97246a98612b627b5f8da80) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:36.437444 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d5c92-9545-465e-8d00-29c780902d09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:36.438867 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d5c92-9545-465e-8d00-29c780902d09 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:36.445063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 555/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:46:36 2022] GET /identity/v3/role_assignments?user.id=4b3c8a90b97246a98612b627b5f8da80&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=304f77f2646444858d534f43683d186a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:46:36.732686 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c91d7-2f75-4bdc-8b0e-6b84c3188adb None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:36.733202 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c91d7-2f75-4bdc-8b0e-6b84c3188adb None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:36.733202 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c91d7-2f75-4bdc-8b0e-6b84c3188adb None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:36.735117 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 552/1107] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:36.740468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb546813-a572-4c80-8dee-abfb0f0a6c70 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:36.740915 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb546813-a572-4c80-8dee-abfb0f0a6c70 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:36.741026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb546813-a572-4c80-8dee-abfb0f0a6c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:36.760147 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-eb546813-a572-4c80-8dee-abfb0f0a6c70 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:36.761346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-eb546813-a572-4c80-8dee-abfb0f0a6c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:36.829285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 556/1108] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:37.103166 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c91d7-2f75-4bdc-8b0e-6b84c3188adb None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:37.215941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c91d7-2f75-4bdc-8b0e-6b84c3188adb None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:37.250582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7646f-ff8d-4fe0-a9a6-6c9f7c115a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:37.251219 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7646f-ff8d-4fe0-a9a6-6c9f7c115a0a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:37.251502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7646f-ff8d-4fe0-a9a6-6c9f7c115a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:37.251777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7646f-ff8d-4fe0-a9a6-6c9f7c115a0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:37.252917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7646f-ff8d-4fe0-a9a6-6c9f7c115a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:37.254347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7646f-ff8d-4fe0-a9a6-6c9f7c115a0a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:37.256517 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 553/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:37.261968 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb546813-a572-4c80-8dee-abfb0f0a6c70 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:37.336471 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:37.359277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb546813-a572-4c80-8dee-abfb0f0a6c70 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:37.392906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba5175-5ac0-47aa-9749-cb8adea35c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:37.393510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba5175-5ac0-47aa-9749-cb8adea35c5d None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:37.393792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba5175-5ac0-47aa-9749-cb8adea35c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:37.394066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba5175-5ac0-47aa-9749-cb8adea35c5d None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:37.394726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba5175-5ac0-47aa-9749-cb8adea35c5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:37.396166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba5175-5ac0-47aa-9749-cb8adea35c5d None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:37.507369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 557/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:46:37 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:46:39.417687 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66485658-f20f-46ea-9271-834803689c5c None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:39.418232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66485658-f20f-46ea-9271-834803689c5c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:39.418232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66485658-f20f-46ea-9271-834803689c5c None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:39.419669 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 554/1111] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:46:39.425333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c210f83-262c-4442-8d70-869eeb3a498d None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:39.425783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c210f83-262c-4442-8d70-869eeb3a498d None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:39.425878 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c210f83-262c-4442-8d70-869eeb3a498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:39.444260 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-0c210f83-262c-4442-8d70-869eeb3a498d None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:39.445440 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0c210f83-262c-4442-8d70-869eeb3a498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:39.510571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 558/1112] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 13:46:39.783118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66485658-f20f-46ea-9271-834803689c5c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:39.810587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:39.883115 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66485658-f20f-46ea-9271-834803689c5c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:39.917325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae2fad-00bd-482d-b73f-a8fb7a4609ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:39.917945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae2fad-00bd-482d-b73f-a8fb7a4609ff None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:39.918227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae2fad-00bd-482d-b73f-a8fb7a4609ff None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:39.918502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae2fad-00bd-482d-b73f-a8fb7a4609ff None admin] PATH_INFO: `/v3/roles/af21992d300b4bb3acb7b7f5f5b04252` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:39.919894 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae2fad-00bd-482d-b73f-a8fb7a4609ff None admin] RBAC: Authorizing `identity:get_role(role_id=af21992d300b4bb3acb7b7f5f5b04252)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:39.921274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae2fad-00bd-482d-b73f-a8fb7a4609ff None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:39.923076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 555/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:46:39 2022] GET /identity/v3/roles/af21992d300b4bb3acb7b7f5f5b04252 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:39.928975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c210f83-262c-4442-8d70-869eeb3a498d None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:39.988367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:40.025299 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c210f83-262c-4442-8d70-869eeb3a498d None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:40.058526 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cd2f0-3539-48d7-8a2d-0421f364f310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:40.059148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cd2f0-3539-48d7-8a2d-0421f364f310 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:40.059431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cd2f0-3539-48d7-8a2d-0421f364f310 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:40.059704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245cd2f0-3539-48d7-8a2d-0421f364f310 None admin] PATH_INFO: `/v3/users/14cbc5e10ddb46eb8ba49f1cb28fbd90` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:40.072336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cd2f0-3539-48d7-8a2d-0421f364f310 None admin] RBAC: Authorizing `identity:get_user(user_id=14cbc5e10ddb46eb8ba49f1cb28fbd90)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:40.073764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245cd2f0-3539-48d7-8a2d-0421f364f310 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:40.075326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 559/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:46:39 2022] GET /identity/v3/users/14cbc5e10ddb46eb8ba49f1cb28fbd90 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:40.081911 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae2fad-00bd-482d-b73f-a8fb7a4609ff None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:40.175206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:40.181065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae2fad-00bd-482d-b73f-a8fb7a4609ff None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:40.214896 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e430a76-9140-45bb-95ee-cb85d98ed0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:40.215497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e430a76-9140-45bb-95ee-cb85d98ed0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:40.215779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e430a76-9140-45bb-95ee-cb85d98ed0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:40.216114 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e430a76-9140-45bb-95ee-cb85d98ed0b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:40.282528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e430a76-9140-45bb-95ee-cb85d98ed0b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:40.283996 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e430a76-9140-45bb-95ee-cb85d98ed0b7 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:40.373557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:40.380382 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 556/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:46:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:46:40.386646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cd2f0-3539-48d7-8a2d-0421f364f310 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:40.504344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245cd2f0-3539-48d7-8a2d-0421f364f310 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:40.525473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:40.538888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7cd0e-bad6-42db-aa71-f08499b0c598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:40.539504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7cd0e-bad6-42db-aa71-f08499b0c598 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:40.539782 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7cd0e-bad6-42db-aa71-f08499b0c598 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:40.540080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7cd0e-bad6-42db-aa71-f08499b0c598 None admin] PATH_INFO: `/v3/projects/24613962ddd04231b9f5950dfa698130` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:40.541176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7cd0e-bad6-42db-aa71-f08499b0c598 None admin] RBAC: Authorizing `identity:get_project(project_id=24613962ddd04231b9f5950dfa698130)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:40.542591 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7cd0e-bad6-42db-aa71-f08499b0c598 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:40.544297 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 560/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:46:40 2022] GET /identity/v3/projects/24613962ddd04231b9f5950dfa698130 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:40.550649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e430a76-9140-45bb-95ee-cb85d98ed0b7 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:40.649142 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e430a76-9140-45bb-95ee-cb85d98ed0b7 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:40.681971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c7097-dc67-42c2-9e6d-20eb61d4c8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:40.682569 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c7097-dc67-42c2-9e6d-20eb61d4c8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:40.682849 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c7097-dc67-42c2-9e6d-20eb61d4c8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:40.683121 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c7097-dc67-42c2-9e6d-20eb61d4c8d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:40.683838 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c7097-dc67-42c2-9e6d-20eb61d4c8d7 None admin] RBAC: Adding query filter params (role.id=af21992d300b4bb3acb7b7f5f5b04252, scope.project.id=24613962ddd04231b9f5950dfa698130, user.id=14cbc5e10ddb46eb8ba49f1cb28fbd90) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:40.684182 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c7097-dc67-42c2-9e6d-20eb61d4c8d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:40.685598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c7097-dc67-42c2-9e6d-20eb61d4c8d7 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:40.691416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 557/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:46:40 2022] GET /identity/v3/role_assignments?user.id=14cbc5e10ddb46eb8ba49f1cb28fbd90&scope.project.id=24613962ddd04231b9f5950dfa698130&role.id=af21992d300b4bb3acb7b7f5f5b04252 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:42.536742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec3861-60e4-4eb4-b617-9dd2d506a44d None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:42.537267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec3861-60e4-4eb4-b617-9dd2d506a44d None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:42.537267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec3861-60e4-4eb4-b617-9dd2d506a44d None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:42.538605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 561/1118] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:42.543761 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c43d80-b0d9-4bb3-a96a-99c06fb07162 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:42.544187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c43d80-b0d9-4bb3-a96a-99c06fb07162 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:42.544342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c43d80-b0d9-4bb3-a96a-99c06fb07162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:42.562873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-53c43d80-b0d9-4bb3-a96a-99c06fb07162 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:42.564094 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-53c43d80-b0d9-4bb3-a96a-99c06fb07162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:42.618965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:42.629905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 558/1119] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:42.900295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec3861-60e4-4eb4-b617-9dd2d506a44d None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:43.001724 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec3861-60e4-4eb4-b617-9dd2d506a44d None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:43.037095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d68bb6-3663-4924-b5f0-36f0e220d1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:43.037722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d68bb6-3663-4924-b5f0-36f0e220d1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:43.037999 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d68bb6-3663-4924-b5f0-36f0e220d1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:43.038268 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d68bb6-3663-4924-b5f0-36f0e220d1c3 None admin] PATH_INFO: `/v3/roles/af21992d300b4bb3acb7b7f5f5b04252` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:43.039633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d68bb6-3663-4924-b5f0-36f0e220d1c3 None admin] RBAC: Authorizing `identity:get_role(role_id=af21992d300b4bb3acb7b7f5f5b04252)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:43.041027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d68bb6-3663-4924-b5f0-36f0e220d1c3 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:43.042340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 562/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:46:42 2022] GET /identity/v3/roles/af21992d300b4bb3acb7b7f5f5b04252 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:43.048499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c43d80-b0d9-4bb3-a96a-99c06fb07162 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:43.145228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c43d80-b0d9-4bb3-a96a-99c06fb07162 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:43.178735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42ee8c-4f0d-4c4b-8962-9cf3f64d2243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:43.179372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42ee8c-4f0d-4c4b-8962-9cf3f64d2243 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:43.179652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42ee8c-4f0d-4c4b-8962-9cf3f64d2243 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:43.179954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42ee8c-4f0d-4c4b-8962-9cf3f64d2243 None admin] PATH_INFO: `/v3/users/14cbc5e10ddb46eb8ba49f1cb28fbd90` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:43.181058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42ee8c-4f0d-4c4b-8962-9cf3f64d2243 None admin] RBAC: Authorizing `identity:get_user(user_id=14cbc5e10ddb46eb8ba49f1cb28fbd90)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:43.182485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42ee8c-4f0d-4c4b-8962-9cf3f64d2243 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:43.184084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 559/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:46:43 2022] GET /identity/v3/users/14cbc5e10ddb46eb8ba49f1cb28fbd90 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:43.189856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d68bb6-3663-4924-b5f0-36f0e220d1c3 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:43.249387 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:43.294157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d68bb6-3663-4924-b5f0-36f0e220d1c3 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:43.328539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e91dba-d60b-43c3-8ec7-2aff4d2655fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:43.329177 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e91dba-d60b-43c3-8ec7-2aff4d2655fa None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:43.329458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e91dba-d60b-43c3-8ec7-2aff4d2655fa None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:43.329729 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e91dba-d60b-43c3-8ec7-2aff4d2655fa None admin] PATH_INFO: `/v3/projects/24613962ddd04231b9f5950dfa698130` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:43.330851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e91dba-d60b-43c3-8ec7-2aff4d2655fa None admin] RBAC: Authorizing `identity:get_project(project_id=24613962ddd04231b9f5950dfa698130)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:43.332321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e91dba-d60b-43c3-8ec7-2aff4d2655fa None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:43.333956 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 563/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:46:43 2022] GET /identity/v3/projects/24613962ddd04231b9f5950dfa698130 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:43.340070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42ee8c-4f0d-4c4b-8962-9cf3f64d2243 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:43.400730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:43.447647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42ee8c-4f0d-4c4b-8962-9cf3f64d2243 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:43.481825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5b7cc-342c-47eb-8489-b88f2e5476c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:43.482481 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5b7cc-342c-47eb-8489-b88f2e5476c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:43.482763 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5b7cc-342c-47eb-8489-b88f2e5476c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:43.483037 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5b7cc-342c-47eb-8489-b88f2e5476c7 None admin] PATH_INFO: `/v3/projects/24613962ddd04231b9f5950dfa698130/users/14cbc5e10ddb46eb8ba49f1cb28fbd90/roles/af21992d300b4bb3acb7b7f5f5b04252` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:43.485366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5b7cc-342c-47eb-8489-b88f2e5476c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=24613962ddd04231b9f5950dfa698130, user_id=14cbc5e10ddb46eb8ba49f1cb28fbd90, role_id=af21992d300b4bb3acb7b7f5f5b04252)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:43.486795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5b7cc-342c-47eb-8489-b88f2e5476c7 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:43.575151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 560/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:46:43 2022] PUT /identity/v3/projects/24613962ddd04231b9f5950dfa698130/users/14cbc5e10ddb46eb8ba49f1cb28fbd90/roles/af21992d300b4bb3acb7b7f5f5b04252 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:46:45.525595 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ff371-e980-4066-a37f-7046a3078e89 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:45.526098 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ff371-e980-4066-a37f-7046a3078e89 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:45.526098 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ff371-e980-4066-a37f-7046a3078e89 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:45.527402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 564/1124] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:45.533419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e4f91-59ae-439b-8aae-3f6e85e865e9 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:45.533827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e4f91-59ae-439b-8aae-3f6e85e865e9 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:45.533966 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e4f91-59ae-439b-8aae-3f6e85e865e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:45.551613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-928e4f91-59ae-439b-8aae-3f6e85e865e9 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:45.552819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-928e4f91-59ae-439b-8aae-3f6e85e865e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:45.654902 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 561/1125] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:45.932415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ff371-e980-4066-a37f-7046a3078e89 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:46.033426 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ff371-e980-4066-a37f-7046a3078e89 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:46.056410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:46.066500 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b49c9a-cf8e-4947-8a88-1017dad83f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:46.070994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b49c9a-cf8e-4947-8a88-1017dad83f3e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:46.070994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b49c9a-cf8e-4947-8a88-1017dad83f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:46.070994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b49c9a-cf8e-4947-8a88-1017dad83f3e None admin] PATH_INFO: `/v3/roles/af21992d300b4bb3acb7b7f5f5b04252` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:46.070994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b49c9a-cf8e-4947-8a88-1017dad83f3e None admin] RBAC: Authorizing `identity:get_role(role_id=af21992d300b4bb3acb7b7f5f5b04252)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:46.070994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b49c9a-cf8e-4947-8a88-1017dad83f3e None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:46.071735 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 565/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:46:45 2022] GET /identity/v3/roles/af21992d300b4bb3acb7b7f5f5b04252 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:46.077637 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e4f91-59ae-439b-8aae-3f6e85e865e9 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:46.125406 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:46.176193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e4f91-59ae-439b-8aae-3f6e85e865e9 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:46.210150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6d590-3642-492b-b6fb-cd4bb11019d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:46.210715 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6d590-3642-492b-b6fb-cd4bb11019d2 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:46.210995 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6d590-3642-492b-b6fb-cd4bb11019d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:46.211269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6d590-3642-492b-b6fb-cd4bb11019d2 None admin] PATH_INFO: `/v3/users/14cbc5e10ddb46eb8ba49f1cb28fbd90` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:46.212392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6d590-3642-492b-b6fb-cd4bb11019d2 None admin] RBAC: Authorizing `identity:get_user(user_id=14cbc5e10ddb46eb8ba49f1cb28fbd90)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:46.213818 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6d590-3642-492b-b6fb-cd4bb11019d2 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:46.215385 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 562/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:46:46 2022] GET /identity/v3/users/14cbc5e10ddb46eb8ba49f1cb28fbd90 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:46.221735 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b49c9a-cf8e-4947-8a88-1017dad83f3e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:46.318847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b49c9a-cf8e-4947-8a88-1017dad83f3e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:46.352088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29108140-335d-41a5-9a12-2f6d0d410a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:46.352690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29108140-335d-41a5-9a12-2f6d0d410a43 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:46.352971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29108140-335d-41a5-9a12-2f6d0d410a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:46.353243 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29108140-335d-41a5-9a12-2f6d0d410a43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:46.409964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:46.418828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29108140-335d-41a5-9a12-2f6d0d410a43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:46.420304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29108140-335d-41a5-9a12-2f6d0d410a43 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:46.515987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 566/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:46:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:46:46.521771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6d590-3642-492b-b6fb-cd4bb11019d2 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:46.617128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6d590-3642-492b-b6fb-cd4bb11019d2 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:46.633681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:46.651120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f38fa-c608-4718-8be7-76bc21bf595b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:46.651740 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f38fa-c608-4718-8be7-76bc21bf595b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:46.652055 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f38fa-c608-4718-8be7-76bc21bf595b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:46.652328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f38fa-c608-4718-8be7-76bc21bf595b None admin] PATH_INFO: `/v3/projects/24613962ddd04231b9f5950dfa698130` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:46.653425 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f38fa-c608-4718-8be7-76bc21bf595b None admin] RBAC: Authorizing `identity:get_project(project_id=24613962ddd04231b9f5950dfa698130)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:46.654839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f38fa-c608-4718-8be7-76bc21bf595b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:46.656502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 563/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:46:46 2022] GET /identity/v3/projects/24613962ddd04231b9f5950dfa698130 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:46.662667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29108140-335d-41a5-9a12-2f6d0d410a43 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:46.757519 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:46.768776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29108140-335d-41a5-9a12-2f6d0d410a43 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:46.799488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c270b-9d2f-4f0e-9bfa-3669b515ec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:46.800112 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c270b-9d2f-4f0e-9bfa-3669b515ec5c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:46.800396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c270b-9d2f-4f0e-9bfa-3669b515ec5c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:46.800671 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c270b-9d2f-4f0e-9bfa-3669b515ec5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:46.801388 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c270b-9d2f-4f0e-9bfa-3669b515ec5c None admin] RBAC: Adding query filter params (role.id=af21992d300b4bb3acb7b7f5f5b04252, scope.project.id=24613962ddd04231b9f5950dfa698130, user.id=14cbc5e10ddb46eb8ba49f1cb28fbd90) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:46.801698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c270b-9d2f-4f0e-9bfa-3669b515ec5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:46.803114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c270b-9d2f-4f0e-9bfa-3669b515ec5c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:46.808739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 567/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:46:46 2022] GET /identity/v3/role_assignments?user.id=14cbc5e10ddb46eb8ba49f1cb28fbd90&scope.project.id=24613962ddd04231b9f5950dfa698130&role.id=af21992d300b4bb3acb7b7f5f5b04252 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:48.742172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780aa84-3afd-4e7e-ac15-b68c14810abf None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:48.742735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780aa84-3afd-4e7e-ac15-b68c14810abf None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:48.742735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780aa84-3afd-4e7e-ac15-b68c14810abf None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:48.744096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 564/1131] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:48.749257 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd169eb-d57c-4000-bab6-b9797dcacb91 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:48.750183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd169eb-d57c-4000-bab6-b9797dcacb91 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:48.750316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd169eb-d57c-4000-bab6-b9797dcacb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:48.768983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-9cd169eb-d57c-4000-bab6-b9797dcacb91 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:48.770169 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-9cd169eb-d57c-4000-bab6-b9797dcacb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:48.840292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 568/1132] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:49.106719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780aa84-3afd-4e7e-ac15-b68c14810abf None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:49.208021 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780aa84-3afd-4e7e-ac15-b68c14810abf None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:49.241167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4507d4-a494-4f08-b65e-9b3189812bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:49.241792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4507d4-a494-4f08-b65e-9b3189812bfe None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:49.242075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4507d4-a494-4f08-b65e-9b3189812bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:49.242348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4507d4-a494-4f08-b65e-9b3189812bfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:49.243448 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4507d4-a494-4f08-b65e-9b3189812bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:49.244909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4507d4-a494-4f08-b65e-9b3189812bfe None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:49.246469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 565/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:49.253012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd169eb-d57c-4000-bab6-b9797dcacb91 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:49.335236 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:49.350060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd169eb-d57c-4000-bab6-b9797dcacb91 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:49.383790 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61f0c0-2e7e-4c40-9894-f9bf5e9142cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:49.384353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61f0c0-2e7e-4c40-9894-f9bf5e9142cf None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:49.384634 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61f0c0-2e7e-4c40-9894-f9bf5e9142cf None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:49.384905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61f0c0-2e7e-4c40-9894-f9bf5e9142cf None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:49.385552 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61f0c0-2e7e-4c40-9894-f9bf5e9142cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:49.386966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61f0c0-2e7e-4c40-9894-f9bf5e9142cf None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:49.479526 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 569/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 13:46:49 2022] POST /identity/v3/projects => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:46:51.392926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee7a48-2ae0-419b-a170-b9153453ae27 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:51.393452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee7a48-2ae0-419b-a170-b9153453ae27 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:51.393452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee7a48-2ae0-419b-a170-b9153453ae27 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:51.394797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 566/1135] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:51.400009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e79078-5383-46c7-8b6a-cab0f196baf1 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:51.400447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e79078-5383-46c7-8b6a-cab0f196baf1 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:51.400562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e79078-5383-46c7-8b6a-cab0f196baf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:51.419125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-80e79078-5383-46c7-8b6a-cab0f196baf1 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:51.420405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-80e79078-5383-46c7-8b6a-cab0f196baf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:51.485557 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 570/1136] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:51.752655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee7a48-2ae0-419b-a170-b9153453ae27 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:51.806089 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:51.854059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee7a48-2ae0-419b-a170-b9153453ae27 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:51.893907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf49d7c-acf0-493f-a2e4-564b7afd02ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:51.894529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf49d7c-acf0-493f-a2e4-564b7afd02ee None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:51.894811 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf49d7c-acf0-493f-a2e4-564b7afd02ee None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:51.895084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf49d7c-acf0-493f-a2e4-564b7afd02ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:51.896221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf49d7c-acf0-493f-a2e4-564b7afd02ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:51.897647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf49d7c-acf0-493f-a2e4-564b7afd02ee None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:51.899219 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 567/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:46:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:51.904994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e79078-5383-46c7-8b6a-cab0f196baf1 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:51.968559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:52.000869 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e79078-5383-46c7-8b6a-cab0f196baf1 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:52.033674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b7342-8806-49aa-bfca-5b7fbceaddb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:52.034207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b7342-8806-49aa-bfca-5b7fbceaddb5 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:52.034484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b7342-8806-49aa-bfca-5b7fbceaddb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:52.034758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b7342-8806-49aa-bfca-5b7fbceaddb5 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:52.035392 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b7342-8806-49aa-bfca-5b7fbceaddb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:52.036832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b7342-8806-49aa-bfca-5b7fbceaddb5 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:52.202480 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 571/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:46:51 2022] POST /identity/v3/users => generated 286 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:46:54.142841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61359293-befe-46c5-b5ca-e28834caffa6 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:54.143407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61359293-befe-46c5-b5ca-e28834caffa6 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:54.143407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61359293-befe-46c5-b5ca-e28834caffa6 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:54.144770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 568/1139] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:54.149914 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98d062-6862-4f9d-a5f0-94cd0ce87707 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:54.150338 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98d062-6862-4f9d-a5f0-94cd0ce87707 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:54.150469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98d062-6862-4f9d-a5f0-94cd0ce87707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:54.168886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-6e98d062-6862-4f9d-a5f0-94cd0ce87707 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:54.170070 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6e98d062-6862-4f9d-a5f0-94cd0ce87707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:54.234891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 572/1140] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:54.503143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61359293-befe-46c5-b5ca-e28834caffa6 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:54.604221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61359293-befe-46c5-b5ca-e28834caffa6 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:54.623399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:54.637594 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be354432-1361-4cb1-821c-d04291dd8cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:54.640530 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be354432-1361-4cb1-821c-d04291dd8cad None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:54.640530 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be354432-1361-4cb1-821c-d04291dd8cad None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:54.640530 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be354432-1361-4cb1-821c-d04291dd8cad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:54.649335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be354432-1361-4cb1-821c-d04291dd8cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-be354432-1361-4cb1-821c-d04291dd8cad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:46:54.654172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:54.655303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:54.656386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:54.656386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:54.656386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:54.656386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:54.656386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:46:54.656386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:46:54.656386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:46:54.656386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:46:54.656386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:46:54.656386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:46:54.656386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:46:54.656386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:54.660020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 569/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:46:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:54.661375 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98d062-6862-4f9d-a5f0-94cd0ce87707 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:54.716240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:54.760299 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98d062-6862-4f9d-a5f0-94cd0ce87707 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:54.793979 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09212b27-466b-4090-9127-090f23e800c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:54.794575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09212b27-466b-4090-9127-090f23e800c1 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:54.794856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09212b27-466b-4090-9127-090f23e800c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:54.795128 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09212b27-466b-4090-9127-090f23e800c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:54.795788 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09212b27-466b-4090-9127-090f23e800c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:54.796124 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09212b27-466b-4090-9127-090f23e800c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:54.797481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09212b27-466b-4090-9127-090f23e800c1 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:54.805322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 573/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:46:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:54.811110 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be354432-1361-4cb1-821c-d04291dd8cad None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:54.910403 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be354432-1361-4cb1-821c-d04291dd8cad None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:54.943404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fef2e-0903-4371-baa2-d7063c8efac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:54.944049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fef2e-0903-4371-baa2-d7063c8efac5 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:54.944326 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fef2e-0903-4371-baa2-d7063c8efac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:54.944590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fef2e-0903-4371-baa2-d7063c8efac5 None admin] PATH_INFO: `/v3/users/e92b395d768748b19ed5904bbba085a1` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:54.957107 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fef2e-0903-4371-baa2-d7063c8efac5 None admin] RBAC: Authorizing `identity:get_user(user_id=e92b395d768748b19ed5904bbba085a1)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:54.958522 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fef2e-0903-4371-baa2-d7063c8efac5 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:54.960140 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 570/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:46:54 2022] GET /identity/v3/users/e92b395d768748b19ed5904bbba085a1 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:54.966029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09212b27-466b-4090-9127-090f23e800c1 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:55.063189 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09212b27-466b-4090-9127-090f23e800c1 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:55.082062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:55.096131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2407566-8a0b-476b-93f2-0b9050900989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:55.096732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2407566-8a0b-476b-93f2-0b9050900989 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:55.097011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2407566-8a0b-476b-93f2-0b9050900989 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:55.097318 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2407566-8a0b-476b-93f2-0b9050900989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:55.165283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2407566-8a0b-476b-93f2-0b9050900989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:55.166732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2407566-8a0b-476b-93f2-0b9050900989 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:55.262963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 574/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:46:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:46:55.268869 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fef2e-0903-4371-baa2-d7063c8efac5 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:55.308387 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:55.367249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fef2e-0903-4371-baa2-d7063c8efac5 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:55.399935 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0518c44-53db-40e3-a227-9dbcebb2cd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:55.400556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0518c44-53db-40e3-a227-9dbcebb2cd55 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:55.400835 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0518c44-53db-40e3-a227-9dbcebb2cd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:55.401108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0518c44-53db-40e3-a227-9dbcebb2cd55 None admin] PATH_INFO: `/v3/projects/0044bcd83cfc40bca9b9deb1596cff0b` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:55.402202 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0518c44-53db-40e3-a227-9dbcebb2cd55 None admin] RBAC: Authorizing `identity:get_project(project_id=0044bcd83cfc40bca9b9deb1596cff0b)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:55.403655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0518c44-53db-40e3-a227-9dbcebb2cd55 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:55.405298 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 571/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:46:55 2022] GET /identity/v3/projects/0044bcd83cfc40bca9b9deb1596cff0b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:55.412017 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2407566-8a0b-476b-93f2-0b9050900989 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:55.429887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:55.510255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2407566-8a0b-476b-93f2-0b9050900989 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:55.543273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287a78e-76a2-4d0e-aed0-fd9385ab2209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:55.543895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a78e-76a2-4d0e-aed0-fd9385ab2209 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:55.544174 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a78e-76a2-4d0e-aed0-fd9385ab2209 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:55.544452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a78e-76a2-4d0e-aed0-fd9385ab2209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:55.545166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287a78e-76a2-4d0e-aed0-fd9385ab2209 None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=0044bcd83cfc40bca9b9deb1596cff0b, user.id=e92b395d768748b19ed5904bbba085a1) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:55.545479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287a78e-76a2-4d0e-aed0-fd9385ab2209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:55.547499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287a78e-76a2-4d0e-aed0-fd9385ab2209 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:55.552798 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 575/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:46:55 2022] GET /identity/v3/role_assignments?user.id=e92b395d768748b19ed5904bbba085a1&scope.project.id=0044bcd83cfc40bca9b9deb1596cff0b&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:57.427262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dfe81-d4d1-4ce4-b4d8-257b383f492c None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:57.427793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dfe81-d4d1-4ce4-b4d8-257b383f492c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:57.427793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10dfe81-d4d1-4ce4-b4d8-257b383f492c None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:57.429120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 572/1147] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:46:57.434341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfdc67-7f65-4b6a-9459-3937d352da27 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:57.434739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfdc67-7f65-4b6a-9459-3937d352da27 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:57.434880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfdc67-7f65-4b6a-9459-3937d352da27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:57.453962 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-4ccfdc67-7f65-4b6a-9459-3937d352da27 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:46:57.455789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-4ccfdc67-7f65-4b6a-9459-3937d352da27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:46:57.522714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 576/1148] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:46:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:46:57.788692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dfe81-d4d1-4ce4-b4d8-257b383f492c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:57.887237 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10dfe81-d4d1-4ce4-b4d8-257b383f492c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:57.894941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:57.926496 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7877f94-a629-4c19-b194-1e071830b19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:57.927123 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7877f94-a629-4c19-b194-1e071830b19b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:57.927403 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7877f94-a629-4c19-b194-1e071830b19b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:57.927674 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7877f94-a629-4c19-b194-1e071830b19b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:57.938264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7877f94-a629-4c19-b194-1e071830b19b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-d7877f94-a629-4c19-b194-1e071830b19b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:46:57.943080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:46:57.944283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:46:57.945338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:46:57.945338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:46:57.945338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:46:57.945338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:46:57.945338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:46:57.945338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:46:57.945338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:46:57.945338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:46:57.945338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:46:57.945338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:46:57.945338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:46:57.945338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:46:57.948024 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 573/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:46:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:46:57.950221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfdc67-7f65-4b6a-9459-3937d352da27 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:57.961684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:58.068961 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfdc67-7f65-4b6a-9459-3937d352da27 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:58.106406 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107b1c6-2588-4053-9321-ba0f764465b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:58.107007 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107b1c6-2588-4053-9321-ba0f764465b4 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:58.107286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107b1c6-2588-4053-9321-ba0f764465b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:58.107557 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107b1c6-2588-4053-9321-ba0f764465b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:58.108240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107b1c6-2588-4053-9321-ba0f764465b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:46:58.109077 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107b1c6-2588-4053-9321-ba0f764465b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:58.110430 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107b1c6-2588-4053-9321-ba0f764465b4 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:58.118203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 577/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:46:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:58.124847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7877f94-a629-4c19-b194-1e071830b19b None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:58.223565 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7877f94-a629-4c19-b194-1e071830b19b None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:58.257503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dda775-1283-4203-99b1-7c4ba33977c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:58.258127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dda775-1283-4203-99b1-7c4ba33977c3 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:58.258409 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dda775-1283-4203-99b1-7c4ba33977c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:58.258686 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dda775-1283-4203-99b1-7c4ba33977c3 None admin] PATH_INFO: `/v3/users/e92b395d768748b19ed5904bbba085a1` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:58.259799 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dda775-1283-4203-99b1-7c4ba33977c3 None admin] RBAC: Authorizing `identity:get_user(user_id=e92b395d768748b19ed5904bbba085a1)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:58.261258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dda775-1283-4203-99b1-7c4ba33977c3 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:58.262838 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 574/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:46:58 2022] GET /identity/v3/users/e92b395d768748b19ed5904bbba085a1 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:58.268685 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107b1c6-2588-4053-9321-ba0f764465b4 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:58.337069 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:58.368020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107b1c6-2588-4053-9321-ba0f764465b4 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:58.409098 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc08b2-d714-4698-b653-3cb6f1cd594b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:58.409735 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc08b2-d714-4698-b653-3cb6f1cd594b None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:58.410015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc08b2-d714-4698-b653-3cb6f1cd594b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:58.410286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc08b2-d714-4698-b653-3cb6f1cd594b None admin] PATH_INFO: `/v3/projects/0044bcd83cfc40bca9b9deb1596cff0b` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:58.411386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc08b2-d714-4698-b653-3cb6f1cd594b None admin] RBAC: Authorizing `identity:get_project(project_id=0044bcd83cfc40bca9b9deb1596cff0b)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:58.412843 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc08b2-d714-4698-b653-3cb6f1cd594b None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:58.414473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 578/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:46:58 2022] GET /identity/v3/projects/0044bcd83cfc40bca9b9deb1596cff0b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:46:58.420446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dda775-1283-4203-99b1-7c4ba33977c3 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:46:58.455684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:46:58.520511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dda775-1283-4203-99b1-7c4ba33977c3 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:46:58.553020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc34054-1418-4f33-834e-63383d3d69b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:46:58.553662 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc34054-1418-4f33-834e-63383d3d69b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:46:58.553939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc34054-1418-4f33-834e-63383d3d69b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:46:58.554210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc34054-1418-4f33-834e-63383d3d69b0 None admin] PATH_INFO: `/v3/projects/0044bcd83cfc40bca9b9deb1596cff0b/users/e92b395d768748b19ed5904bbba085a1/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:46:58.556088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc34054-1418-4f33-834e-63383d3d69b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=0044bcd83cfc40bca9b9deb1596cff0b, user_id=e92b395d768748b19ed5904bbba085a1, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:46:58.557509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc34054-1418-4f33-834e-63383d3d69b0 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:46:58.666345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 575/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:46:58 2022] PUT /identity/v3/projects/0044bcd83cfc40bca9b9deb1596cff0b/users/e92b395d768748b19ed5904bbba085a1/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:47:00.529853 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ff04a-df53-41bf-87a2-8cb0dd5ad88d None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:00.530870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ff04a-df53-41bf-87a2-8cb0dd5ad88d None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:00.530870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ff04a-df53-41bf-87a2-8cb0dd5ad88d None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:00.532201 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 579/1154] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:00.537319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8714cc7-7770-4fab-9165-e206b468505d None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:00.537712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8714cc7-7770-4fab-9165-e206b468505d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:00.537865 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8714cc7-7770-4fab-9165-e206b468505d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:00.556224 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-f8714cc7-7770-4fab-9165-e206b468505d None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:00.557392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f8714cc7-7770-4fab-9165-e206b468505d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:00.621509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 576/1155] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:47:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:47:00.890548 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ff04a-df53-41bf-87a2-8cb0dd5ad88d None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:00.992297 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ff04a-df53-41bf-87a2-8cb0dd5ad88d None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:01.024998 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a380748-9c71-457c-9cd7-0787da8739a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:01.025615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a380748-9c71-457c-9cd7-0787da8739a8 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:01.025894 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a380748-9c71-457c-9cd7-0787da8739a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:01.026168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a380748-9c71-457c-9cd7-0787da8739a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:01.034117 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:01.037564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a380748-9c71-457c-9cd7-0787da8739a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-9a380748-9c71-457c-9cd7-0787da8739a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:47:01.042396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:47:01.048283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:47:01.049178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:47:01.049178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:47:01.049178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:47:01.049178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:47:01.049178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:47:01.049178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:47:01.049178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:47:01.049178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:47:01.049178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:47:01.049178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:47:01.049178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:47:01.049178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:47:01.049178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 580/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:47:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:47:01.049994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8714cc7-7770-4fab-9165-e206b468505d None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:01.094357 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:01.187407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8714cc7-7770-4fab-9165-e206b468505d None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:01.220889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d276e6-f4b1-4c56-990b-a11124193f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:01.221475 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d276e6-f4b1-4c56-990b-a11124193f83 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:01.221750 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d276e6-f4b1-4c56-990b-a11124193f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:01.222017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d276e6-f4b1-4c56-990b-a11124193f83 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:01.222673 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d276e6-f4b1-4c56-990b-a11124193f83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:47:01.222972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d276e6-f4b1-4c56-990b-a11124193f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:01.224348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d276e6-f4b1-4c56-990b-a11124193f83 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:01.232107 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 577/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:47:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:47:01.237939 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a380748-9c71-457c-9cd7-0787da8739a8 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:01.336934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a380748-9c71-457c-9cd7-0787da8739a8 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:01.370475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c59913-d3f3-4bac-840c-120c0596ab2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:01.371097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c59913-d3f3-4bac-840c-120c0596ab2b None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:01.371383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c59913-d3f3-4bac-840c-120c0596ab2b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:01.371662 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c59913-d3f3-4bac-840c-120c0596ab2b None admin] PATH_INFO: `/v3/users/e92b395d768748b19ed5904bbba085a1` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:01.372804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c59913-d3f3-4bac-840c-120c0596ab2b None admin] RBAC: Authorizing `identity:get_user(user_id=e92b395d768748b19ed5904bbba085a1)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:01.374230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c59913-d3f3-4bac-840c-120c0596ab2b None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:01.375801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 581/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:47:01 2022] GET /identity/v3/users/e92b395d768748b19ed5904bbba085a1 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:47:01.382502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d276e6-f4b1-4c56-990b-a11124193f83 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:01.477094 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:01.491520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d276e6-f4b1-4c56-990b-a11124193f83 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:01.525456 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddf5b0-ea83-4ddb-aa71-0a1d92c1234b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:01.526063 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddf5b0-ea83-4ddb-aa71-0a1d92c1234b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:01.526345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddf5b0-ea83-4ddb-aa71-0a1d92c1234b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:01.526619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddf5b0-ea83-4ddb-aa71-0a1d92c1234b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:01.592218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddf5b0-ea83-4ddb-aa71-0a1d92c1234b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:01.593715 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddf5b0-ea83-4ddb-aa71-0a1d92c1234b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:01.675144 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:01.691010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 578/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:47:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:47:01.697003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c59913-d3f3-4bac-840c-120c0596ab2b None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:01.762043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:01.794087 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c59913-d3f3-4bac-840c-120c0596ab2b None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:01.827116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c5dc5-68a4-46d9-93af-fb50e2627e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:01.827739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c5dc5-68a4-46d9-93af-fb50e2627e7f None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:01.828072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c5dc5-68a4-46d9-93af-fb50e2627e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:01.828347 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c5dc5-68a4-46d9-93af-fb50e2627e7f None admin] PATH_INFO: `/v3/projects/0044bcd83cfc40bca9b9deb1596cff0b` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:01.829468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c5dc5-68a4-46d9-93af-fb50e2627e7f None admin] RBAC: Authorizing `identity:get_project(project_id=0044bcd83cfc40bca9b9deb1596cff0b)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:01.830886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c5dc5-68a4-46d9-93af-fb50e2627e7f None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:01.832542 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 582/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:47:01 2022] GET /identity/v3/projects/0044bcd83cfc40bca9b9deb1596cff0b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:47:01.838648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddf5b0-ea83-4ddb-aa71-0a1d92c1234b None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:01.943172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddf5b0-ea83-4ddb-aa71-0a1d92c1234b None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:01.977624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d01221-b943-4ce0-9f8e-9c9c61a45ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:01.978220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01221-b943-4ce0-9f8e-9c9c61a45ddb None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:01.978502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01221-b943-4ce0-9f8e-9c9c61a45ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:01.978773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01221-b943-4ce0-9f8e-9c9c61a45ddb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:01.979491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d01221-b943-4ce0-9f8e-9c9c61a45ddb None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=0044bcd83cfc40bca9b9deb1596cff0b, user.id=e92b395d768748b19ed5904bbba085a1) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:47:01.979800 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d01221-b943-4ce0-9f8e-9c9c61a45ddb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:01.981245 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d01221-b943-4ce0-9f8e-9c9c61a45ddb None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:01.987469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 579/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:47:01 2022] GET /identity/v3/role_assignments?user.id=e92b395d768748b19ed5904bbba085a1&scope.project.id=0044bcd83cfc40bca9b9deb1596cff0b&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:47:03.938904 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d53713-98a4-4713-a173-ab1a809b9e74 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:03.939515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d53713-98a4-4713-a173-ab1a809b9e74 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:03.939515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d53713-98a4-4713-a173-ab1a809b9e74 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:03.940827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 583/1162] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:03.946023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75601aab-fd28-4da7-987d-79107a8306e0 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:03.946452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75601aab-fd28-4da7-987d-79107a8306e0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:03.946575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75601aab-fd28-4da7-987d-79107a8306e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:03.969790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-75601aab-fd28-4da7-987d-79107a8306e0 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:03.971900 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-75601aab-fd28-4da7-987d-79107a8306e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:04.019450 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:04.039371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 580/1163] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:47:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:47:04.304135 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d53713-98a4-4713-a173-ab1a809b9e74 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:04.404082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d53713-98a4-4713-a173-ab1a809b9e74 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:04.436898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16e837-32d0-49a1-85fa-1db652e91bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:04.437491 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16e837-32d0-49a1-85fa-1db652e91bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:04.437771 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16e837-32d0-49a1-85fa-1db652e91bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:04.438044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16e837-32d0-49a1-85fa-1db652e91bf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:04.441337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:04.506760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16e837-32d0-49a1-85fa-1db652e91bf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:04.508242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16e837-32d0-49a1-85fa-1db652e91bf4 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:04.604412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 584/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:47:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:47:04.610925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75601aab-fd28-4da7-987d-79107a8306e0 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:04.706651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75601aab-fd28-4da7-987d-79107a8306e0 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:04.739362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b80627-55f0-4b12-94e9-89b6ac408d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:04.740008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b80627-55f0-4b12-94e9-89b6ac408d53 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:04.740289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b80627-55f0-4b12-94e9-89b6ac408d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:04.740562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b80627-55f0-4b12-94e9-89b6ac408d53 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:04.747010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b80627-55f0-4b12-94e9-89b6ac408d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:04.748473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b80627-55f0-4b12-94e9-89b6ac408d53 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-91b80627-55f0-4b12-94e9-89b6ac408d53 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:47:04.759834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:47:04.761108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:47:04.762225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:47:04.762225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:47:04.762225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:47:04.762225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:47:04.762225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:47:04.762225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:47:04.762225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:47:04.762225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:47:04.762225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:47:04.762225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:47:04.762225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 13:47:04.762225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:47:04.762225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 13:47:04.762225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:47:04.762225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 581/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 13:47:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:47:04.767541 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16e837-32d0-49a1-85fa-1db652e91bf4 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:04.801211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:04.864024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16e837-32d0-49a1-85fa-1db652e91bf4 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:04.897431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287349f4-d0a8-4aac-bb9e-1dfd3762afbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:04.898032 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287349f4-d0a8-4aac-bb9e-1dfd3762afbc None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:04.898311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287349f4-d0a8-4aac-bb9e-1dfd3762afbc None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:04.898586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287349f4-d0a8-4aac-bb9e-1dfd3762afbc None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:04.899221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287349f4-d0a8-4aac-bb9e-1dfd3762afbc None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:47:04.899525 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287349f4-d0a8-4aac-bb9e-1dfd3762afbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:04.900911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287349f4-d0a8-4aac-bb9e-1dfd3762afbc None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:04.908468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 585/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Sep 1 13:47:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:47:06.810556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729af4e2-0655-43dc-8876-6f7cb2711e69 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:06.811604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729af4e2-0655-43dc-8876-6f7cb2711e69 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:06.811604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729af4e2-0655-43dc-8876-6f7cb2711e69 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:06.812994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 582/1167] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:06.818242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b564e3f-408e-435a-bbf0-b40a04140d86 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:06.818664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b564e3f-408e-435a-bbf0-b40a04140d86 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:06.818801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b564e3f-408e-435a-bbf0-b40a04140d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:06.837259 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1b564e3f-408e-435a-bbf0-b40a04140d86 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:06.838445 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1b564e3f-408e-435a-bbf0-b40a04140d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:06.903842 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 586/1168] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:47:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:47:07.171161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729af4e2-0655-43dc-8876-6f7cb2711e69 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:07.214189 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:07.272465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729af4e2-0655-43dc-8876-6f7cb2711e69 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:07.305795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db943d6-8fc7-422b-9d10-6e9ebba2513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:07.306383 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db943d6-8fc7-422b-9d10-6e9ebba2513f None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:07.306659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db943d6-8fc7-422b-9d10-6e9ebba2513f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:07.306929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db943d6-8fc7-422b-9d10-6e9ebba2513f None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:07.307586 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db943d6-8fc7-422b-9d10-6e9ebba2513f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:07.308968 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db943d6-8fc7-422b-9d10-6e9ebba2513f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:07.381525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 583/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Thu Sep 1 13:47:07 2022] POST /identity/v3/domains => generated 267 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:47:09.309461 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e612f00-c036-48c1-87da-e539b6e81820 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:09.310015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e612f00-c036-48c1-87da-e539b6e81820 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:09.310015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e612f00-c036-48c1-87da-e539b6e81820 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:09.311365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 587/1170] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:09.316712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0650-83e4-4d6a-a763-ae50e68e0aa4 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:09.317127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0650-83e4-4d6a-a763-ae50e68e0aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:09.317273 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0650-83e4-4d6a-a763-ae50e68e0aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:09.335498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b80c0650-83e4-4d6a-a763-ae50e68e0aa4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:09.336717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b80c0650-83e4-4d6a-a763-ae50e68e0aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:09.402209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 584/1171] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:47:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:47:09.676595 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e612f00-c036-48c1-87da-e539b6e81820 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:09.707707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:09.776429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e612f00-c036-48c1-87da-e539b6e81820 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:09.808395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f676ef-80f0-4a26-8e20-ce5f0372d4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:09.809013 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f676ef-80f0-4a26-8e20-ce5f0372d4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:09.809289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f676ef-80f0-4a26-8e20-ce5f0372d4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:09.809559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f676ef-80f0-4a26-8e20-ce5f0372d4a2 None admin] PATH_INFO: `/v3/domains/d8cad6dfa75144d09637bd6b0ca3f4b5` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:09.820019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f676ef-80f0-4a26-8e20-ce5f0372d4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d8cad6dfa75144d09637bd6b0ca3f4b5)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:09.821445 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f676ef-80f0-4a26-8e20-ce5f0372d4a2 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:09.822997 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 588/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Thu Sep 1 13:47:09 2022] GET /identity/v3/domains/d8cad6dfa75144d09637bd6b0ca3f4b5 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:47:09.829504 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0650-83e4-4d6a-a763-ae50e68e0aa4 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:09.858381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:09.926729 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0650-83e4-4d6a-a763-ae50e68e0aa4 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:09.959654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe51349-58e1-48cb-bad4-ea7d4960321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:09.960289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe51349-58e1-48cb-bad4-ea7d4960321b None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:09.960573 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe51349-58e1-48cb-bad4-ea7d4960321b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:09.960849 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe51349-58e1-48cb-bad4-ea7d4960321b None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:09.961488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe51349-58e1-48cb-bad4-ea7d4960321b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:09.962907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe51349-58e1-48cb-bad4-ea7d4960321b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:10.079524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 585/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 13:47:09 2022] POST /identity/v3/projects => generated 361 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:47:11.990383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84ef41-ff85-4477-8a26-b1234de2f730 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:11.990940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84ef41-ff85-4477-8a26-b1234de2f730 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:11.990940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84ef41-ff85-4477-8a26-b1234de2f730 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:11.992359 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 589/1174] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:11.997537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f22da4-8038-4c29-b8de-ab8e18eede72 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:11.997927 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f22da4-8038-4c29-b8de-ab8e18eede72 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:11.998099 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f22da4-8038-4c29-b8de-ab8e18eede72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:12.018246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-d4f22da4-8038-4c29-b8de-ab8e18eede72 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:12.019433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d4f22da4-8038-4c29-b8de-ab8e18eede72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:12.089426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 586/1175] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:47:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:47:12.353982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84ef41-ff85-4477-8a26-b1234de2f730 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:12.444606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:12.454716 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84ef41-ff85-4477-8a26-b1234de2f730 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:12.487338 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee39e9-ba77-4e57-b882-3a6af905f7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:12.488106 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee39e9-ba77-4e57-b882-3a6af905f7cc None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:12.488745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee39e9-ba77-4e57-b882-3a6af905f7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:12.489023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee39e9-ba77-4e57-b882-3a6af905f7cc None admin] PATH_INFO: `/v3/domains/d8cad6dfa75144d09637bd6b0ca3f4b5` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:12.490132 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee39e9-ba77-4e57-b882-3a6af905f7cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=d8cad6dfa75144d09637bd6b0ca3f4b5)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:12.491563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee39e9-ba77-4e57-b882-3a6af905f7cc None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:12.493134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 590/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Thu Sep 1 13:47:12 2022] GET /identity/v3/domains/d8cad6dfa75144d09637bd6b0ca3f4b5 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:47:12.499353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f22da4-8038-4c29-b8de-ab8e18eede72 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:12.513571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:12.596948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f22da4-8038-4c29-b8de-ab8e18eede72 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:12.631702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e09b9c-89e0-4928-9136-c26fea3988e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:12.632272 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e09b9c-89e0-4928-9136-c26fea3988e0 None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:12.632553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e09b9c-89e0-4928-9136-c26fea3988e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:12.632826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e09b9c-89e0-4928-9136-c26fea3988e0 None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:12.633475 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e09b9c-89e0-4928-9136-c26fea3988e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:12.634894 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e09b9c-89e0-4928-9136-c26fea3988e0 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:12.752546 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 587/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:47:12 2022] POST /identity/v3/users => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:47:14.685066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d01c0-f34d-4e54-847d-7731fb452899 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:14.685626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d01c0-f34d-4e54-847d-7731fb452899 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:14.685626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d01c0-f34d-4e54-847d-7731fb452899 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:14.687503 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 591/1178] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:14.692652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18214ac8-6ae7-45a9-8dd4-286b9578f8d1 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:14.693025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18214ac8-6ae7-45a9-8dd4-286b9578f8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:14.693216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18214ac8-6ae7-45a9-8dd4-286b9578f8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:14.711367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-18214ac8-6ae7-45a9-8dd4-286b9578f8d1 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:14.712585 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-18214ac8-6ae7-45a9-8dd4-286b9578f8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:14.772800 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:14.778038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 588/1179] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:47:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:47:15.049496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d01c0-f34d-4e54-847d-7731fb452899 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:15.153656 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d01c0-f34d-4e54-847d-7731fb452899 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:15.187735 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12653b18-8018-4845-a6a6-dd2d50825808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:15.188374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12653b18-8018-4845-a6a6-dd2d50825808 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:15.188651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12653b18-8018-4845-a6a6-dd2d50825808 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:15.188917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12653b18-8018-4845-a6a6-dd2d50825808 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:15.198611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12653b18-8018-4845-a6a6-dd2d50825808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-12653b18-8018-4845-a6a6-dd2d50825808 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:47:15.203409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:47:15.204583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:47:15.205841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:47:15.205841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:47:15.205841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:47:15.205841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:47:15.205841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:47:15.205841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:47:15.205841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:47:15.205841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:47:15.205841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:47:15.205841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:47:15.205841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:47:15.205841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:47:15.205841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 592/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:47:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:47:15.210489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18214ac8-6ae7-45a9-8dd4-286b9578f8d1 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:15.305966 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18214ac8-6ae7-45a9-8dd4-286b9578f8d1 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:15.338687 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebfc57-45bc-4869-9b6f-ae202864e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:15.339301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebfc57-45bc-4869-9b6f-ae202864e6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:15.339574 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebfc57-45bc-4869-9b6f-ae202864e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:15.339844 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebfc57-45bc-4869-9b6f-ae202864e6b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:15.340515 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebfc57-45bc-4869-9b6f-ae202864e6b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:47:15.340815 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebfc57-45bc-4869-9b6f-ae202864e6b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:15.342198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebfc57-45bc-4869-9b6f-ae202864e6b2 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:15.350016 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 589/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:47:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:47:15.355939 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12653b18-8018-4845-a6a6-dd2d50825808 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:15.376053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:15.533074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12653b18-8018-4845-a6a6-dd2d50825808 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:15.566275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fce9a1-52b8-43b0-abda-f0d7387a3a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:15.566833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fce9a1-52b8-43b0-abda-f0d7387a3a5b None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:15.567117 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fce9a1-52b8-43b0-abda-f0d7387a3a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:15.567395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fce9a1-52b8-43b0-abda-f0d7387a3a5b None admin] PATH_INFO: `/v3/users/a105e9c75e444ce0a2e03db8be34df06` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:15.580054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fce9a1-52b8-43b0-abda-f0d7387a3a5b None admin] RBAC: Authorizing `identity:get_user(user_id=a105e9c75e444ce0a2e03db8be34df06)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:15.581492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fce9a1-52b8-43b0-abda-f0d7387a3a5b None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:15.583074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 593/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:47:15 2022] GET /identity/v3/users/a105e9c75e444ce0a2e03db8be34df06 => generated 311 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:47:15.588924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebfc57-45bc-4869-9b6f-ae202864e6b2 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:15.646948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:15.687525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebfc57-45bc-4869-9b6f-ae202864e6b2 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:15.720346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0481c-9413-4d77-919d-96935b60ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:15.720952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0481c-9413-4d77-919d-96935b60ecb7 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:15.721217 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0481c-9413-4d77-919d-96935b60ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:15.721488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0481c-9413-4d77-919d-96935b60ecb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:15.787373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0481c-9413-4d77-919d-96935b60ecb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:15.788841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0481c-9413-4d77-919d-96935b60ecb7 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:15.844356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:15.885281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 590/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:47:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:47:15.891727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fce9a1-52b8-43b0-abda-f0d7387a3a5b None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:15.975298 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:15.997020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fce9a1-52b8-43b0-abda-f0d7387a3a5b None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:16.032610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1c165-2453-4e37-b8ff-d73c70e86a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:16.033232 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1c165-2453-4e37-b8ff-d73c70e86a22 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:16.033510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1c165-2453-4e37-b8ff-d73c70e86a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:16.033777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1c165-2453-4e37-b8ff-d73c70e86a22 None admin] PATH_INFO: `/v3/projects/1ba5cb72a59d4bb4a63f426545fcc0e4` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:16.034865 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1c165-2453-4e37-b8ff-d73c70e86a22 None admin] RBAC: Authorizing `identity:get_project(project_id=1ba5cb72a59d4bb4a63f426545fcc0e4)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:16.036318 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1c165-2453-4e37-b8ff-d73c70e86a22 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:16.037925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 594/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:47:15 2022] GET /identity/v3/projects/1ba5cb72a59d4bb4a63f426545fcc0e4 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:47:16.044065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0481c-9413-4d77-919d-96935b60ecb7 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:16.146118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0481c-9413-4d77-919d-96935b60ecb7 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:16.179455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f6f2f-c2ee-4132-8bed-111f8752cd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:16.180082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f6f2f-c2ee-4132-8bed-111f8752cd54 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:16.180359 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f6f2f-c2ee-4132-8bed-111f8752cd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:16.180627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f6f2f-c2ee-4132-8bed-111f8752cd54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:16.181341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f6f2f-c2ee-4132-8bed-111f8752cd54 None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=1ba5cb72a59d4bb4a63f426545fcc0e4, user.id=a105e9c75e444ce0a2e03db8be34df06) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:47:16.181644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f6f2f-c2ee-4132-8bed-111f8752cd54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:16.183044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f6f2f-c2ee-4132-8bed-111f8752cd54 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:16.188403 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 591/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:47:16 2022] GET /identity/v3/role_assignments?user.id=a105e9c75e444ce0a2e03db8be34df06&scope.project.id=1ba5cb72a59d4bb4a63f426545fcc0e4&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:47:18.074860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e39fd3-2e5c-4afc-b102-8b4b71bf51f3 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:18.075442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e39fd3-2e5c-4afc-b102-8b4b71bf51f3 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:18.075442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e39fd3-2e5c-4afc-b102-8b4b71bf51f3 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:18.076883 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 595/1186] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:18.082241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b8812-e920-4d54-aeda-95aa1711b974 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:18.082668 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b8812-e920-4d54-aeda-95aa1711b974 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:18.082761 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b8812-e920-4d54-aeda-95aa1711b974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:18.100862 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-740b8812-e920-4d54-aeda-95aa1711b974 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:18.102023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-740b8812-e920-4d54-aeda-95aa1711b974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:18.118640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:18.171060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 592/1187] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:47:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:47:18.452097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e39fd3-2e5c-4afc-b102-8b4b71bf51f3 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:18.550924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e39fd3-2e5c-4afc-b102-8b4b71bf51f3 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:18.582653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b135940-c188-4a1c-9c39-f62effae00f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:18.583262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b135940-c188-4a1c-9c39-f62effae00f3 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:18.583541 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b135940-c188-4a1c-9c39-f62effae00f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:18.583813 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b135940-c188-4a1c-9c39-f62effae00f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:18.595513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b135940-c188-4a1c-9c39-f62effae00f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-1b135940-c188-4a1c-9c39-f62effae00f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:47:18.600258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:47:18.601454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:47:18.602333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:47:18.602333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:47:18.602333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:47:18.602333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:47:18.602333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:47:18.602333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:47:18.602333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:47:18.602333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:47:18.602333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:47:18.602333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:47:18.602333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:47:18.602333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:47:18.602333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 596/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:47:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:47:18.608328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b8812-e920-4d54-aeda-95aa1711b974 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:18.707813 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b8812-e920-4d54-aeda-95aa1711b974 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:18.741132 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6e992-3e1b-43a2-a0f5-2100080abaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:18.741731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6e992-3e1b-43a2-a0f5-2100080abaeb None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:18.742009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6e992-3e1b-43a2-a0f5-2100080abaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:18.742279 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6e992-3e1b-43a2-a0f5-2100080abaeb None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:18.742931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6e992-3e1b-43a2-a0f5-2100080abaeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:47:18.743234 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6e992-3e1b-43a2-a0f5-2100080abaeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:18.744615 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6e992-3e1b-43a2-a0f5-2100080abaeb None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:18.752489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 593/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:47:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:47:18.758627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b135940-c188-4a1c-9c39-f62effae00f3 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:18.762928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:18.857455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b135940-c188-4a1c-9c39-f62effae00f3 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:18.891817 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80685b24-326f-4d9f-a83a-30571b137022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:18.892468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80685b24-326f-4d9f-a83a-30571b137022 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:18.892751 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80685b24-326f-4d9f-a83a-30571b137022 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:18.893027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80685b24-326f-4d9f-a83a-30571b137022 None admin] PATH_INFO: `/v3/users/a105e9c75e444ce0a2e03db8be34df06` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:18.894138 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80685b24-326f-4d9f-a83a-30571b137022 None admin] RBAC: Authorizing `identity:get_user(user_id=a105e9c75e444ce0a2e03db8be34df06)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:18.895581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80685b24-326f-4d9f-a83a-30571b137022 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:18.897171 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 597/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:47:18 2022] GET /identity/v3/users/a105e9c75e444ce0a2e03db8be34df06 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:47:18.903016 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6e992-3e1b-43a2-a0f5-2100080abaeb None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:18.921805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:19.027719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6e992-3e1b-43a2-a0f5-2100080abaeb None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:19.061655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dcc1b-5348-435c-9b71-cc4a9c8b907f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:19.062274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dcc1b-5348-435c-9b71-cc4a9c8b907f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:19.062547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dcc1b-5348-435c-9b71-cc4a9c8b907f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:19.062817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dcc1b-5348-435c-9b71-cc4a9c8b907f None admin] PATH_INFO: `/v3/projects/1ba5cb72a59d4bb4a63f426545fcc0e4` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:19.063948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59dcc1b-5348-435c-9b71-cc4a9c8b907f None admin] RBAC: Authorizing `identity:get_project(project_id=1ba5cb72a59d4bb4a63f426545fcc0e4)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:19.065370 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59dcc1b-5348-435c-9b71-cc4a9c8b907f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:19.066982 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 594/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:47:18 2022] GET /identity/v3/projects/1ba5cb72a59d4bb4a63f426545fcc0e4 => generated 361 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:47:19.072953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80685b24-326f-4d9f-a83a-30571b137022 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:19.141974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:19.171629 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80685b24-326f-4d9f-a83a-30571b137022 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:19.205474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47281cc9-f6e9-4e81-9ae1-aa2d0616e288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:19.206119 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47281cc9-f6e9-4e81-9ae1-aa2d0616e288 None admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:19.206401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47281cc9-f6e9-4e81-9ae1-aa2d0616e288 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:19.206675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47281cc9-f6e9-4e81-9ae1-aa2d0616e288 None admin] PATH_INFO: `/v3/projects/1ba5cb72a59d4bb4a63f426545fcc0e4/users/a105e9c75e444ce0a2e03db8be34df06/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:19.208662 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47281cc9-f6e9-4e81-9ae1-aa2d0616e288 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba5cb72a59d4bb4a63f426545fcc0e4, user_id=a105e9c75e444ce0a2e03db8be34df06, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:19.210136 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47281cc9-f6e9-4e81-9ae1-aa2d0616e288 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:19.311907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 598/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:47:19 2022] PUT /identity/v3/projects/1ba5cb72a59d4bb4a63f426545fcc0e4/users/a105e9c75e444ce0a2e03db8be34df06/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:47:21.176445 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c88a6-d7d9-47c2-8663-bd2d9d709790 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:21.176847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c88a6-d7d9-47c2-8663-bd2d9d709790 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:21.177001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c88a6-d7d9-47c2-8663-bd2d9d709790 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:21.178350 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 595/1193] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:47:21.183620 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c901f-bdce-4b87-b988-3d885bda082b None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:21.184085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c901f-bdce-4b87-b988-3d885bda082b None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:21.184180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c901f-bdce-4b87-b988-3d885bda082b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:21.202715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-d18c901f-bdce-4b87-b988-3d885bda082b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:47:21.203906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d18c901f-bdce-4b87-b988-3d885bda082b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:47:21.268563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 599/1194] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:47:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:47:21.537188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c88a6-d7d9-47c2-8663-bd2d9d709790 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:21.620046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:21.650027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c88a6-d7d9-47c2-8663-bd2d9d709790 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:21.683380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f1ea3-2675-4c17-a3bd-23aa08974427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:21.684029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f1ea3-2675-4c17-a3bd-23aa08974427 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:21.684316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f1ea3-2675-4c17-a3bd-23aa08974427 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:21.684593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f1ea3-2675-4c17-a3bd-23aa08974427 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:21.695022 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f1ea3-2675-4c17-a3bd-23aa08974427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-3d9f1ea3-2675-4c17-a3bd-23aa08974427 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:47:21.699805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:47:21.700947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:47:21.702567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:47:21.702567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:47:21.702567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:47:21.702567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:47:21.702567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:47:21.702567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:47:21.702567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:47:21.702567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:47:21.702567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:47:21.702567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:47:21.702567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:47:21.702567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:47:21.704016 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 596/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:47:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:47:21.707592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c901f-bdce-4b87-b988-3d885bda082b None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:21.766175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:21.801835 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c901f-bdce-4b87-b988-3d885bda082b None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:21.835670 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b8625-3428-410e-ad2e-1475c13e6a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:21.836312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b8625-3428-410e-ad2e-1475c13e6a16 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:21.836794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b8625-3428-410e-ad2e-1475c13e6a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:21.837230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b8625-3428-410e-ad2e-1475c13e6a16 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:21.838353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b8625-3428-410e-ad2e-1475c13e6a16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:47:21.838659 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b8625-3428-410e-ad2e-1475c13e6a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:21.840060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b8625-3428-410e-ad2e-1475c13e6a16 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:21.847912 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 600/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:47:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:47:21.853739 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f1ea3-2675-4c17-a3bd-23aa08974427 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:21.954101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f1ea3-2675-4c17-a3bd-23aa08974427 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:21.986639 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bf81e-d186-4006-9145-f008978d527e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:21.987263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bf81e-d186-4006-9145-f008978d527e None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:21.987544 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bf81e-d186-4006-9145-f008978d527e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:21.987818 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bf81e-d186-4006-9145-f008978d527e None admin] PATH_INFO: `/v3/users/a105e9c75e444ce0a2e03db8be34df06` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:21.988956 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bf81e-d186-4006-9145-f008978d527e None admin] RBAC: Authorizing `identity:get_user(user_id=a105e9c75e444ce0a2e03db8be34df06)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:21.990381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bf81e-d186-4006-9145-f008978d527e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:21.991964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 597/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Sep 1 13:47:21 2022] GET /identity/v3/users/a105e9c75e444ce0a2e03db8be34df06 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:47:21.998452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b8625-3428-410e-ad2e-1475c13e6a16 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:22.095274 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b8625-3428-410e-ad2e-1475c13e6a16 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:22.117606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:22.127917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f567b-3908-45f3-954f-d877a45cfccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:22.128516 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f567b-3908-45f3-954f-d877a45cfccf None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:22.128799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f567b-3908-45f3-954f-d877a45cfccf None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:22.129075 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f567b-3908-45f3-954f-d877a45cfccf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:22.200376 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f567b-3908-45f3-954f-d877a45cfccf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:22.202350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f567b-3908-45f3-954f-d877a45cfccf None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:22.332302 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 601/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:47:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:47:22.340401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bf81e-d186-4006-9145-f008978d527e None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:22.357419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:22.441093 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bf81e-d186-4006-9145-f008978d527e None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:22.473928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88beaf0-228f-46ec-9cd8-10b1ef36cba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:22.474547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88beaf0-228f-46ec-9cd8-10b1ef36cba3 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:22.474827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88beaf0-228f-46ec-9cd8-10b1ef36cba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:22.475101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88beaf0-228f-46ec-9cd8-10b1ef36cba3 None admin] PATH_INFO: `/v3/projects/1ba5cb72a59d4bb4a63f426545fcc0e4` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:22.476226 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88beaf0-228f-46ec-9cd8-10b1ef36cba3 None admin] RBAC: Authorizing `identity:get_project(project_id=1ba5cb72a59d4bb4a63f426545fcc0e4)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:22.477645 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88beaf0-228f-46ec-9cd8-10b1ef36cba3 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:22.479258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 598/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Sep 1 13:47:22 2022] GET /identity/v3/projects/1ba5cb72a59d4bb4a63f426545fcc0e4 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:47:22.485375 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f567b-3908-45f3-954f-d877a45cfccf None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:47:22.510922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:22.583455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f567b-3908-45f3-954f-d877a45cfccf None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:47:22.616792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f813455-214a-4f53-aaf7-0849e722bcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:47:22.617333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f813455-214a-4f53-aaf7-0849e722bcce None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:47:22.617612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f813455-214a-4f53-aaf7-0849e722bcce None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:47:22.617911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f813455-214a-4f53-aaf7-0849e722bcce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:47:22.618627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f813455-214a-4f53-aaf7-0849e722bcce None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=1ba5cb72a59d4bb4a63f426545fcc0e4, user.id=a105e9c75e444ce0a2e03db8be34df06) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:47:22.618934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f813455-214a-4f53-aaf7-0849e722bcce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:47:22.620383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f813455-214a-4f53-aaf7-0849e722bcce None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:47:22.626129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 602/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:47:22 2022] GET /identity/v3/role_assignments?user.id=a105e9c75e444ce0a2e03db8be34df06&scope.project.id=1ba5cb72a59d4bb4a63f426545fcc0e4&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:47:32.469871 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=60 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:47:32.623532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=56 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:42.145266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd0e71-23fa-4e36-a855-d786d3c5c1c6 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:42.145863 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd0e71-23fa-4e36-a855-d786d3c5c1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:42.145863 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd0e71-23fa-4e36-a855-d786d3c5c1c6 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:42.147151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 599/1201] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:42.152582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf8d73-2985-4577-8373-faf05fd175b2 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:42.153032 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf8d73-2985-4577-8373-faf05fd175b2 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:42.153130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf8d73-2985-4577-8373-faf05fd175b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:42.171673 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-a6bf8d73-2985-4577-8373-faf05fd175b2 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:42.172879 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a6bf8d73-2985-4577-8373-faf05fd175b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:42.242219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 603/1202] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:48:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:48:42.510000 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd0e71-23fa-4e36-a855-d786d3c5c1c6 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:42.609821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd0e71-23fa-4e36-a855-d786d3c5c1c6 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:42.643562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bcfb1-8c8a-46ce-b278-93de1ac49ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:42.644204 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bcfb1-8c8a-46ce-b278-93de1ac49ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:42.644488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bcfb1-8c8a-46ce-b278-93de1ac49ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:42.644758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bcfb1-8c8a-46ce-b278-93de1ac49ca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:42.654947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bcfb1-8c8a-46ce-b278-93de1ac49ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:42.660347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bcfb1-8c8a-46ce-b278-93de1ac49ca4 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-584bcfb1-8c8a-46ce-b278-93de1ac49ca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:48:42.670187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:42.671380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:48:42.672523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:48:42.672523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:42.672523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:48:42.672523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 600/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:42.677475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf8d73-2985-4577-8373-faf05fd175b2 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:42.775659 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf8d73-2985-4577-8373-faf05fd175b2 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:42.804140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:42.809857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59484146-dfc6-429e-b649-8acfa5cd30cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:42.811085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59484146-dfc6-429e-b649-8acfa5cd30cb None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:42.811358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59484146-dfc6-429e-b649-8acfa5cd30cb None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:42.811623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59484146-dfc6-429e-b649-8acfa5cd30cb None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:42.812284 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59484146-dfc6-429e-b649-8acfa5cd30cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:42.812585 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59484146-dfc6-429e-b649-8acfa5cd30cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:42.814055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59484146-dfc6-429e-b649-8acfa5cd30cb None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:42.825190 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 604/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:42.831104 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bcfb1-8c8a-46ce-b278-93de1ac49ca4 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:42.883820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:42.933089 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bcfb1-8c8a-46ce-b278-93de1ac49ca4 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:42.966150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb206d9b-fceb-4f71-94ec-31ca377772a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:42.966784 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb206d9b-fceb-4f71-94ec-31ca377772a7 None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:42.967065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb206d9b-fceb-4f71-94ec-31ca377772a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:42.967341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb206d9b-fceb-4f71-94ec-31ca377772a7 None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:42.968011 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb206d9b-fceb-4f71-94ec-31ca377772a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:42.969435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb206d9b-fceb-4f71-94ec-31ca377772a7 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:43.073551 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 601/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Sep 1 13:48:42 2022] POST /identity/v3/users => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:48:45.015570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8761562-695f-49fb-9b63-48ada604fead None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:45.016186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8761562-695f-49fb-9b63-48ada604fead None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:45.016186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8761562-695f-49fb-9b63-48ada604fead None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:45.017525 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 605/1206] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:45.022803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b1a8e-d54e-4cd3-98d7-8d858b436c84 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:45.023195 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b1a8e-d54e-4cd3-98d7-8d858b436c84 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:45.023380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b1a8e-d54e-4cd3-98d7-8d858b436c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:45.041974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6b2b1a8e-d54e-4cd3-98d7-8d858b436c84 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:45.043159 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6b2b1a8e-d54e-4cd3-98d7-8d858b436c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:45.111658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 602/1207] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:48:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:48:45.384379 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8761562-695f-49fb-9b63-48ada604fead None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:45.487002 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8761562-695f-49fb-9b63-48ada604fead None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:45.519996 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f6ada-571c-4490-8ef7-9f375710f2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:45.520615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6ada-571c-4490-8ef7-9f375710f2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:45.520893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6ada-571c-4490-8ef7-9f375710f2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:45.521199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6ada-571c-4490-8ef7-9f375710f2c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:45.532118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f6ada-571c-4490-8ef7-9f375710f2c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-929f6ada-571c-4490-8ef7-9f375710f2c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:48:45.537061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:45.538164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:45.539111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:45.539111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:45.539111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:45.539111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:45.539111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:48:45.539111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:48:45.539111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:48:45.539111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:48:45.539111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:48:45.539111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:48:45.539111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:48:45.539111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:48:45.539111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 606/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:48:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:45.544288 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b1a8e-d54e-4cd3-98d7-8d858b436c84 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:45.596488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:45.655968 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b1a8e-d54e-4cd3-98d7-8d858b436c84 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:45.690299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5fe69-ad29-408c-9f5a-73c9e4af7ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:45.690900 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5fe69-ad29-408c-9f5a-73c9e4af7ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:45.691176 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5fe69-ad29-408c-9f5a-73c9e4af7ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:45.691444 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5fe69-ad29-408c-9f5a-73c9e4af7ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:45.692124 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5fe69-ad29-408c-9f5a-73c9e4af7ad0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:45.692423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5fe69-ad29-408c-9f5a-73c9e4af7ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:45.693778 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5fe69-ad29-408c-9f5a-73c9e4af7ad0 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:45.701925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 603/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:48:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:45.707791 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f6ada-571c-4490-8ef7-9f375710f2c1 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:45.757513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:45.807002 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f6ada-571c-4490-8ef7-9f375710f2c1 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:45.843372 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58090440-f260-455d-81ed-b94690df83ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:45.844019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58090440-f260-455d-81ed-b94690df83ca None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:45.844299 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58090440-f260-455d-81ed-b94690df83ca None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:45.844622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58090440-f260-455d-81ed-b94690df83ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:45.855048 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58090440-f260-455d-81ed-b94690df83ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:45.856636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58090440-f260-455d-81ed-b94690df83ca None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-58090440-f260-455d-81ed-b94690df83ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:48:45.870773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:45.871789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:48:45.872838 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:48:45.872838 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:45.872838 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:48:45.872838 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 607/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:45.878189 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5fe69-ad29-408c-9f5a-73c9e4af7ad0 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:45.990558 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:45.994323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5fe69-ad29-408c-9f5a-73c9e4af7ad0 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:46.036637 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d397465-9e0f-457b-b37d-4fc06aaee347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:46.037292 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d397465-9e0f-457b-b37d-4fc06aaee347 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:46.037515 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d397465-9e0f-457b-b37d-4fc06aaee347 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:46.037786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d397465-9e0f-457b-b37d-4fc06aaee347 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:46.038419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d397465-9e0f-457b-b37d-4fc06aaee347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:46.038722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d397465-9e0f-457b-b37d-4fc06aaee347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:46.040175 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d397465-9e0f-457b-b37d-4fc06aaee347 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:46.054048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 604/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:46.059750 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58090440-f260-455d-81ed-b94690df83ca None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:46.162195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58090440-f260-455d-81ed-b94690df83ca None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:46.163717 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:46.199526 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f7fe1-0b4b-444b-b33a-3956ed24edab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:46.200397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f7fe1-0b4b-444b-b33a-3956ed24edab None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:46.200904 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f7fe1-0b4b-444b-b33a-3956ed24edab None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:46.202048 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f7fe1-0b4b-444b-b33a-3956ed24edab None admin] PATH_INFO: `/v3/users/placement` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:46.209790 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f7fe1-0b4b-444b-b33a-3956ed24edab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:46.211231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f7fe1-0b4b-444b-b33a-3956ed24edab None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-088f7fe1-0b4b-444b-b33a-3956ed24edab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:48:46.222449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:46.223592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:46.224785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:46.224785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:46.224785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:48:46.224785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:48:46.224785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:48:46.224785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:48:46.224785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:48:46.224785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:48:46.224785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:48:46.224785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:48:46.224785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 608/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:48:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:46.229449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d397465-9e0f-457b-b37d-4fc06aaee347 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:46.329611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d397465-9e0f-457b-b37d-4fc06aaee347 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:46.363145 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85dde3-e7b6-4ec2-a3aa-a2758452878e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:46.363743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85dde3-e7b6-4ec2-a3aa-a2758452878e None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:46.364054 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85dde3-e7b6-4ec2-a3aa-a2758452878e None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:46.364328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85dde3-e7b6-4ec2-a3aa-a2758452878e None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:46.365122 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85dde3-e7b6-4ec2-a3aa-a2758452878e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:46.365428 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85dde3-e7b6-4ec2-a3aa-a2758452878e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:46.366843 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85dde3-e7b6-4ec2-a3aa-a2758452878e None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:46.384368 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 605/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Sep 1 13:48:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:46.391009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f7fe1-0b4b-444b-b33a-3956ed24edab None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:46.487951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f7fe1-0b4b-444b-b33a-3956ed24edab None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:46.521540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd9178-4072-4706-acf9-f9875f0fbe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:46.522132 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd9178-4072-4706-acf9-f9875f0fbe61 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:46.522409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd9178-4072-4706-acf9-f9875f0fbe61 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:46.522675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd9178-4072-4706-acf9-f9875f0fbe61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:46.552661 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:46.589375 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd9178-4072-4706-acf9-f9875f0fbe61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:46.593591 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd9178-4072-4706-acf9-f9875f0fbe61 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:46.692427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 609/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:48:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:48:46.698468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85dde3-e7b6-4ec2-a3aa-a2758452878e None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:46.717109 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:46.803232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85dde3-e7b6-4ec2-a3aa-a2758452878e None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:46.837820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107672f-0a9d-4ccd-b492-51458075cc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:46.838446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107672f-0a9d-4ccd-b492-51458075cc8f None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:46.838720 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107672f-0a9d-4ccd-b492-51458075cc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:46.838987 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107672f-0a9d-4ccd-b492-51458075cc8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:46.849010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107672f-0a9d-4ccd-b492-51458075cc8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:46.850378 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107672f-0a9d-4ccd-b492-51458075cc8f None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-2107672f-0a9d-4ccd-b492-51458075cc8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:48:46.865198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:46.866221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:48:46.867460 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:48:46.867460 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:46.867460 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:48:46.867460 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 606/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:46.872193 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd9178-4072-4706-acf9-f9875f0fbe61 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:46.934844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:46.976567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd9178-4072-4706-acf9-f9875f0fbe61 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:47.010808 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2babd8e-e4e4-4c2a-b5c6-0a4a19e9f4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:47.011405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2babd8e-e4e4-4c2a-b5c6-0a4a19e9f4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:47.011684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2babd8e-e4e4-4c2a-b5c6-0a4a19e9f4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:47.011985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2babd8e-e4e4-4c2a-b5c6-0a4a19e9f4f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:47.012617 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2babd8e-e4e4-4c2a-b5c6-0a4a19e9f4f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:47.012920 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2babd8e-e4e4-4c2a-b5c6-0a4a19e9f4f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:47.014891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2babd8e-e4e4-4c2a-b5c6-0a4a19e9f4f3 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:47.025744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 610/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:47.031547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107672f-0a9d-4ccd-b492-51458075cc8f None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:47.101154 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:47.132191 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107672f-0a9d-4ccd-b492-51458075cc8f None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:47.165749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647385b-dfc6-49c0-91f0-8c6bf4c6a0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:47.166410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647385b-dfc6-49c0-91f0-8c6bf4c6a0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:47.166683 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647385b-dfc6-49c0-91f0-8c6bf4c6a0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:47.166939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647385b-dfc6-49c0-91f0-8c6bf4c6a0b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:47.174547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647385b-dfc6-49c0-91f0-8c6bf4c6a0b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:47.176030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647385b-dfc6-49c0-91f0-8c6bf4c6a0b7 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:47.188257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-e647385b-dfc6-49c0-91f0-8c6bf4c6a0b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:48:47.188257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:47.188257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:47.188257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:47.188257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:47.188257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:47.188257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:47.188257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:47.188257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:47.188257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:47.188257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:47.188257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:47.188257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:48:47.188257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:48:47.188257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:47.190455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:47.192647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:48:47.192647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:48:47.192647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:48:47.192647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:48:47.192647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:48:47.192647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:48:47.192647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:48:47.192647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:48:47.192647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 607/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:48:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:47.195858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2babd8e-e4e4-4c2a-b5c6-0a4a19e9f4f3 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:47.296224 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2babd8e-e4e4-4c2a-b5c6-0a4a19e9f4f3 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:47.318166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:47.330477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c527e8c-fab1-45ea-80f9-83149fcf9497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:47.331132 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c527e8c-fab1-45ea-80f9-83149fcf9497 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:47.331416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c527e8c-fab1-45ea-80f9-83149fcf9497 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:47.331689 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c527e8c-fab1-45ea-80f9-83149fcf9497 None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:47.332409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c527e8c-fab1-45ea-80f9-83149fcf9497 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:47.332718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c527e8c-fab1-45ea-80f9-83149fcf9497 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:47.334183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c527e8c-fab1-45ea-80f9-83149fcf9497 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:47.347357 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 611/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:48:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:47.353514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647385b-dfc6-49c0-91f0-8c6bf4c6a0b7 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:47.455779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647385b-dfc6-49c0-91f0-8c6bf4c6a0b7 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:47.484618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:47.490362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4050969-a955-4af7-b9b3-d7358c723264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:47.490958 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4050969-a955-4af7-b9b3-d7358c723264 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:47.491237 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4050969-a955-4af7-b9b3-d7358c723264 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:47.491506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4050969-a955-4af7-b9b3-d7358c723264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:47.492252 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4050969-a955-4af7-b9b3-d7358c723264 None admin] RBAC: Adding query filter params (role.id=530c8dc4a70b4cb48bc4036a57ffa71b, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=cec4f437077c41039cae3d505b43b558) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:47.492562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4050969-a955-4af7-b9b3-d7358c723264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:47.493983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4050969-a955-4af7-b9b3-d7358c723264 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:47.499276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 608/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:48:47 2022] GET /identity/v3/role_assignments?user.id=cec4f437077c41039cae3d505b43b558&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=530c8dc4a70b4cb48bc4036a57ffa71b => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:49.424196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4313c5-359e-45a9-8d57-a2048158df15 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:49.424698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4313c5-359e-45a9-8d57-a2048158df15 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:49.424698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4313c5-359e-45a9-8d57-a2048158df15 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:49.425982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 612/1220] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:49.431058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc60c5-53f3-4896-88a0-1f8a0f4734a2 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:49.431477 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc60c5-53f3-4896-88a0-1f8a0f4734a2 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:49.431692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc60c5-53f3-4896-88a0-1f8a0f4734a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:49.450336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-fbdc60c5-53f3-4896-88a0-1f8a0f4734a2 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:49.452147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-fbdc60c5-53f3-4896-88a0-1f8a0f4734a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:49.518231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 609/1221] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:48:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:48:49.796570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4313c5-359e-45a9-8d57-a2048158df15 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:49.897523 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4313c5-359e-45a9-8d57-a2048158df15 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:49.930883 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289763c-6ec6-4a49-96f9-a11662a68b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:49.931515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289763c-6ec6-4a49-96f9-a11662a68b1e None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:49.931796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289763c-6ec6-4a49-96f9-a11662a68b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:49.932089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289763c-6ec6-4a49-96f9-a11662a68b1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:49.942641 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289763c-6ec6-4a49-96f9-a11662a68b1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-e289763c-6ec6-4a49-96f9-a11662a68b1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:48:49.947496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:49.951924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:49.953483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:49.953483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:49.953483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:49.953483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:49.953483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:48:49.953483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:48:49.953483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:48:49.953483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:48:49.953483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:48:49.953483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:48:49.953483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:48:49.953483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:48:49.953483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 613/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:48:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:48:49.955520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc60c5-53f3-4896-88a0-1f8a0f4734a2 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:50.066866 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc60c5-53f3-4896-88a0-1f8a0f4734a2 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:50.090270 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:50.100721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85896d4-52bf-4440-8ddf-47e2144e8788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:50.101321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85896d4-52bf-4440-8ddf-47e2144e8788 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:50.101597 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85896d4-52bf-4440-8ddf-47e2144e8788 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:50.102021 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85896d4-52bf-4440-8ddf-47e2144e8788 None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:50.102673 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85896d4-52bf-4440-8ddf-47e2144e8788 None admin] RBAC: Adding query filter params (name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:50.102974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85896d4-52bf-4440-8ddf-47e2144e8788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:50.104461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85896d4-52bf-4440-8ddf-47e2144e8788 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:50.112861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 610/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:48:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:50.119780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289763c-6ec6-4a49-96f9-a11662a68b1e None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:50.163971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:50.220117 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289763c-6ec6-4a49-96f9-a11662a68b1e None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:50.252792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa041346-b112-43e1-aa5b-c4b68af01d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:50.253409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa041346-b112-43e1-aa5b-c4b68af01d35 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:50.253686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa041346-b112-43e1-aa5b-c4b68af01d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:50.253953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa041346-b112-43e1-aa5b-c4b68af01d35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:50.264219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa041346-b112-43e1-aa5b-c4b68af01d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:50.265698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa041346-b112-43e1-aa5b-c4b68af01d35 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-fa041346-b112-43e1-aa5b-c4b68af01d35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:48:50.282315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:50.283660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:48:50.284895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:48:50.284895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:50.284895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:48:50.284895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 614/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:50.289623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85896d4-52bf-4440-8ddf-47e2144e8788 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:50.392722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85896d4-52bf-4440-8ddf-47e2144e8788 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:50.425759 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d789b-7148-4856-b74a-4566a382a9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:50.426362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d789b-7148-4856-b74a-4566a382a9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:50.426677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d789b-7148-4856-b74a-4566a382a9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:50.426959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d789b-7148-4856-b74a-4566a382a9d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:50.427589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d789b-7148-4856-b74a-4566a382a9d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:50.427917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d789b-7148-4856-b74a-4566a382a9d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:50.429276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d789b-7148-4856-b74a-4566a382a9d7 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:50.440676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 611/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:50.446343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa041346-b112-43e1-aa5b-c4b68af01d35 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:50.540472 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:50.547412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa041346-b112-43e1-aa5b-c4b68af01d35 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:50.581265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e36aa-ed55-4e11-96b7-7c3739d30eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:50.581893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e36aa-ed55-4e11-96b7-7c3739d30eaf None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:50.582176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e36aa-ed55-4e11-96b7-7c3739d30eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:50.582450 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e36aa-ed55-4e11-96b7-7c3739d30eaf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:50.589868 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e36aa-ed55-4e11-96b7-7c3739d30eaf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:50.591890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e36aa-ed55-4e11-96b7-7c3739d30eaf None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-7f6e36aa-ed55-4e11-96b7-7c3739d30eaf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:48:50.603228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:50.604425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:50.605562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:50.605562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:50.605562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:48:50.605562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:48:50.605562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:48:50.605562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:48:50.605562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:48:50.605562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:48:50.605562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:48:50.605562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:48:50.605562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 615/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:48:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:50.610354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d789b-7148-4856-b74a-4566a382a9d7 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:50.658730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:50.710145 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d789b-7148-4856-b74a-4566a382a9d7 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:50.743659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961fe3e-7bdd-4c92-b1a0-5312cec70080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:50.744292 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961fe3e-7bdd-4c92-b1a0-5312cec70080 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:50.744573 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961fe3e-7bdd-4c92-b1a0-5312cec70080 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:50.744843 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961fe3e-7bdd-4c92-b1a0-5312cec70080 None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:50.745557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961fe3e-7bdd-4c92-b1a0-5312cec70080 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:50.745872 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961fe3e-7bdd-4c92-b1a0-5312cec70080 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:50.747335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961fe3e-7bdd-4c92-b1a0-5312cec70080 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:50.767342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 612/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Sep 1 13:48:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:48:50.773222 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e36aa-ed55-4e11-96b7-7c3739d30eaf None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:50.874877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e36aa-ed55-4e11-96b7-7c3739d30eaf None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:50.909001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a8559-730b-4294-a3fe-bb74a1668086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:50.909561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a8559-730b-4294-a3fe-bb74a1668086 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:50.909844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a8559-730b-4294-a3fe-bb74a1668086 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:50.910119 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a8559-730b-4294-a3fe-bb74a1668086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:50.921689 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a8559-730b-4294-a3fe-bb74a1668086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:50.923148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a8559-730b-4294-a3fe-bb74a1668086 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-a60a8559-730b-4294-a3fe-bb74a1668086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:48:50.937615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:50.938730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:48:50.939837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:48:50.939837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:50.939837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:48:50.939837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 616/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:50.944588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961fe3e-7bdd-4c92-b1a0-5312cec70080 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:51.054312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961fe3e-7bdd-4c92-b1a0-5312cec70080 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:51.056624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:51.088192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1598d04-5e2a-4fbe-8870-43dbc2e0a898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:51.088800 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1598d04-5e2a-4fbe-8870-43dbc2e0a898 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:51.089082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1598d04-5e2a-4fbe-8870-43dbc2e0a898 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:51.089352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1598d04-5e2a-4fbe-8870-43dbc2e0a898 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:51.089985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1598d04-5e2a-4fbe-8870-43dbc2e0a898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:51.090291 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1598d04-5e2a-4fbe-8870-43dbc2e0a898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:51.091681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1598d04-5e2a-4fbe-8870-43dbc2e0a898 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:51.102765 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 613/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:51.109154 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a8559-730b-4294-a3fe-bb74a1668086 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:51.118475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:51.212081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a8559-730b-4294-a3fe-bb74a1668086 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:51.246995 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb42d8-b6ec-4836-a900-8c072f3352d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:51.248238 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb42d8-b6ec-4836-a900-8c072f3352d1 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:51.248520 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb42d8-b6ec-4836-a900-8c072f3352d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:51.248788 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb42d8-b6ec-4836-a900-8c072f3352d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:51.255767 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb42d8-b6ec-4836-a900-8c072f3352d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:51.257238 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb42d8-b6ec-4836-a900-8c072f3352d1 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:51.268604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-cebb42d8-b6ec-4836-a900-8c072f3352d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:48:51.268604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:51.268604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:51.268604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:51.268604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:51.268604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:51.268604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:51.268604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:51.268604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:51.268604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:51.268604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:51.268604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:51.268604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:48:51.268604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:48:51.268604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:51.269680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:51.270631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:48:51.270631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:48:51.270631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:48:51.270631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:48:51.270631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:48:51.270631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:48:51.270631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:48:51.270631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:48:51.270631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 617/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:48:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:51.275859 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1598d04-5e2a-4fbe-8870-43dbc2e0a898 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:51.377483 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1598d04-5e2a-4fbe-8870-43dbc2e0a898 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:51.416831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf30119-a365-42f3-8f76-107982f3b1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:51.417520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf30119-a365-42f3-8f76-107982f3b1ac None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:51.417807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf30119-a365-42f3-8f76-107982f3b1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:51.418081 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf30119-a365-42f3-8f76-107982f3b1ac None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:51.418776 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf30119-a365-42f3-8f76-107982f3b1ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:51.419140 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf30119-a365-42f3-8f76-107982f3b1ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:51.420551 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf30119-a365-42f3-8f76-107982f3b1ac None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:51.433050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 614/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:48:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:51.439545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb42d8-b6ec-4836-a900-8c072f3352d1 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:51.504614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:51.538658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb42d8-b6ec-4836-a900-8c072f3352d1 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:51.571527 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5fe55-bead-401b-bf3c-a180909d2110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:51.572205 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5fe55-bead-401b-bf3c-a180909d2110 None admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:51.572485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5fe55-bead-401b-bf3c-a180909d2110 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:51.572752 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5fe55-bead-401b-bf3c-a180909d2110 None admin] PATH_INFO: `/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/cec4f437077c41039cae3d505b43b558/roles/530c8dc4a70b4cb48bc4036a57ffa71b` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:51.587213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5fe55-bead-401b-bf3c-a180909d2110 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e7998cc03064a0bb9a9dc6a1475d73c, user_id=cec4f437077c41039cae3d505b43b558, role_id=530c8dc4a70b4cb48bc4036a57ffa71b)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:51.588659 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5fe55-bead-401b-bf3c-a180909d2110 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:51.715164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 618/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:48:51 2022] PUT /identity/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/cec4f437077c41039cae3d505b43b558/roles/530c8dc4a70b4cb48bc4036a57ffa71b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:48:53.647442 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912f34-7297-4fee-bac0-1d2b44d657f4 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:53.648066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912f34-7297-4fee-bac0-1d2b44d657f4 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:53.648066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912f34-7297-4fee-bac0-1d2b44d657f4 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:53.649430 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 615/1233] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:53.654444 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd558c9-210c-4913-a7d1-42125385bf88 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:53.654920 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd558c9-210c-4913-a7d1-42125385bf88 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:53.655022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd558c9-210c-4913-a7d1-42125385bf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:53.673837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-9bd558c9-210c-4913-a7d1-42125385bf88 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:53.675091 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-9bd558c9-210c-4913-a7d1-42125385bf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:53.742807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 619/1234] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:48:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:48:54.007283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8912f34-7297-4fee-bac0-1d2b44d657f4 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:54.032659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:54.106681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8912f34-7297-4fee-bac0-1d2b44d657f4 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:54.140428 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630a4e1-c644-46f0-b9c1-2554517c6b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:54.141050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630a4e1-c644-46f0-b9c1-2554517c6b12 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:54.141328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630a4e1-c644-46f0-b9c1-2554517c6b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:54.141600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630a4e1-c644-46f0-b9c1-2554517c6b12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:54.151560 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630a4e1-c644-46f0-b9c1-2554517c6b12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-b630a4e1-c644-46f0-b9c1-2554517c6b12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:48:54.156950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:54.158213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:54.159222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:54.159222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:54.159222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:54.159222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:54.159222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:48:54.159222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:48:54.159222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:48:54.159222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:48:54.159222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:48:54.159222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:48:54.159222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 13:48:54.159222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:48:54.159222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 616/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Sep 1 13:48:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:54.163983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd558c9-210c-4913-a7d1-42125385bf88 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:54.209162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:54.260518 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd558c9-210c-4913-a7d1-42125385bf88 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:54.294012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da525750-174f-483d-a8b5-f6d9894c54cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:54.295386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da525750-174f-483d-a8b5-f6d9894c54cd None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:54.295386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da525750-174f-483d-a8b5-f6d9894c54cd None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:54.295386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da525750-174f-483d-a8b5-f6d9894c54cd None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:54.295841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da525750-174f-483d-a8b5-f6d9894c54cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:54.296183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da525750-174f-483d-a8b5-f6d9894c54cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:54.297545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da525750-174f-483d-a8b5-f6d9894c54cd None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:54.305243 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 620/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Sep 1 13:48:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:54.311033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630a4e1-c644-46f0-b9c1-2554517c6b12 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:54.395295 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:54.411263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630a4e1-c644-46f0-b9c1-2554517c6b12 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:54.444104 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75ec7d-1f41-4a1d-bcf3-3c3c322c5e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:54.444728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75ec7d-1f41-4a1d-bcf3-3c3c322c5e72 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:54.445008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75ec7d-1f41-4a1d-bcf3-3c3c322c5e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:54.445279 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75ec7d-1f41-4a1d-bcf3-3c3c322c5e72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:54.456079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75ec7d-1f41-4a1d-bcf3-3c3c322c5e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:54.460555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75ec7d-1f41-4a1d-bcf3-3c3c322c5e72 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-ee75ec7d-1f41-4a1d-bcf3-3c3c322c5e72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:48:54.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:54.472392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:48:54.473565 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:48:54.473565 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:54.473565 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:48:54.473565 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 617/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:48:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:54.478507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da525750-174f-483d-a8b5-f6d9894c54cd None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:54.583903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da525750-174f-483d-a8b5-f6d9894c54cd None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:54.592551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:54.616836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b32e7d-b189-486b-9287-54c9f5e166ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:54.617437 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b32e7d-b189-486b-9287-54c9f5e166ca None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:54.617718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b32e7d-b189-486b-9287-54c9f5e166ca None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:54.617989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b32e7d-b189-486b-9287-54c9f5e166ca None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:54.618616 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b32e7d-b189-486b-9287-54c9f5e166ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:54.618916 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b32e7d-b189-486b-9287-54c9f5e166ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:54.620307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b32e7d-b189-486b-9287-54c9f5e166ca None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:54.632604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 621/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:54.638939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75ec7d-1f41-4a1d-bcf3-3c3c322c5e72 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:54.738837 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75ec7d-1f41-4a1d-bcf3-3c3c322c5e72 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:54.772997 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa020b-f761-425c-a46c-960caa844ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:54.773611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa020b-f761-425c-a46c-960caa844ace None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:54.773889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa020b-f761-425c-a46c-960caa844ace None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:54.774158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa020b-f761-425c-a46c-960caa844ace None admin] PATH_INFO: `/v3/users/placement` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:54.776779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:54.781802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa020b-f761-425c-a46c-960caa844ace None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:54.783265 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa020b-f761-425c-a46c-960caa844ace None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-e8aa020b-f761-425c-a46c-960caa844ace None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:48:54.794809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:54.795983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:54.797337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:54.797337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:54.797337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:48:54.797337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:48:54.797337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:48:54.797337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:48:54.797337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:48:54.797337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:48:54.797337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:48:54.797337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:48:54.797337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 618/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:48:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:54.801911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b32e7d-b189-486b-9287-54c9f5e166ca None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:54.902345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b32e7d-b189-486b-9287-54c9f5e166ca None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:54.937315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f3d48-4061-44b8-8f85-0e8b57548aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:54.937912 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f3d48-4061-44b8-8f85-0e8b57548aee None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:54.938188 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f3d48-4061-44b8-8f85-0e8b57548aee None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:54.938458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f3d48-4061-44b8-8f85-0e8b57548aee None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:54.939180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f3d48-4061-44b8-8f85-0e8b57548aee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:54.939486 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f3d48-4061-44b8-8f85-0e8b57548aee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:54.940975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f3d48-4061-44b8-8f85-0e8b57548aee None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:54.958102 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 622/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Sep 1 13:48:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:54.964199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa020b-f761-425c-a46c-960caa844ace None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:55.073210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa020b-f761-425c-a46c-960caa844ace None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:55.109024 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea073074-4f9b-47ef-81fd-cb344fcf39de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:55.109024 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea073074-4f9b-47ef-81fd-cb344fcf39de None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:55.109024 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea073074-4f9b-47ef-81fd-cb344fcf39de None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:55.109024 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea073074-4f9b-47ef-81fd-cb344fcf39de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:55.176400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:55.182933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea073074-4f9b-47ef-81fd-cb344fcf39de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:55.184415 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea073074-4f9b-47ef-81fd-cb344fcf39de None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:55.283537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 619/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:48:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 13:48:55.289459 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f3d48-4061-44b8-8f85-0e8b57548aee None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:55.316679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:55.385911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f3d48-4061-44b8-8f85-0e8b57548aee None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:55.420554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf2dba-d203-4df4-818b-af075ec5ce1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:55.421102 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf2dba-d203-4df4-818b-af075ec5ce1c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:55.421381 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf2dba-d203-4df4-818b-af075ec5ce1c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:55.421650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf2dba-d203-4df4-818b-af075ec5ce1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:55.431198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf2dba-d203-4df4-818b-af075ec5ce1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:55.432650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf2dba-d203-4df4-818b-af075ec5ce1c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-f6bf2dba-d203-4df4-818b-af075ec5ce1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:48:55.446741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:55.447926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:48:55.449012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:48:55.449012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:55.449012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:48:55.449012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 623/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:48:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:55.453593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea073074-4f9b-47ef-81fd-cb344fcf39de None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:55.547800 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:55.553426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea073074-4f9b-47ef-81fd-cb344fcf39de None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:55.587017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a11842-6cfe-41ec-9476-cd171f98597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:55.587620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a11842-6cfe-41ec-9476-cd171f98597b None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:55.587926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a11842-6cfe-41ec-9476-cd171f98597b None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:55.588200 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a11842-6cfe-41ec-9476-cd171f98597b None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:55.588830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a11842-6cfe-41ec-9476-cd171f98597b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:55.589130 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a11842-6cfe-41ec-9476-cd171f98597b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:55.590486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a11842-6cfe-41ec-9476-cd171f98597b None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:55.602331 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 620/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:48:55.608275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf2dba-d203-4df4-818b-af075ec5ce1c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:55.687313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:55.708279 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf2dba-d203-4df4-818b-af075ec5ce1c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:55.741023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d3231-be77-4ec7-a35b-356fa4a84858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:55.741641 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d3231-be77-4ec7-a35b-356fa4a84858 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:55.741925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d3231-be77-4ec7-a35b-356fa4a84858 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:55.742201 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d3231-be77-4ec7-a35b-356fa4a84858 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:55.749295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d3231-be77-4ec7-a35b-356fa4a84858 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:55.750727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d3231-be77-4ec7-a35b-356fa4a84858 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:55.762300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-8a8d3231-be77-4ec7-a35b-356fa4a84858 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:48:55.762300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:55.762300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:55.762300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:55.762300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:55.762300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:55.762300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:55.762300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:55.762300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:55.762300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:55.762300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:55.762300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:55.762300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:48:55.762300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:48:55.762300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:55.770710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:55.771836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:48:55.771836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:48:55.771836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:48:55.771836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:48:55.771836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:48:55.771836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:48:55.771836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:48:55.771836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:48:55.771836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 624/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:48:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:55.772501 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a11842-6cfe-41ec-9476-cd171f98597b None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:55.868969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a11842-6cfe-41ec-9476-cd171f98597b None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:55.902426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd213ce5-d200-4bb1-904f-9f3445d8d685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:55.903027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd213ce5-d200-4bb1-904f-9f3445d8d685 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:55.903306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd213ce5-d200-4bb1-904f-9f3445d8d685 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:55.903711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd213ce5-d200-4bb1-904f-9f3445d8d685 None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:55.904293 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd213ce5-d200-4bb1-904f-9f3445d8d685 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:55.904600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd213ce5-d200-4bb1-904f-9f3445d8d685 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:55.906072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd213ce5-d200-4bb1-904f-9f3445d8d685 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:55.917776 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 621/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:48:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:55.924474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d3231-be77-4ec7-a35b-356fa4a84858 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:56.028140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d3231-be77-4ec7-a35b-356fa4a84858 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:56.061479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cc949-ea83-4e3a-8fdf-960af0d09478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:56.062071 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cc949-ea83-4e3a-8fdf-960af0d09478 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:56.063440 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cc949-ea83-4e3a-8fdf-960af0d09478 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:56.063440 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cc949-ea83-4e3a-8fdf-960af0d09478 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:56.063440 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cc949-ea83-4e3a-8fdf-960af0d09478 None admin] RBAC: Adding query filter params (role.id=530c8dc4a70b4cb48bc4036a57ffa71b, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=cec4f437077c41039cae3d505b43b558) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:56.063705 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cc949-ea83-4e3a-8fdf-960af0d09478 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:56.065029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cc949-ea83-4e3a-8fdf-960af0d09478 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:56.070574 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 625/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:48:55 2022] GET /identity/v3/role_assignments?user.id=cec4f437077c41039cae3d505b43b558&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=530c8dc4a70b4cb48bc4036a57ffa71b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:58.027410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a49470-c3a7-4dda-82e6-d0ab0111d4b1 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:58.027963 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a49470-c3a7-4dda-82e6-d0ab0111d4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:58.028061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a49470-c3a7-4dda-82e6-d0ab0111d4b1 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:58.030753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 622/1247] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:48:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:48:58.036146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a28d4-d336-473b-a5d0-1779f5ad1cdd None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:58.036586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a28d4-d336-473b-a5d0-1779f5ad1cdd None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:58.036692 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a28d4-d336-473b-a5d0-1779f5ad1cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:58.042909 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:58.055584 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-b28a28d4-d336-473b-a5d0-1779f5ad1cdd None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:48:58.056802 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b28a28d4-d336-473b-a5d0-1779f5ad1cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:48:58.123656 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 626/1248] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:48:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:48:58.392781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a49470-c3a7-4dda-82e6-d0ab0111d4b1 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:58.411527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:58.494655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a49470-c3a7-4dda-82e6-d0ab0111d4b1 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:58.528171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b74e4-d98f-4d6b-9817-9585983228ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:58.529295 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b74e4-d98f-4d6b-9817-9585983228ac None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:58.529574 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b74e4-d98f-4d6b-9817-9585983228ac None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:58.529846 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b74e4-d98f-4d6b-9817-9585983228ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:58.539614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b74e4-d98f-4d6b-9817-9585983228ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-bf3b74e4-d98f-4d6b-9817-9585983228ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:48:58.544922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:58.546008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:58.547161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:58.547161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:58.547161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:58.547161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:58.547161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:48:58.547161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:48:58.547161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:48:58.547161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:48:58.547161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:48:58.547161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:48:58.547161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:48:58.547161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:48:58.547161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 623/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:48:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:58.552054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a28d4-d336-473b-a5d0-1779f5ad1cdd None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:58.649974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a28d4-d336-473b-a5d0-1779f5ad1cdd None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:58.678848 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:58.683597 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2128f-7112-4f64-9b43-b23c2fbf4fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:58.684235 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2128f-7112-4f64-9b43-b23c2fbf4fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:58.684545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2128f-7112-4f64-9b43-b23c2fbf4fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:58.684830 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2128f-7112-4f64-9b43-b23c2fbf4fa5 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:58.685488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2128f-7112-4f64-9b43-b23c2fbf4fa5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:58.685794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2128f-7112-4f64-9b43-b23c2fbf4fa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:58.687153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2128f-7112-4f64-9b43-b23c2fbf4fa5 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:58.694926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 627/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:48:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:58.701367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b74e4-d98f-4d6b-9817-9585983228ac None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:58.782352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:58.804802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b74e4-d98f-4d6b-9817-9585983228ac None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:58.837523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582f131-cf08-4754-862e-de53ccb3ab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:58.838148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582f131-cf08-4754-862e-de53ccb3ab58 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:58.838430 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582f131-cf08-4754-862e-de53ccb3ab58 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:58.838703 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582f131-cf08-4754-862e-de53ccb3ab58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:58.849641 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582f131-cf08-4754-862e-de53ccb3ab58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:58.851082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582f131-cf08-4754-862e-de53ccb3ab58 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-e582f131-cf08-4754-862e-de53ccb3ab58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:48:58.870299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:58.878465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:48:58.880276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:48:58.880276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:58.880276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:48:58.880276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 624/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:48:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:58.880592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2128f-7112-4f64-9b43-b23c2fbf4fa5 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:58.988698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2128f-7112-4f64-9b43-b23c2fbf4fa5 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:59.023653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2707d-34cd-4d97-8182-253b0dbfc437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:59.024284 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2707d-34cd-4d97-8182-253b0dbfc437 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:59.024576 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2707d-34cd-4d97-8182-253b0dbfc437 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:59.024828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2707d-34cd-4d97-8182-253b0dbfc437 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:59.025872 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2707d-34cd-4d97-8182-253b0dbfc437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:59.026007 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2707d-34cd-4d97-8182-253b0dbfc437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:59.027429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2707d-34cd-4d97-8182-253b0dbfc437 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:59.039914 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 628/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:59.046369 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582f131-cf08-4754-862e-de53ccb3ab58 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:59.155143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582f131-cf08-4754-862e-de53ccb3ab58 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:59.183192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:59.191607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481149af-f5ef-499b-8a1f-0ce07dd58f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:59.192286 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481149af-f5ef-499b-8a1f-0ce07dd58f64 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:59.192562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481149af-f5ef-499b-8a1f-0ce07dd58f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:59.192833 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481149af-f5ef-499b-8a1f-0ce07dd58f64 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:59.201176 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481149af-f5ef-499b-8a1f-0ce07dd58f64 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:59.202584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481149af-f5ef-499b-8a1f-0ce07dd58f64 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-481149af-f5ef-499b-8a1f-0ce07dd58f64 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:48:59.213766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:59.214914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:59.216201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:59.216201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:59.216201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:48:59.216201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:48:59.216201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:48:59.216201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:48:59.216201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:48:59.216201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:48:59.216201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:48:59.216201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:48:59.216201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 625/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:48:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:59.221277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2707d-34cd-4d97-8182-253b0dbfc437 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:59.282375 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:59.337442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2707d-34cd-4d97-8182-253b0dbfc437 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:59.373195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e34481-aee0-4997-b999-bc6d6da8b5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:59.373948 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e34481-aee0-4997-b999-bc6d6da8b5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:59.374242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e34481-aee0-4997-b999-bc6d6da8b5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:59.374520 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e34481-aee0-4997-b999-bc6d6da8b5c6 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:59.375251 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e34481-aee0-4997-b999-bc6d6da8b5c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:48:59.375561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e34481-aee0-4997-b999-bc6d6da8b5c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:59.377288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e34481-aee0-4997-b999-bc6d6da8b5c6 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:59.397855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 629/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Sep 1 13:48:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:48:59.404328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481149af-f5ef-499b-8a1f-0ce07dd58f64 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:59.523622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481149af-f5ef-499b-8a1f-0ce07dd58f64 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:59.558701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5157d4-dd2d-4068-97f0-b4dff0812aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:59.560226 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5157d4-dd2d-4068-97f0-b4dff0812aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:59.560226 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5157d4-dd2d-4068-97f0-b4dff0812aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:59.560537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5157d4-dd2d-4068-97f0-b4dff0812aa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:59.619154 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:59.632162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5157d4-dd2d-4068-97f0-b4dff0812aa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:59.633607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5157d4-dd2d-4068-97f0-b4dff0812aa3 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:59.729553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 626/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:48:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:48:59.736078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e34481-aee0-4997-b999-bc6d6da8b5c6 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:59.832548 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e34481-aee0-4997-b999-bc6d6da8b5c6 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:48:59.846472 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:48:59.867208 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91ec1a-fa32-41b2-8c1e-254e228140de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:48:59.867830 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91ec1a-fa32-41b2-8c1e-254e228140de None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:48:59.868137 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91ec1a-fa32-41b2-8c1e-254e228140de None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:48:59.868413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91ec1a-fa32-41b2-8c1e-254e228140de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:48:59.878281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91ec1a-fa32-41b2-8c1e-254e228140de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:48:59.880847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91ec1a-fa32-41b2-8c1e-254e228140de None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-0c91ec1a-fa32-41b2-8c1e-254e228140de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:48:59.893930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:48:59.895084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:48:59.896027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:48:59.896027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:48:59.896027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:48:59.896027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 630/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:48:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:48:59.901732 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5157d4-dd2d-4068-97f0-b4dff0812aa3 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:48:59.989878 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:00.002523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5157d4-dd2d-4068-97f0-b4dff0812aa3 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:00.036340 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a8dd1-63a9-4516-bdda-f169c7280812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:00.036941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a8dd1-63a9-4516-bdda-f169c7280812 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:00.037220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a8dd1-63a9-4516-bdda-f169c7280812 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:00.037491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a8dd1-63a9-4516-bdda-f169c7280812 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:00.038150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a8dd1-63a9-4516-bdda-f169c7280812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:00.038453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a8dd1-63a9-4516-bdda-f169c7280812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:00.039814 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a8dd1-63a9-4516-bdda-f169c7280812 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:00.051351 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 627/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:00.057129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91ec1a-fa32-41b2-8c1e-254e228140de None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:00.176469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91ec1a-fa32-41b2-8c1e-254e228140de None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:00.209823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff3a80-24d8-4bd1-a8c1-5f7db78ff330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:00.210450 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff3a80-24d8-4bd1-a8c1-5f7db78ff330 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:00.210733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff3a80-24d8-4bd1-a8c1-5f7db78ff330 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:00.211008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff3a80-24d8-4bd1-a8c1-5f7db78ff330 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:00.218140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff3a80-24d8-4bd1-a8c1-5f7db78ff330 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:00.219587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff3a80-24d8-4bd1-a8c1-5f7db78ff330 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:00.230720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-abff3a80-24d8-4bd1-a8c1-5f7db78ff330 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:49:00.230720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:00.230720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:49:00.230720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:49:00.230720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:49:00.230720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:49:00.230720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:49:00.230720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:49:00.230720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:49:00.230720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:49:00.230720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:49:00.230720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:49:00.230720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:49:00.230720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:49:00.230720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:49:00.231783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:49:00.232924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:49:00.232924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:49:00.232924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:49:00.232924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:49:00.232924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:49:00.232924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:49:00.232924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:49:00.232924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:49:00.232924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 631/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:49:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:49:00.237851 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a8dd1-63a9-4516-bdda-f169c7280812 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:00.339946 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a8dd1-63a9-4516-bdda-f169c7280812 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:00.373636 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeee6e3-b115-45ef-b874-7cf5e73deaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:00.374240 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeee6e3-b115-45ef-b874-7cf5e73deaae None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:00.374522 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeee6e3-b115-45ef-b874-7cf5e73deaae None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:00.374793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeee6e3-b115-45ef-b874-7cf5e73deaae None admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:00.375504 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeee6e3-b115-45ef-b874-7cf5e73deaae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:00.375787 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeee6e3-b115-45ef-b874-7cf5e73deaae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:00.377512 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeee6e3-b115-45ef-b874-7cf5e73deaae None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:00.389707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 628/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:49:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:00.395939 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff3a80-24d8-4bd1-a8c1-5f7db78ff330 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:00.422390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:00.496233 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff3a80-24d8-4bd1-a8c1-5f7db78ff330 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:00.530516 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab206f2-48d0-4c77-af36-1edcdb318fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:00.531115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab206f2-48d0-4c77-af36-1edcdb318fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:00.531396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab206f2-48d0-4c77-af36-1edcdb318fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:00.531667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab206f2-48d0-4c77-af36-1edcdb318fd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:00.532429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab206f2-48d0-4c77-af36-1edcdb318fd3 None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=cec4f437077c41039cae3d505b43b558) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:00.532736 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab206f2-48d0-4c77-af36-1edcdb318fd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:00.534155 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab206f2-48d0-4c77-af36-1edcdb318fd3 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:00.539412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 632/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:49:00 2022] GET /identity/v3/role_assignments?user.id=cec4f437077c41039cae3d505b43b558&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:02.416204 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc4be9-f770-4df4-acbc-9b2d06f70b32 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:02.416767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc4be9-f770-4df4-acbc-9b2d06f70b32 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:02.416767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc4be9-f770-4df4-acbc-9b2d06f70b32 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:02.418104 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 629/1261] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:49:02.423736 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedfad0-3281-493c-902b-d8e92a8ce8ef None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:02.424185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedfad0-3281-493c-902b-d8e92a8ce8ef None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:02.424291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedfad0-3281-493c-902b-d8e92a8ce8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:02.442262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-0fedfad0-3281-493c-902b-d8e92a8ce8ef None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:49:02.443426 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0fedfad0-3281-493c-902b-d8e92a8ce8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:49:02.509841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 633/1262] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:49:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:49:02.776987 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc4be9-f770-4df4-acbc-9b2d06f70b32 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:02.788443 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:02.875845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc4be9-f770-4df4-acbc-9b2d06f70b32 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:02.909869 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a6a04-1442-4b07-ac28-f87153698864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:02.910473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6a04-1442-4b07-ac28-f87153698864 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:02.910753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6a04-1442-4b07-ac28-f87153698864 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:02.911025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a6a04-1442-4b07-ac28-f87153698864 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:02.921673 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a6a04-1442-4b07-ac28-f87153698864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-559a6a04-1442-4b07-ac28-f87153698864 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:49:02.926653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:49:02.927730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:49:02.929088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:49:02.929088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:49:02.929088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:49:02.929088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:49:02.929088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:49:02.929088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:49:02.929088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:49:02.929088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:49:02.929088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:49:02.929088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:49:02.929088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:49:02.929088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:49:02.929088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 630/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:49:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:49:02.933785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedfad0-3281-493c-902b-d8e92a8ce8ef None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:02.951709 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:03.030345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedfad0-3281-493c-902b-d8e92a8ce8ef None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:03.065558 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5143cc-0145-4957-be22-bd83c26073a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:03.066168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5143cc-0145-4957-be22-bd83c26073a3 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:03.066451 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5143cc-0145-4957-be22-bd83c26073a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:03.066839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5143cc-0145-4957-be22-bd83c26073a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:03.067475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5143cc-0145-4957-be22-bd83c26073a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:03.067784 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5143cc-0145-4957-be22-bd83c26073a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:03.069341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5143cc-0145-4957-be22-bd83c26073a3 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:03.077533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 634/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:49:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:03.083297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a6a04-1442-4b07-ac28-f87153698864 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:03.160156 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:03.193395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a6a04-1442-4b07-ac28-f87153698864 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:03.225718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34034b-46ce-4d1e-8911-34c457f6e697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:03.226342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34034b-46ce-4d1e-8911-34c457f6e697 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:03.226623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34034b-46ce-4d1e-8911-34c457f6e697 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:03.227009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34034b-46ce-4d1e-8911-34c457f6e697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:03.237727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34034b-46ce-4d1e-8911-34c457f6e697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:03.239204 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34034b-46ce-4d1e-8911-34c457f6e697 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-bf34034b-46ce-4d1e-8911-34c457f6e697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:49:03.253624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:49:03.268801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:49:03.269875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:49:03.269875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:49:03.269875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:49:03.269875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 631/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:49:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:49:03.270159 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5143cc-0145-4957-be22-bd83c26073a3 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:03.343145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:03.361625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5143cc-0145-4957-be22-bd83c26073a3 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:03.396333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994d8e1-f2a0-43c5-869f-53a61a9cbec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:03.396933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994d8e1-f2a0-43c5-869f-53a61a9cbec8 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:03.397209 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994d8e1-f2a0-43c5-869f-53a61a9cbec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:03.397475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994d8e1-f2a0-43c5-869f-53a61a9cbec8 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:03.398104 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994d8e1-f2a0-43c5-869f-53a61a9cbec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:03.398402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994d8e1-f2a0-43c5-869f-53a61a9cbec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:03.399828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994d8e1-f2a0-43c5-869f-53a61a9cbec8 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:03.412007 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 635/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:03.417810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34034b-46ce-4d1e-8911-34c457f6e697 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:03.518130 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34034b-46ce-4d1e-8911-34c457f6e697 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:03.537581 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:03.551556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32903cd7-6bde-428e-88a8-8db5a3525f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:03.552222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32903cd7-6bde-428e-88a8-8db5a3525f4a None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:03.552508 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32903cd7-6bde-428e-88a8-8db5a3525f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:03.552783 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32903cd7-6bde-428e-88a8-8db5a3525f4a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:03.560585 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32903cd7-6bde-428e-88a8-8db5a3525f4a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:03.562012 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32903cd7-6bde-428e-88a8-8db5a3525f4a None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-32903cd7-6bde-428e-88a8-8db5a3525f4a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:49:03.573599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:49:03.575059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:49:03.576046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:49:03.576046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:49:03.576046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:49:03.576046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:49:03.576046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:49:03.576046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:49:03.576046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:49:03.576046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:49:03.576046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:49:03.576046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:49:03.576046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 632/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:49:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:49:03.580893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994d8e1-f2a0-43c5-869f-53a61a9cbec8 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:03.680711 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994d8e1-f2a0-43c5-869f-53a61a9cbec8 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:03.713796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba176b62-651e-4a0b-a63b-94ad94ec6083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:03.714394 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba176b62-651e-4a0b-a63b-94ad94ec6083 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:03.714692 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba176b62-651e-4a0b-a63b-94ad94ec6083 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:03.714945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba176b62-651e-4a0b-a63b-94ad94ec6083 None admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:03.716226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba176b62-651e-4a0b-a63b-94ad94ec6083 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:03.716532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba176b62-651e-4a0b-a63b-94ad94ec6083 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:03.717998 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba176b62-651e-4a0b-a63b-94ad94ec6083 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:03.726481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:03.735211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 636/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Sep 1 13:49:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:03.740915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32903cd7-6bde-428e-88a8-8db5a3525f4a None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:03.839922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32903cd7-6bde-428e-88a8-8db5a3525f4a None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:03.873163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cd5bb-1005-41e7-9534-6b7389acd8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:03.873786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cd5bb-1005-41e7-9534-6b7389acd8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:03.874066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cd5bb-1005-41e7-9534-6b7389acd8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:03.874366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cd5bb-1005-41e7-9534-6b7389acd8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:03.884869 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cd5bb-1005-41e7-9534-6b7389acd8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:03.886292 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cd5bb-1005-41e7-9534-6b7389acd8e1 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-279cd5bb-1005-41e7-9534-6b7389acd8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:49:03.900526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:49:03.901476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:49:03.902389 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:49:03.902389 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:49:03.902389 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:49:03.902389 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 633/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:49:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:49:03.908167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba176b62-651e-4a0b-a63b-94ad94ec6083 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:04.007247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba176b62-651e-4a0b-a63b-94ad94ec6083 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:04.039745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5794f5-09f9-4977-88de-b7a7a8571a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:04.040369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5794f5-09f9-4977-88de-b7a7a8571a39 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:04.040642 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5794f5-09f9-4977-88de-b7a7a8571a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:04.040914 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5794f5-09f9-4977-88de-b7a7a8571a39 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:04.041540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5794f5-09f9-4977-88de-b7a7a8571a39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:04.041840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5794f5-09f9-4977-88de-b7a7a8571a39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:04.043183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5794f5-09f9-4977-88de-b7a7a8571a39 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:04.054535 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 637/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:04.060922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cd5bb-1005-41e7-9534-6b7389acd8e1 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:04.092147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:04.161206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cd5bb-1005-41e7-9534-6b7389acd8e1 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:04.196065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c79996-c606-4591-93bc-cc8e27087039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:04.196695 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c79996-c606-4591-93bc-cc8e27087039 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:04.196976 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c79996-c606-4591-93bc-cc8e27087039 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:04.197248 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c79996-c606-4591-93bc-cc8e27087039 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:04.203757 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c79996-c606-4591-93bc-cc8e27087039 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:04.205222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c79996-c606-4591-93bc-cc8e27087039 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:04.217051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-e8c79996-c606-4591-93bc-cc8e27087039 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:49:04.217051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:04.217051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:49:04.217051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:49:04.217051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:49:04.217051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:49:04.217051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:49:04.217051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:49:04.217051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:49:04.217051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:49:04.217051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:49:04.217051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:49:04.217051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:49:04.217051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:49:04.217051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:49:04.218823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:49:04.219953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:49:04.219953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:49:04.219953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:49:04.219953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:49:04.219953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:49:04.219953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:49:04.219953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:49:04.219953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:49:04.219953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 634/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:49:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 13:49:04.224199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5794f5-09f9-4977-88de-b7a7a8571a39 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:04.284668 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:04.322598 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5794f5-09f9-4977-88de-b7a7a8571a39 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:04.355397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab63d5b-d92b-42d6-bad6-d5c31b354180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:04.356061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab63d5b-d92b-42d6-bad6-d5c31b354180 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:04.356891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab63d5b-d92b-42d6-bad6-d5c31b354180 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:04.357162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab63d5b-d92b-42d6-bad6-d5c31b354180 None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:04.357843 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab63d5b-d92b-42d6-bad6-d5c31b354180 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:04.358146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab63d5b-d92b-42d6-bad6-d5c31b354180 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:04.359554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab63d5b-d92b-42d6-bad6-d5c31b354180 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:04.376470 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 638/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:49:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:04.378652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c79996-c606-4591-93bc-cc8e27087039 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:04.471333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:04.479671 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c79996-c606-4591-93bc-cc8e27087039 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:04.513438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7708c4-d65f-4aa9-bcd5-d80e461bbab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:04.514098 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7708c4-d65f-4aa9-bcd5-d80e461bbab2 None admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:04.516749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7708c4-d65f-4aa9-bcd5-d80e461bbab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:04.516749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7708c4-d65f-4aa9-bcd5-d80e461bbab2 None admin] PATH_INFO: `/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/cec4f437077c41039cae3d505b43b558/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:04.516749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7708c4-d65f-4aa9-bcd5-d80e461bbab2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e7998cc03064a0bb9a9dc6a1475d73c, user_id=cec4f437077c41039cae3d505b43b558, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:04.518008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7708c4-d65f-4aa9-bcd5-d80e461bbab2 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:04.622245 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 635/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Sep 1 13:49:04 2022] PUT /identity/v3/projects/5e7998cc03064a0bb9a9dc6a1475d73c/users/cec4f437077c41039cae3d505b43b558/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 13:49:06.552947 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542b227-b61c-47f0-8ebe-4fe4f61c0485 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:06.553545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542b227-b61c-47f0-8ebe-4fe4f61c0485 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:06.553545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542b227-b61c-47f0-8ebe-4fe4f61c0485 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:06.554809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 639/1274] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:49:06.560425 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744d649-5f3e-4294-82ed-d90e57f55af6 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:06.560900 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744d649-5f3e-4294-82ed-d90e57f55af6 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:06.561011 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744d649-5f3e-4294-82ed-d90e57f55af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:06.580579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-d744d649-5f3e-4294-82ed-d90e57f55af6 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:49:06.581796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d744d649-5f3e-4294-82ed-d90e57f55af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:49:06.656266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 636/1275] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:49:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:49:06.928728 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542b227-b61c-47f0-8ebe-4fe4f61c0485 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:07.031626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542b227-b61c-47f0-8ebe-4fe4f61c0485 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:07.048568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:07.064767 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a864a3-c74e-4f65-8177-c6d69bc5fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:07.065389 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a864a3-c74e-4f65-8177-c6d69bc5fee4 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:07.065669 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a864a3-c74e-4f65-8177-c6d69bc5fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:07.065942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a864a3-c74e-4f65-8177-c6d69bc5fee4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:07.076711 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a864a3-c74e-4f65-8177-c6d69bc5fee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-35a864a3-c74e-4f65-8177-c6d69bc5fee4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 13:49:07.081531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:49:07.082755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:49:07.083684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:49:07.083684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:49:07.083684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:49:07.083684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:49:07.083684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 13:49:07.083684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 13:49:07.083684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 13:49:07.083684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 13:49:07.083684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 13:49:07.083684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 13:49:07.083684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 13:49:07.083684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:49:07.083684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 640/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Sep 1 13:49:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:49:07.088631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744d649-5f3e-4294-82ed-d90e57f55af6 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:07.177241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:07.200468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744d649-5f3e-4294-82ed-d90e57f55af6 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:07.229104 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9f831-5fd4-4bb1-abfe-3e559d4996aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:07.229709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9f831-5fd4-4bb1-abfe-3e559d4996aa None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:07.229988 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9f831-5fd4-4bb1-abfe-3e559d4996aa None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:07.230258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9f831-5fd4-4bb1-abfe-3e559d4996aa None admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:07.230954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9f831-5fd4-4bb1-abfe-3e559d4996aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:07.231366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9f831-5fd4-4bb1-abfe-3e559d4996aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:07.232794 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9f831-5fd4-4bb1-abfe-3e559d4996aa None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:07.241758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 637/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Sep 1 13:49:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:07.248232 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a864a3-c74e-4f65-8177-c6d69bc5fee4 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:07.360256 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a864a3-c74e-4f65-8177-c6d69bc5fee4 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:07.395442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07277cbb-9172-43e0-be4e-b68ddc03e1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:07.396096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07277cbb-9172-43e0-be4e-b68ddc03e1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:07.396381 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07277cbb-9172-43e0-be4e-b68ddc03e1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:07.396653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07277cbb-9172-43e0-be4e-b68ddc03e1d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:07.406466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07277cbb-9172-43e0-be4e-b68ddc03e1d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:07.407922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07277cbb-9172-43e0-be4e-b68ddc03e1d6 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-07277cbb-9172-43e0-be4e-b68ddc03e1d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:49:07.422328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:49:07.423377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:49:07.424339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:49:07.424339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:49:07.424339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:49:07.424339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 641/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:49:07.429535 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9f831-5fd4-4bb1-abfe-3e559d4996aa None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:07.529353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9f831-5fd4-4bb1-abfe-3e559d4996aa None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:07.562594 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad6dd8-7ac3-40b7-aada-facd76da4727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:07.563206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad6dd8-7ac3-40b7-aada-facd76da4727 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:07.563453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad6dd8-7ac3-40b7-aada-facd76da4727 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:07.563717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad6dd8-7ac3-40b7-aada-facd76da4727 None admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:07.564368 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad6dd8-7ac3-40b7-aada-facd76da4727 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:07.564668 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad6dd8-7ac3-40b7-aada-facd76da4727 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:07.566003 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad6dd8-7ac3-40b7-aada-facd76da4727 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:07.587608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 638/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:07.593485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07277cbb-9172-43e0-be4e-b68ddc03e1d6 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:07.631365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:07.701940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07277cbb-9172-43e0-be4e-b68ddc03e1d6 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:07.735000 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac12143-6764-4de3-848d-8eca1fcb1d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:07.735628 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12143-6764-4de3-848d-8eca1fcb1d67 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:07.735945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12143-6764-4de3-848d-8eca1fcb1d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:07.736225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac12143-6764-4de3-848d-8eca1fcb1d67 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:07.743505 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac12143-6764-4de3-848d-8eca1fcb1d67 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:07.744965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac12143-6764-4de3-848d-8eca1fcb1d67 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-8ac12143-6764-4de3-848d-8eca1fcb1d67 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 13:49:07.757042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:49:07.758184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:49:07.759168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:49:07.759168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:49:07.759168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 13:49:07.759168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 13:49:07.759168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 13:49:07.759168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 13:49:07.759168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 13:49:07.759168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 13:49:07.759168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 13:49:07.759168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:49:07.759168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 642/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:49:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:49:07.764231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad6dd8-7ac3-40b7-aada-facd76da4727 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:07.768119 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:07.862022 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad6dd8-7ac3-40b7-aada-facd76da4727 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:07.895403 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8808f3-8cc0-47aa-a0fc-56125fdc3e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:07.896090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8808f3-8cc0-47aa-a0fc-56125fdc3e13 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:07.900457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8808f3-8cc0-47aa-a0fc-56125fdc3e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:07.900457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8808f3-8cc0-47aa-a0fc-56125fdc3e13 None admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:07.900457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8808f3-8cc0-47aa-a0fc-56125fdc3e13 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:07.900457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8808f3-8cc0-47aa-a0fc-56125fdc3e13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:07.900457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8808f3-8cc0-47aa-a0fc-56125fdc3e13 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:07.916740 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 639/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Sep 1 13:49:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 13:49:07.924419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac12143-6764-4de3-848d-8eca1fcb1d67 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:08.015253 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:08.024934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac12143-6764-4de3-848d-8eca1fcb1d67 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:08.058343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8f823-4747-47a5-9903-87dd7f87d24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:08.058946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8f823-4747-47a5-9903-87dd7f87d24c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:08.059228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8f823-4747-47a5-9903-87dd7f87d24c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:08.059634 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8f823-4747-47a5-9903-87dd7f87d24c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:08.127587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8f823-4747-47a5-9903-87dd7f87d24c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:08.129026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8f823-4747-47a5-9903-87dd7f87d24c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:08.217136 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:08.227760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 643/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Sep 1 13:49:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 13:49:08.233724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8808f3-8cc0-47aa-a0fc-56125fdc3e13 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:08.295436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:08.332621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8808f3-8cc0-47aa-a0fc-56125fdc3e13 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:08.369984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463d714-e788-4077-8075-05bfc75ba180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:08.370611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463d714-e788-4077-8075-05bfc75ba180 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:08.370891 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463d714-e788-4077-8075-05bfc75ba180 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:08.371163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463d714-e788-4077-8075-05bfc75ba180 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:08.385965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463d714-e788-4077-8075-05bfc75ba180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:08.385965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463d714-e788-4077-8075-05bfc75ba180 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-5463d714-e788-4077-8075-05bfc75ba180 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 13:49:08.398489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:49:08.399627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 13:49:08.400825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 13:49:08.400825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 13:49:08.400825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:49:08.400825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 640/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 13:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:49:08.405531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8f823-4747-47a5-9903-87dd7f87d24c None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:08.505786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8f823-4747-47a5-9903-87dd7f87d24c None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:08.538603 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097cb60-b716-4fb6-acea-0ac17def8445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:08.539202 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097cb60-b716-4fb6-acea-0ac17def8445 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:08.539482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097cb60-b716-4fb6-acea-0ac17def8445 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:08.539752 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097cb60-b716-4fb6-acea-0ac17def8445 None admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:08.540414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097cb60-b716-4fb6-acea-0ac17def8445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:08.540716 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097cb60-b716-4fb6-acea-0ac17def8445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:08.542064 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097cb60-b716-4fb6-acea-0ac17def8445 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:08.553470 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 644/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Sep 1 13:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:08.559937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463d714-e788-4077-8075-05bfc75ba180 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:08.660306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463d714-e788-4077-8075-05bfc75ba180 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:08.674396 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:08.694132 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da06893-18e0-4b54-9d6e-c2cbf9618ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:08.694830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da06893-18e0-4b54-9d6e-c2cbf9618ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:08.695109 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da06893-18e0-4b54-9d6e-c2cbf9618ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:08.695375 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da06893-18e0-4b54-9d6e-c2cbf9618ad9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:08.701829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da06893-18e0-4b54-9d6e-c2cbf9618ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:08.703245 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da06893-18e0-4b54-9d6e-c2cbf9618ad9 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:08.714074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application [None req-2da06893-18e0-4b54-9d6e-c2cbf9618ad9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:49:08.714074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:08.714074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:49:08.714074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:49:08.714074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:49:08.714074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:49:08.714074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:49:08.714074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:49:08.714074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:49:08.714074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:49:08.714074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:49:08.714074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:49:08.714074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 13:49:08.714074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 13:49:08.714074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application with Lock( Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:49:08.715108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:49:08.724311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 13:49:08.724311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 13:49:08.724311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 13:49:08.724311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 13:49:08.724311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 13:49:08.724311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 13:49:08.724311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 13:49:08.724311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: ERROR keystone.server.flask.application Sep 01 13:49:08.724311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 641/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Sep 1 13:49:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:49:08.724960 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097cb60-b716-4fb6-acea-0ac17def8445 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:08.770610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:08.819762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097cb60-b716-4fb6-acea-0ac17def8445 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:08.853823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7779b-22a9-47d2-9f05-e126cfee615c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:08.854426 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7779b-22a9-47d2-9f05-e126cfee615c None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:08.854711 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7779b-22a9-47d2-9f05-e126cfee615c None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:08.854987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7779b-22a9-47d2-9f05-e126cfee615c None admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:08.855703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7779b-22a9-47d2-9f05-e126cfee615c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:08.856707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7779b-22a9-47d2-9f05-e126cfee615c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:08.858141 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7779b-22a9-47d2-9f05-e126cfee615c None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:08.870044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 645/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Sep 1 13:49:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:08.876564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da06893-18e0-4b54-9d6e-c2cbf9618ad9 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:08.975605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da06893-18e0-4b54-9d6e-c2cbf9618ad9 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:09.010139 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38578f-f425-4d72-b99b-54399e207b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:09.010759 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38578f-f425-4d72-b99b-54399e207b7d None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:09.011024 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38578f-f425-4d72-b99b-54399e207b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:09.011295 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38578f-f425-4d72-b99b-54399e207b7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:09.012066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38578f-f425-4d72-b99b-54399e207b7d None admin] RBAC: Adding query filter params (role.id=d1bd8a5b71324c839e80289ee9e4d600, scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c, user.id=cec4f437077c41039cae3d505b43b558) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:09.012392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38578f-f425-4d72-b99b-54399e207b7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:09.013806 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38578f-f425-4d72-b99b-54399e207b7d None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:09.019630 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 642/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Sep 1 13:49:08 2022] GET /identity/v3/role_assignments?user.id=cec4f437077c41039cae3d505b43b558&scope.project.id=5e7998cc03064a0bb9a9dc6a1475d73c&role.id=d1bd8a5b71324c839e80289ee9e4d600 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:10.959359 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf28ce5-6852-4cae-b5af-fd08ac262387 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:10.959977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf28ce5-6852-4cae-b5af-fd08ac262387 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:10.959977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf28ce5-6852-4cae-b5af-fd08ac262387 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:10.961279 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 646/1288] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:49:10.966927 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460daa14-d33c-4e92-a230-a6d1138aa8e0 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:10.967387 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460daa14-d33c-4e92-a230-a6d1138aa8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:10.967492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460daa14-d33c-4e92-a230-a6d1138aa8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:10.986124 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-460daa14-d33c-4e92-a230-a6d1138aa8e0 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:49:10.987334 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-460daa14-d33c-4e92-a230-a6d1138aa8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:49:11.017953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:11.054164 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 643/1289] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:49:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:49:11.324405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf28ce5-6852-4cae-b5af-fd08ac262387 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:11.425587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf28ce5-6852-4cae-b5af-fd08ac262387 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:11.436695 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:11.459633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4ece1-0e70-4559-8421-9d84b6335330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:11.460275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4ece1-0e70-4559-8421-9d84b6335330 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:11.460549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4ece1-0e70-4559-8421-9d84b6335330 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:11.460851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4ece1-0e70-4559-8421-9d84b6335330 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:11.462384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4ece1-0e70-4559-8421-9d84b6335330 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:11.462917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4ece1-0e70-4559-8421-9d84b6335330 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-43a4ece1-0e70-4559-8421-9d84b6335330 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:49:11.472350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:49:11.473748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:49:11.474832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:49:11.474832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:49:11.474832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:49:11.474832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:49:11.474832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:49:11.474832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:49:11.474832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:49:11.474832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:49:11.474832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:49:11.474832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:49:11.474832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:49:11.474832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:49:11.474832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:49:11.474832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:49:11.474832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 647/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 13:49:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:49:11.479507 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460daa14-d33c-4e92-a230-a6d1138aa8e0 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:11.583680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460daa14-d33c-4e92-a230-a6d1138aa8e0 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:11.617782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd280c-c586-4ef3-9f16-f5ef1988e4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:11.618384 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd280c-c586-4ef3-9f16-f5ef1988e4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:11.618666 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd280c-c586-4ef3-9f16-f5ef1988e4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:11.618937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd280c-c586-4ef3-9f16-f5ef1988e4a9 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:11.619557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd280c-c586-4ef3-9f16-f5ef1988e4a9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:11.619883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd280c-c586-4ef3-9f16-f5ef1988e4a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:11.621289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd280c-c586-4ef3-9f16-f5ef1988e4a9 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:11.626445 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 644/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Sep 1 13:49:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:11.632220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4ece1-0e70-4559-8421-9d84b6335330 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:11.732611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4ece1-0e70-4559-8421-9d84b6335330 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:11.765279 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef5e5-02c9-483c-a930-0ea445fbbd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:11.765879 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef5e5-02c9-483c-a930-0ea445fbbd6b None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:11.766160 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef5e5-02c9-483c-a930-0ea445fbbd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:11.766432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef5e5-02c9-483c-a930-0ea445fbbd6b None admin] PATH_INFO: `/v3/services` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:11.767052 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef5e5-02c9-483c-a930-0ea445fbbd6b None admin] RBAC: Adding query filter params (type=placement) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:11.767354 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef5e5-02c9-483c-a930-0ea445fbbd6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:11.768748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef5e5-02c9-483c-a930-0ea445fbbd6b None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:11.773046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 648/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Sep 1 13:49:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:13.695619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05a2b5-b369-4982-aa63-e743ae7c7476 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:13.696213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05a2b5-b369-4982-aa63-e743ae7c7476 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:13.696213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05a2b5-b369-4982-aa63-e743ae7c7476 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:13.697535 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 645/1293] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:49:13.703399 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a10b9-af68-4de1-a717-3c18955b32e7 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:13.703800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a10b9-af68-4de1-a717-3c18955b32e7 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:13.703975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a10b9-af68-4de1-a717-3c18955b32e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:13.722576 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-035a10b9-af68-4de1-a717-3c18955b32e7 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:49:13.723901 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-035a10b9-af68-4de1-a717-3c18955b32e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:49:13.753161 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:13.790375 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 649/1294] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:49:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:49:14.058624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05a2b5-b369-4982-aa63-e743ae7c7476 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:14.090128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:14.159026 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05a2b5-b369-4982-aa63-e743ae7c7476 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:14.192225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ac529-f85e-4881-90e6-994289ca92c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:14.192829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ac529-f85e-4881-90e6-994289ca92c5 None admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:14.193110 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ac529-f85e-4881-90e6-994289ca92c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:14.193385 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ac529-f85e-4881-90e6-994289ca92c5 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:14.194028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ac529-f85e-4881-90e6-994289ca92c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:14.195386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ac529-f85e-4881-90e6-994289ca92c5 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:14.302173 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 646/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Sep 1 13:49:14 2022] POST /identity/v3/services => generated 246 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:49:16.242373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426d57f-50d0-41fa-a59e-6e62df051601 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:16.242965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426d57f-50d0-41fa-a59e-6e62df051601 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:16.242965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426d57f-50d0-41fa-a59e-6e62df051601 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:16.244395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 650/1296] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:49:16.250093 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9238b2a-4a5b-4568-956b-d4b65e40d789 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:16.250754 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9238b2a-4a5b-4568-956b-d4b65e40d789 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:16.250926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9238b2a-4a5b-4568-956b-d4b65e40d789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:16.268795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-a9238b2a-4a5b-4568-956b-d4b65e40d789 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:49:16.270002 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a9238b2a-4a5b-4568-956b-d4b65e40d789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:49:16.348878 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 647/1297] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:49:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:49:16.621054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426d57f-50d0-41fa-a59e-6e62df051601 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:16.722462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426d57f-50d0-41fa-a59e-6e62df051601 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:16.757582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c06259-0d3d-4877-bf93-2caec1842298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:16.758212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c06259-0d3d-4877-bf93-2caec1842298 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:16.758501 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c06259-0d3d-4877-bf93-2caec1842298 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:16.758766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c06259-0d3d-4877-bf93-2caec1842298 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:16.759345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c06259-0d3d-4877-bf93-2caec1842298 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:16.760725 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c06259-0d3d-4877-bf93-2caec1842298 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-35c06259-0d3d-4877-bf93-2caec1842298 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:49:16.769333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:49:16.770531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:49:16.771556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:49:16.771556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:49:16.771556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:49:16.771556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:49:16.771556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:49:16.771556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:49:16.771556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:49:16.771556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:49:16.771556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:49:16.771556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:49:16.771556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:49:16.771556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:49:16.771556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:49:16.771556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:49:16.771556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 651/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 13:49:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:49:16.776629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9238b2a-4a5b-4568-956b-d4b65e40d789 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:16.795751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:16.880910 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9238b2a-4a5b-4568-956b-d4b65e40d789 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:16.917397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bf5c6-4387-48f6-9158-82c7a9ea1990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:16.918601 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bf5c6-4387-48f6-9158-82c7a9ea1990 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:16.918883 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bf5c6-4387-48f6-9158-82c7a9ea1990 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:16.919153 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bf5c6-4387-48f6-9158-82c7a9ea1990 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:16.919798 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bf5c6-4387-48f6-9158-82c7a9ea1990 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:16.920136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bf5c6-4387-48f6-9158-82c7a9ea1990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:16.921544 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1bf5c6-4387-48f6-9158-82c7a9ea1990 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:16.932569 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 648/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Sep 1 13:49:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:16.933836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c06259-0d3d-4877-bf93-2caec1842298 None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:16.969120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:17.042604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c06259-0d3d-4877-bf93-2caec1842298 None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:17.079927 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b58210-ec03-4413-8738-e8c591d47736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:17.080557 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b58210-ec03-4413-8738-e8c591d47736 None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:17.080841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b58210-ec03-4413-8738-e8c591d47736 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:17.081114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b58210-ec03-4413-8738-e8c591d47736 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:17.081838 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b58210-ec03-4413-8738-e8c591d47736 None admin] RBAC: Adding query filter params (interface=public, service_id=78648b8cd51349bc9964ff397d89a461, region_id=RegionOne) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:17.082149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b58210-ec03-4413-8738-e8c591d47736 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:17.083592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b58210-ec03-4413-8738-e8c591d47736 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:17.089489 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 652/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Sep 1 13:49:16 2022] GET /identity/v3/endpoints?service_id=78648b8cd51349bc9964ff397d89a461&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:17.096143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bf5c6-4387-48f6-9158-82c7a9ea1990 None admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:17.182135 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:17.201150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bf5c6-4387-48f6-9158-82c7a9ea1990 None admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:17.239397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e47db-9bc2-4d4e-ba92-2fdbbf4f90c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:17.239963 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e47db-9bc2-4d4e-ba92-2fdbbf4f90c1 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:17.240273 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e47db-9bc2-4d4e-ba92-2fdbbf4f90c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:17.240563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e47db-9bc2-4d4e-ba92-2fdbbf4f90c1 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:17.241196 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e47db-9bc2-4d4e-ba92-2fdbbf4f90c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:17.242550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e47db-9bc2-4d4e-ba92-2fdbbf4f90c1 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:17.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 649/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Sep 1 13:49:17 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 13:49:19.144731 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb311af9-b30d-450f-80b9-0bc53a789980 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:19.192172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb311af9-b30d-450f-80b9-0bc53a789980 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:19.192172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb311af9-b30d-450f-80b9-0bc53a789980 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:19.192172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 653/1302] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:49:19.193047 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6b6f0-b9db-4b97-8f47-88c2fc48ac86 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:19.193047 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6b6f0-b9db-4b97-8f47-88c2fc48ac86 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:19.193047 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6b6f0-b9db-4b97-8f47-88c2fc48ac86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:19.193047 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-bca6b6f0-b9db-4b97-8f47-88c2fc48ac86 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:49:19.193047 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bca6b6f0-b9db-4b97-8f47-88c2fc48ac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:49:19.238860 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 650/1303] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:49:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 13:49:19.522246 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb311af9-b30d-450f-80b9-0bc53a789980 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:19.616197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:19.624230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb311af9-b30d-450f-80b9-0bc53a789980 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:19.658187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421500fc-4fa1-4984-99f5-08ca19499c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:19.663382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421500fc-4fa1-4984-99f5-08ca19499c3b None admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:19.663382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421500fc-4fa1-4984-99f5-08ca19499c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:19.663382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421500fc-4fa1-4984-99f5-08ca19499c3b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:19.663382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421500fc-4fa1-4984-99f5-08ca19499c3b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:19.663382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421500fc-4fa1-4984-99f5-08ca19499c3b None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application [None req-421500fc-4fa1-4984-99f5-08ca19499c3b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 13:49:19.670019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 13:49:19.671374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 13:49:19.672632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 13:49:19.672632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application with Lock( Sep 01 13:49:19.672632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 13:49:19.672632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self._enter() Sep 01 13:49:19.672632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 13:49:19.672632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 13:49:19.672632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 13:49:19.672632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application return self.creator() Sep 01 13:49:19.672632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 13:49:19.672632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application created_value = creator( Sep 01 13:49:19.672632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 13:49:19.672632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 13:49:19.672632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 13:49:19.672632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: ERROR keystone.server.flask.application Sep 01 13:49:19.672632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 654/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Sep 1 13:49:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 13:49:19.677161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6b6f0-b9db-4b97-8f47-88c2fc48ac86 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:19.753322 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:19.776624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6b6f0-b9db-4b97-8f47-88c2fc48ac86 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:19.809572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350d85d-4a86-4965-8b9f-cb22de1e7934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:19.810176 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350d85d-4a86-4965-8b9f-cb22de1e7934 None admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:19.810460 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350d85d-4a86-4965-8b9f-cb22de1e7934 None admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:19.810736 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350d85d-4a86-4965-8b9f-cb22de1e7934 None admin] PATH_INFO: `/v3/services` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:19.811356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350d85d-4a86-4965-8b9f-cb22de1e7934 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 13:49:19.811661 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350d85d-4a86-4965-8b9f-cb22de1e7934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:19.813069 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350d85d-4a86-4965-8b9f-cb22de1e7934 None admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:19.818065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 651/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Sep 1 13:49:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 13:49:19.824002 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421500fc-4fa1-4984-99f5-08ca19499c3b None admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:49:19.922370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421500fc-4fa1-4984-99f5-08ca19499c3b None admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:49:19.955836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2858b7-9bdc-4f63-bc47-56818ad39e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:49:19.956466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2858b7-9bdc-4f63-bc47-56818ad39e68 None admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:49:19.956744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2858b7-9bdc-4f63-bc47-56818ad39e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:49:19.957015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2858b7-9bdc-4f63-bc47-56818ad39e68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:49:19.957688 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2858b7-9bdc-4f63-bc47-56818ad39e68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:49:19.959040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2858b7-9bdc-4f63-bc47-56818ad39e68 None admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:49:20.073050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 655/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 13:49:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 13:49:29.890134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=30 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:49:30.068560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:57.263604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd302607-398a-43c7-b74a-6a1ac9701c2c None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:57.264559 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd302607-398a-43c7-b74a-6a1ac9701c2c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:57.264992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd302607-398a-43c7-b74a-6a1ac9701c2c None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:57.271758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d9d76-b3d5-44fa-956a-c18ec36fe83b None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:57.272597 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d9d76-b3d5-44fa-956a-c18ec36fe83b None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:57.273033 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d9d76-b3d5-44fa-956a-c18ec36fe83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:57.276443 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 652/1307] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:57:57 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:57:57.413138 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-c01d9d76-b3d5-44fa-956a-c18ec36fe83b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:57:57.414738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c01d9d76-b3d5-44fa-956a-c18ec36fe83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:57.619924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 656/1308] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:57:57.904690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe2c11-af71-41e5-aa06-b457b59591cd None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:57.905055 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe2c11-af71-41e5-aa06-b457b59591cd None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:57.905418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe2c11-af71-41e5-aa06-b457b59591cd None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:57.906839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 653/1309] 10.222.0.64 () {54 vars in 965 bytes} [Thu Sep 1 13:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:57:57.913112 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9029d4-75f9-4393-aba9-0a4620113cd0 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:57.913479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9029d4-75f9-4393-aba9-0a4620113cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:57.913821 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9029d4-75f9-4393-aba9-0a4620113cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:57.996698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-fb9029d4-75f9-4393-aba9-0a4620113cd0 None None] MFA Rules not processed for user `4a9703db64624bbeb392d693ca60c6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:57:58.003764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fb9029d4-75f9-4393-aba9-0a4620113cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:58.022350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:58.090488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 657/1310] 10.222.0.64 () {58 vars in 1062 bytes} [Thu Sep 1 13:57:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:57:58.100194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe2c11-af71-41e5-aa06-b457b59591cd None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:57:58.102272 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c5fe2c11-af71-41e5-aa06-b457b59591cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:58.232748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe2c11-af71-41e5-aa06-b457b59591cd None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:57:58.314783 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef32bc3-bfef-4f3b-abdb-848ec736be86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:57:58.315479 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef32bc3-bfef-4f3b-abdb-848ec736be86 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:57:58.315725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef32bc3-bfef-4f3b-abdb-848ec736be86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:57:58.315994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef32bc3-bfef-4f3b-abdb-848ec736be86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:57:58.317590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4ef32bc3-bfef-4f3b-abdb-848ec736be86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:57:58.376581 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:58.439993 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef32bc3-bfef-4f3b-abdb-848ec736be86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:57:58.441332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef32bc3-bfef-4f3b-abdb-848ec736be86 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:57:58.461948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 654/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:57:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:58:00.669211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760b655-4a86-4faf-8422-7eb14d0d3b55 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:00.669741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760b655-4a86-4faf-8422-7eb14d0d3b55 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:00.669741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760b655-4a86-4faf-8422-7eb14d0d3b55 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:00.671254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 658/1312] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:00.676394 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be519f70-4501-4aa7-8180-33d556367665 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:00.676804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be519f70-4501-4aa7-8180-33d556367665 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:00.676978 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be519f70-4501-4aa7-8180-33d556367665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:00.753510 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-be519f70-4501-4aa7-8180-33d556367665 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:00.754720 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-be519f70-4501-4aa7-8180-33d556367665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:00.863582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 655/1313] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:01.146651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760b655-4a86-4faf-8422-7eb14d0d3b55 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:01.148897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-4760b655-4a86-4faf-8422-7eb14d0d3b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:01.257149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760b655-4a86-4faf-8422-7eb14d0d3b55 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:01.329852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:01.332198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032cdcf-9657-4845-95af-4d61aa22a826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:01.332810 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032cdcf-9657-4845-95af-4d61aa22a826 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:01.333090 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032cdcf-9657-4845-95af-4d61aa22a826 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:01.333361 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032cdcf-9657-4845-95af-4d61aa22a826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:01.334967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e032cdcf-9657-4845-95af-4d61aa22a826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:01.448457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032cdcf-9657-4845-95af-4d61aa22a826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:01.449807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032cdcf-9657-4845-95af-4d61aa22a826 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:01.471165 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 659/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:03.972916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc16f6-2f43-4967-a607-2e235d6a0ce7 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:03.973503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc16f6-2f43-4967-a607-2e235d6a0ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:03.973605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc16f6-2f43-4967-a607-2e235d6a0ce7 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:03.974923 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 656/1315] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:03.980752 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055d5b3-ad27-4b69-86b5-9d8f5bb8e27f None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:03.981338 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055d5b3-ad27-4b69-86b5-9d8f5bb8e27f None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:03.981338 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055d5b3-ad27-4b69-86b5-9d8f5bb8e27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:04.053159 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-6055d5b3-ad27-4b69-86b5-9d8f5bb8e27f None None] MFA Rules not processed for user `61066d74ba554ad286195a8631d292e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:04.054942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6055d5b3-ad27-4b69-86b5-9d8f5bb8e27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:04.106120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:04.151573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 660/1316] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:58:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:04.446508 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbdeec-6130-48a3-831b-8f21728bd440 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:04.446792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbdeec-6130-48a3-831b-8f21728bd440 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:04.447066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbdeec-6130-48a3-831b-8f21728bd440 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:04.448486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 657/1317] 10.222.0.64 () {54 vars in 965 bytes} [Thu Sep 1 13:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:04.454324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13532369-f890-484e-aad5-8e598a4e9347 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:04.454612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13532369-f890-484e-aad5-8e598a4e9347 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:04.454884 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13532369-f890-484e-aad5-8e598a4e9347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:04.530722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-13532369-f890-484e-aad5-8e598a4e9347 None None] MFA Rules not processed for user `4a9703db64624bbeb392d693ca60c6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:04.531959 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-13532369-f890-484e-aad5-8e598a4e9347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:04.606457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 661/1318] 10.222.0.64 () {58 vars in 1062 bytes} [Thu Sep 1 13:58:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:04.615850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbdeec-6130-48a3-831b-8f21728bd440 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:04.617990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d7dbdeec-6130-48a3-831b-8f21728bd440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:04.627702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:04.723074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbdeec-6130-48a3-831b-8f21728bd440 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:04.797613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a15b83-4deb-4823-9946-6a222148a2b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:04.798228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a15b83-4deb-4823-9946-6a222148a2b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:04.798511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a15b83-4deb-4823-9946-6a222148a2b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:04.798781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a15b83-4deb-4823-9946-6a222148a2b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:04.800414 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-17a15b83-4deb-4823-9946-6a222148a2b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:04.863636 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:04.909486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a15b83-4deb-4823-9946-6a222148a2b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:04.910963 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a15b83-4deb-4823-9946-6a222148a2b1 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:04.928985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 658/1319] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:04 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:08.040794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f304201-71e3-4d78-9f3d-dd5bb4398a85 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:08.041339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f304201-71e3-4d78-9f3d-dd5bb4398a85 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:08.041339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f304201-71e3-4d78-9f3d-dd5bb4398a85 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:08.042726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 662/1320] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:58:08.047999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84e20d-8137-4cd4-8fce-7397e38bd3b1 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:08.048436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84e20d-8137-4cd4-8fce-7397e38bd3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:08.048562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84e20d-8137-4cd4-8fce-7397e38bd3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:08.113753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-8b84e20d-8137-4cd4-8fce-7397e38bd3b1 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:08.114962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-8b84e20d-8137-4cd4-8fce-7397e38bd3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:08.216197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 659/1321] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:58:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:08.498452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f304201-71e3-4d78-9f3d-dd5bb4398a85 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:08.500033 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-5f304201-71e3-4d78-9f3d-dd5bb4398a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:08.557822 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:08.609924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f304201-71e3-4d78-9f3d-dd5bb4398a85 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:08.681343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e1308-d1a5-47d7-af0d-c4fb1ff25b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:08.681945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e1308-d1a5-47d7-af0d-c4fb1ff25b5f service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:08.682222 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e1308-d1a5-47d7-af0d-c4fb1ff25b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:08.682490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e1308-d1a5-47d7-af0d-c4fb1ff25b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:08.684130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-439e1308-d1a5-47d7-af0d-c4fb1ff25b5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:08.786626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:08.800482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e1308-d1a5-47d7-af0d-c4fb1ff25b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:08.801933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e1308-d1a5-47d7-af0d-c4fb1ff25b5f service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:08.819636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 663/1322] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:11.939942 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602901e-1c56-42a2-a7d9-4769fe5c7d94 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:11.940525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602901e-1c56-42a2-a7d9-4769fe5c7d94 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:11.940525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602901e-1c56-42a2-a7d9-4769fe5c7d94 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:11.941856 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 660/1323] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:11.947094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3e794-e5d2-4f2b-9c07-5d29935ec12e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:11.947503 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3e794-e5d2-4f2b-9c07-5d29935ec12e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:11.947793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3e794-e5d2-4f2b-9c07-5d29935ec12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:12.015748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-5fc3e794-e5d2-4f2b-9c07-5d29935ec12e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:12.017000 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-5fc3e794-e5d2-4f2b-9c07-5d29935ec12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:12.114303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 664/1324] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:12.395778 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602901e-1c56-42a2-a7d9-4769fe5c7d94 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:12.397403 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-0602901e-1c56-42a2-a7d9-4769fe5c7d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:12.418091 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:12.509447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602901e-1c56-42a2-a7d9-4769fe5c7d94 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:12.585344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a5b1d-cbf1-478b-8c5b-617199fd28c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:12.585949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a5b1d-cbf1-478b-8c5b-617199fd28c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:12.586223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a5b1d-cbf1-478b-8c5b-617199fd28c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:12.586487 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a5b1d-cbf1-478b-8c5b-617199fd28c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:12.588089 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-431a5b1d-cbf1-478b-8c5b-617199fd28c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:12.660689 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:12.700569 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a5b1d-cbf1-478b-8c5b-617199fd28c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:12.702000 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a5b1d-cbf1-478b-8c5b-617199fd28c2 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:12.720439 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 661/1325] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:14.728367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf8add-e8d9-4a4c-ab48-f8f73669aef2 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:14.728933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf8add-e8d9-4a4c-ab48-f8f73669aef2 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:14.728933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf8add-e8d9-4a4c-ab48-f8f73669aef2 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:14.730292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 665/1326] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:14.736094 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63247b-5d6f-43bb-9702-9adb91c93d95 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:14.736531 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63247b-5d6f-43bb-9702-9adb91c93d95 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:14.736642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63247b-5d6f-43bb-9702-9adb91c93d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:14.804983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-ba63247b-5d6f-43bb-9702-9adb91c93d95 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:14.806200 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ba63247b-5d6f-43bb-9702-9adb91c93d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:14.905969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 662/1327] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:15.190331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf8add-e8d9-4a4c-ab48-f8f73669aef2 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:15.191854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-9dbf8add-e8d9-4a4c-ab48-f8f73669aef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:15.261534 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:15.313723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf8add-e8d9-4a4c-ab48-f8f73669aef2 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:15.396613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8a0a4-160d-444e-a51a-57a372ceaee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:15.397752 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8a0a4-160d-444e-a51a-57a372ceaee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:15.398037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8a0a4-160d-444e-a51a-57a372ceaee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:15.398464 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8a0a4-160d-444e-a51a-57a372ceaee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:15.399982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e5e8a0a4-160d-444e-a51a-57a372ceaee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:15.525926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:15.528450 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8a0a4-160d-444e-a51a-57a372ceaee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:15.529915 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8a0a4-160d-444e-a51a-57a372ceaee5 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:15.549400 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 666/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:17.526086 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1516bd-6730-4f72-b2a8-0582fda80a56 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:17.526631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1516bd-6730-4f72-b2a8-0582fda80a56 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:17.526631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1516bd-6730-4f72-b2a8-0582fda80a56 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:17.527910 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 663/1329] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:17.533281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51340058-da52-4e31-ae61-a146ce023c42 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:17.533727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51340058-da52-4e31-ae61-a146ce023c42 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:17.533825 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51340058-da52-4e31-ae61-a146ce023c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:17.604402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-51340058-da52-4e31-ae61-a146ce023c42 None None] MFA Rules not processed for user `61066d74ba554ad286195a8631d292e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:17.605917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-51340058-da52-4e31-ae61-a146ce023c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:17.715086 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 667/1330] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:58:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:18.000995 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1516bd-6730-4f72-b2a8-0582fda80a56 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:18.002524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-fe1516bd-6730-4f72-b2a8-0582fda80a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:18.034547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:18.137009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1516bd-6730-4f72-b2a8-0582fda80a56 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:18.216796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9afc6-2d2a-43fa-b91d-0abe7a591a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:18.217414 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9afc6-2d2a-43fa-b91d-0abe7a591a70 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:18.217700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9afc6-2d2a-43fa-b91d-0abe7a591a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:18.217973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9afc6-2d2a-43fa-b91d-0abe7a591a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:18.219563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b1a9afc6-2d2a-43fa-b91d-0abe7a591a70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:18.296532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:18.338367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9afc6-2d2a-43fa-b91d-0abe7a591a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:18.338367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9afc6-2d2a-43fa-b91d-0abe7a591a70 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:18.347945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 664/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:17 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:21.335039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6fb95-5079-4c79-9238-edc00ec0fa35 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:21.335623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6fb95-5079-4c79-9238-edc00ec0fa35 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:21.335623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6fb95-5079-4c79-9238-edc00ec0fa35 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:21.336970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 668/1332] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:21.342221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94e473-0523-4258-8135-434768fbf063 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:21.342661 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94e473-0523-4258-8135-434768fbf063 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:21.342782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94e473-0523-4258-8135-434768fbf063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:21.410084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6a94e473-0523-4258-8135-434768fbf063 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:21.411292 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6a94e473-0523-4258-8135-434768fbf063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:21.522268 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 665/1333] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:21.830050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6fb95-5079-4c79-9238-edc00ec0fa35 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:21.831661 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-4bd6fb95-5079-4c79-9238-edc00ec0fa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:21.901225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:21.935953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6fb95-5079-4c79-9238-edc00ec0fa35 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:22.009467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e5ad1-ecbd-4d8f-8a63-3267653de876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:22.010357 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e5ad1-ecbd-4d8f-8a63-3267653de876 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:22.010644 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e5ad1-ecbd-4d8f-8a63-3267653de876 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:22.010919 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e5ad1-ecbd-4d8f-8a63-3267653de876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:22.012559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-692e5ad1-ecbd-4d8f-8a63-3267653de876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:22.120653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e5ad1-ecbd-4d8f-8a63-3267653de876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:22.121999 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e5ad1-ecbd-4d8f-8a63-3267653de876 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:22.132409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:22.141862 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 669/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:24.102453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f203c-9255-47a7-995a-af7ada71e771 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:24.103065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f203c-9255-47a7-995a-af7ada71e771 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:24.103065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f203c-9255-47a7-995a-af7ada71e771 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:24.104501 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 666/1335] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:24.110061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b361e-5f4b-455a-a234-8c6661eae227 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:24.110486 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b361e-5f4b-455a-a234-8c6661eae227 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:24.110615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b361e-5f4b-455a-a234-8c6661eae227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:24.178877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-c99b361e-5f4b-455a-a234-8c6661eae227 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:24.180182 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c99b361e-5f4b-455a-a234-8c6661eae227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:24.281539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 670/1336] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:24.566762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f203c-9255-47a7-995a-af7ada71e771 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:24.568371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-579f203c-9255-47a7-995a-af7ada71e771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:24.609815 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:24.673249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f203c-9255-47a7-995a-af7ada71e771 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:24.748490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6aac3-c178-4183-9ab9-a0e012190cbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:24.749419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6aac3-c178-4183-9ab9-a0e012190cbb service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:24.749705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6aac3-c178-4183-9ab9-a0e012190cbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:24.749978 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6aac3-c178-4183-9ab9-a0e012190cbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:24.751579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e4f6aac3-c178-4183-9ab9-a0e012190cbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:24.836111 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:24.862486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6aac3-c178-4183-9ab9-a0e012190cbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:24.863944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6aac3-c178-4183-9ab9-a0e012190cbb service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:24.882499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 667/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:27.436723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433dfe3-cf55-4f4b-87a3-cffd2184e92b None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:27.437247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433dfe3-cf55-4f4b-87a3-cffd2184e92b None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:27.437247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433dfe3-cf55-4f4b-87a3-cffd2184e92b None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:27.438533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 671/1338] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:27.443692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae86829-5194-442f-bc41-a2f7c4d8e475 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:27.444163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae86829-5194-442f-bc41-a2f7c4d8e475 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:27.444285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae86829-5194-442f-bc41-a2f7c4d8e475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:27.510483 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-bae86829-5194-442f-bc41-a2f7c4d8e475 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:27.511760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bae86829-5194-442f-bc41-a2f7c4d8e475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:27.613660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 668/1339] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:58:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:27.902978 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433dfe3-cf55-4f4b-87a3-cffd2184e92b None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:27.904569 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6433dfe3-cf55-4f4b-87a3-cffd2184e92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:27.980404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:28.008092 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433dfe3-cf55-4f4b-87a3-cffd2184e92b None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:28.080100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41be4a1-8b32-487e-9f51-24d631d7f550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:28.080700 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41be4a1-8b32-487e-9f51-24d631d7f550 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:28.080976 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41be4a1-8b32-487e-9f51-24d631d7f550 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:28.081246 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41be4a1-8b32-487e-9f51-24d631d7f550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:28.082818 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e41be4a1-8b32-487e-9f51-24d631d7f550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:28.189584 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41be4a1-8b32-487e-9f51-24d631d7f550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:28.191017 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41be4a1-8b32-487e-9f51-24d631d7f550 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:28.209977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 672/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:32.407952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1945f-1286-4afc-b666-dbda80e6bc8b None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:32.408597 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1945f-1286-4afc-b666-dbda80e6bc8b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:32.408597 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1945f-1286-4afc-b666-dbda80e6bc8b None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:32.409861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 669/1341] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:32.415790 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b11550-2d95-4cc7-a1ff-6f65cc4ee842 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:32.416254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b11550-2d95-4cc7-a1ff-6f65cc4ee842 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:32.416376 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b11550-2d95-4cc7-a1ff-6f65cc4ee842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:32.421858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:32.486373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-e0b11550-2d95-4cc7-a1ff-6f65cc4ee842 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:32.487597 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e0b11550-2d95-4cc7-a1ff-6f65cc4ee842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:32.586830 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 673/1342] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:32.870335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1945f-1286-4afc-b666-dbda80e6bc8b None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:32.872019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-aef1945f-1286-4afc-b666-dbda80e6bc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:32.921112 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:32.977144 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1945f-1286-4afc-b666-dbda80e6bc8b None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:33.051367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec17fd-86d3-46de-bb95-2b3fbfe1a028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:33.052016 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec17fd-86d3-46de-bb95-2b3fbfe1a028 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:33.052306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec17fd-86d3-46de-bb95-2b3fbfe1a028 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:33.052645 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec17fd-86d3-46de-bb95-2b3fbfe1a028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:33.054742 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d1ec17fd-86d3-46de-bb95-2b3fbfe1a028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:33.149762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:33.166878 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec17fd-86d3-46de-bb95-2b3fbfe1a028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:33.168362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec17fd-86d3-46de-bb95-2b3fbfe1a028 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:33.187281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 670/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:36.310587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58be54b-c7ea-42e2-ade4-79d3de4b6bcf None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:36.311149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58be54b-c7ea-42e2-ade4-79d3de4b6bcf None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:36.311149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58be54b-c7ea-42e2-ade4-79d3de4b6bcf None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:36.312623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 674/1344] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:36.318136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38c678-95b5-4ad7-93e7-f9a937571f13 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:36.318568 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38c678-95b5-4ad7-93e7-f9a937571f13 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:36.318705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38c678-95b5-4ad7-93e7-f9a937571f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:36.396672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-1e38c678-95b5-4ad7-93e7-f9a937571f13 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:36.397927 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1e38c678-95b5-4ad7-93e7-f9a937571f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:36.497879 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 671/1345] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:58:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:36.785847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58be54b-c7ea-42e2-ade4-79d3de4b6bcf None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:36.788017 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a58be54b-c7ea-42e2-ade4-79d3de4b6bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:36.880229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:36.897719 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58be54b-c7ea-42e2-ade4-79d3de4b6bcf None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:36.976316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d70d03-46bc-42b8-a3ec-38bb1d2c2508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:36.976929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d70d03-46bc-42b8-a3ec-38bb1d2c2508 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:36.977218 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d70d03-46bc-42b8-a3ec-38bb1d2c2508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:36.977490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d70d03-46bc-42b8-a3ec-38bb1d2c2508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:36.979096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-22d70d03-46bc-42b8-a3ec-38bb1d2c2508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:37.090697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d70d03-46bc-42b8-a3ec-38bb1d2c2508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:37.092553 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d70d03-46bc-42b8-a3ec-38bb1d2c2508 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:37.112645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 675/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:41.600159 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88561188-ebfc-48dd-b7f0-44ca20533897 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:41.600879 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88561188-ebfc-48dd-b7f0-44ca20533897 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:41.600879 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88561188-ebfc-48dd-b7f0-44ca20533897 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:41.602357 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 672/1347] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:41.610972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c48355-450d-41c2-af7d-27b1a70247cb None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:41.611475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c48355-450d-41c2-af7d-27b1a70247cb None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:41.611588 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c48355-450d-41c2-af7d-27b1a70247cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:41.627942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:41.682543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-82c48355-450d-41c2-af7d-27b1a70247cb None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:41.683786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-82c48355-450d-41c2-af7d-27b1a70247cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:41.798430 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 676/1348] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:42.113715 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88561188-ebfc-48dd-b7f0-44ca20533897 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:42.115285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-88561188-ebfc-48dd-b7f0-44ca20533897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:42.180010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:42.228924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88561188-ebfc-48dd-b7f0-44ca20533897 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:42.305016 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b86a6-dfe5-4ce0-983a-dd68a6712070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:42.305629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b86a6-dfe5-4ce0-983a-dd68a6712070 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:42.305911 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b86a6-dfe5-4ce0-983a-dd68a6712070 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:42.306184 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b86a6-dfe5-4ce0-983a-dd68a6712070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:42.307807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-758b86a6-dfe5-4ce0-983a-dd68a6712070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:42.415311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:42.418756 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b86a6-dfe5-4ce0-983a-dd68a6712070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:42.420267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b86a6-dfe5-4ce0-983a-dd68a6712070 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:42.438836 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 673/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:47.614273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734b189-1657-45c0-aa51-029c2ec93337 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:47.615147 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734b189-1657-45c0-aa51-029c2ec93337 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:47.615748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734b189-1657-45c0-aa51-029c2ec93337 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:47.617745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 677/1350] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 13:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:47.623168 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c07bd-f262-414f-8fa0-9860a23b9d0e None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:47.624000 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c07bd-f262-414f-8fa0-9860a23b9d0e None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:47.624431 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c07bd-f262-414f-8fa0-9860a23b9d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:47.720959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-f62c07bd-f262-414f-8fa0-9860a23b9d0e None None] MFA Rules not processed for user `cec4f437077c41039cae3d505b43b558`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:47.722418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f62c07bd-f262-414f-8fa0-9860a23b9d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:47.913469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 674/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 13:58:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:58:51.796331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=59 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:52.281636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c611e-de43-4bf2-9447-cf7512c24395 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:52.281946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c611e-de43-4bf2-9447-cf7512c24395 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:52.282253 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c611e-de43-4bf2-9447-cf7512c24395 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:52.283638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 678/1352] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 13:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:52.290217 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d62df6-3b0a-47e8-85ee-9a3bc43a1001 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:52.290873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d62df6-3b0a-47e8-85ee-9a3bc43a1001 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:52.291002 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d62df6-3b0a-47e8-85ee-9a3bc43a1001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:52.351246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:52.376431 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-c2d62df6-3b0a-47e8-85ee-9a3bc43a1001 None None] MFA Rules not processed for user `cec4f437077c41039cae3d505b43b558`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:52.377635 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c2d62df6-3b0a-47e8-85ee-9a3bc43a1001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:52.496356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 675/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 13:58:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:53.787020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d0e27-22ad-42e1-a783-addad7a02201 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:53.787559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d0e27-22ad-42e1-a783-addad7a02201 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:53.787661 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d0e27-22ad-42e1-a783-addad7a02201 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:53.789120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 679/1354] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 13:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:53.794226 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a052e4-e50f-49de-9757-c78a698ce094 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:53.794645 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a052e4-e50f-49de-9757-c78a698ce094 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:53.794798 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a052e4-e50f-49de-9757-c78a698ce094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:53.873151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-f3a052e4-e50f-49de-9757-c78a698ce094 None None] MFA Rules not processed for user `cec4f437077c41039cae3d505b43b558`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:53.874340 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f3a052e4-e50f-49de-9757-c78a698ce094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:53.917943 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:53.984588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 676/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 13:58:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:58:57.559640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058c4ee-355a-4ffd-a58d-522a3a3a564f None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:57.560226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058c4ee-355a-4ffd-a58d-522a3a3a564f None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:57.560226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058c4ee-355a-4ffd-a58d-522a3a3a564f None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:57.561557 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 680/1356] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:57.566783 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b212e0a-6a80-4c5c-b43a-a7e5d6087d53 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:57.567195 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b212e0a-6a80-4c5c-b43a-a7e5d6087d53 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:57.567397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b212e0a-6a80-4c5c-b43a-a7e5d6087d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:57.643038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-8b212e0a-6a80-4c5c-b43a-a7e5d6087d53 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:57.645599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-8b212e0a-6a80-4c5c-b43a-a7e5d6087d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:57.799975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 677/1357] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:58.095339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa5ff4-8f3e-493c-b5d2-070f7725e6b3 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:58.095938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa5ff4-8f3e-493c-b5d2-070f7725e6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:58.096515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa5ff4-8f3e-493c-b5d2-070f7725e6b3 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:58.098414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 681/1358] 10.222.0.64 () {54 vars in 962 bytes} [Thu Sep 1 13:58:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:58:58.105877 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368de3e6-104e-4d6c-a5f4-3319eef7a9db None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:58.114592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368de3e6-104e-4d6c-a5f4-3319eef7a9db None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:58.114592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368de3e6-104e-4d6c-a5f4-3319eef7a9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:58.150710 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:58.226408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-368de3e6-104e-4d6c-a5f4-3319eef7a9db None None] MFA Rules not processed for user `4b3c8a90b97246a98612b627b5f8da80`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:58:58.227776 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-368de3e6-104e-4d6c-a5f4-3319eef7a9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:58.354557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 678/1359] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Sep 1 13:58:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:58:58.363214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa5ff4-8f3e-493c-b5d2-070f7725e6b3 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:58:58.365467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2efa5ff4-8f3e-493c-b5d2-070f7725e6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:58.524258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa5ff4-8f3e-493c-b5d2-070f7725e6b3 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:58:58.606426 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:58.652631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481b950-dfc0-4a4f-a9cf-a14333aeaf6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:58:58.653430 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b950-dfc0-4a4f-a9cf-a14333aeaf6e service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:58:58.653817 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b950-dfc0-4a4f-a9cf-a14333aeaf6e service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:58:58.654191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b950-dfc0-4a4f-a9cf-a14333aeaf6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:58:58.656230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c481b950-dfc0-4a4f-a9cf-a14333aeaf6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:58:58.752787 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481b950-dfc0-4a4f-a9cf-a14333aeaf6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:58:58.755111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481b950-dfc0-4a4f-a9cf-a14333aeaf6e service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:58:58.775797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 682/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:00.949588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79f96d-a77f-4161-9331-59d19ee8847a None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:00.950146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79f96d-a77f-4161-9331-59d19ee8847a None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:00.950146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79f96d-a77f-4161-9331-59d19ee8847a None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:00.951697 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 679/1361] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:59:00.957134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694542a1-bcc0-4bf3-8df8-edef7d3cbf89 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:00.958200 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694542a1-bcc0-4bf3-8df8-edef7d3cbf89 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:00.958312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694542a1-bcc0-4bf3-8df8-edef7d3cbf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:01.028616 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-694542a1-bcc0-4bf3-8df8-edef7d3cbf89 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:01.029893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-694542a1-bcc0-4bf3-8df8-edef7d3cbf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:01.072281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:01.138105 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 683/1362] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:01.447295 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79f96d-a77f-4161-9331-59d19ee8847a None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:01.456436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2f79f96d-a77f-4161-9331-59d19ee8847a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:01.546864 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:01.637850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79f96d-a77f-4161-9331-59d19ee8847a None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:01.759440 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a8072-ac9c-490e-a46b-05e5407ba923 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:01.760089 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a8072-ac9c-490e-a46b-05e5407ba923 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:01.760373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a8072-ac9c-490e-a46b-05e5407ba923 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:01.760646 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a8072-ac9c-490e-a46b-05e5407ba923 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:01.762345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-3e8a8072-ac9c-490e-a46b-05e5407ba923 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:01.787051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:01.868913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a8072-ac9c-490e-a46b-05e5407ba923 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:01.870600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a8072-ac9c-490e-a46b-05e5407ba923 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:01.890721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 680/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:04.284893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489b490-82bf-4c0a-a004-5038c02552a7 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:04.285468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489b490-82bf-4c0a-a004-5038c02552a7 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:04.285742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489b490-82bf-4c0a-a004-5038c02552a7 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:04.287389 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 684/1364] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:04.292816 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1b8b7-2a06-400c-b60d-7e341eab54dd None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:04.293359 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1b8b7-2a06-400c-b60d-7e341eab54dd None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:04.293445 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1b8b7-2a06-400c-b60d-7e341eab54dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:04.361968 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-81b1b8b7-2a06-400c-b60d-7e341eab54dd None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:04.363187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-81b1b8b7-2a06-400c-b60d-7e341eab54dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:04.462606 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:04.465716 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 681/1365] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:04.761254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2fb60-06f0-4262-84eb-e7c9109fe865 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:04.761542 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2fb60-06f0-4262-84eb-e7c9109fe865 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:04.762027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2fb60-06f0-4262-84eb-e7c9109fe865 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:04.763631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 685/1366] 10.222.0.64 () {54 vars in 962 bytes} [Thu Sep 1 13:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:04.769068 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba4b58-439b-4978-bd0b-6754cccd112f None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:04.769548 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba4b58-439b-4978-bd0b-6754cccd112f None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:04.770724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba4b58-439b-4978-bd0b-6754cccd112f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:04.854362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-7dba4b58-439b-4978-bd0b-6754cccd112f None None] MFA Rules not processed for user `4b3c8a90b97246a98612b627b5f8da80`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:04.856056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7dba4b58-439b-4978-bd0b-6754cccd112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:04.983765 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 682/1367] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Sep 1 13:59:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:59:04.992360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2fb60-06f0-4262-84eb-e7c9109fe865 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:04.994427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-21f2fb60-06f0-4262-84eb-e7c9109fe865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:05.162474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2fb60-06f0-4262-84eb-e7c9109fe865 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:05.188632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:05.296032 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc81ed-9336-40a3-994f-9a3e274af780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:05.296711 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc81ed-9336-40a3-994f-9a3e274af780 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:05.297141 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc81ed-9336-40a3-994f-9a3e274af780 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:05.297425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc81ed-9336-40a3-994f-9a3e274af780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:05.299208 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-76fc81ed-9336-40a3-994f-9a3e274af780 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:05.397178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc81ed-9336-40a3-994f-9a3e274af780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:05.398798 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc81ed-9336-40a3-994f-9a3e274af780 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:05.418425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 686/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:06.093426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acc015-fb24-4633-9ec3-7078c170f357 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:06.093974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acc015-fb24-4633-9ec3-7078c170f357 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:06.093974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acc015-fb24-4633-9ec3-7078c170f357 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:06.095466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 683/1369] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:06.100605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336668-2cbc-4205-92f4-e559c012c2a1 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:06.100892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336668-2cbc-4205-92f4-e559c012c2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:06.101168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336668-2cbc-4205-92f4-e559c012c2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:06.139253 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:06.189821 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-5f336668-2cbc-4205-92f4-e559c012c2a1 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:06.191355 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-5f336668-2cbc-4205-92f4-e559c012c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:06.316172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 687/1370] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:06.969716 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0c275-7656-49e2-8e88-7c274ef58f08 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:06.970002 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0c275-7656-49e2-8e88-7c274ef58f08 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:06.970275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0c275-7656-49e2-8e88-7c274ef58f08 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:06.971760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 684/1371] 10.222.0.64 () {54 vars in 964 bytes} [Thu Sep 1 13:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:06.976647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd3cf3-6de1-41f6-8617-bd4d32c45a77 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:06.976938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd3cf3-6de1-41f6-8617-bd4d32c45a77 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:06.977268 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd3cf3-6de1-41f6-8617-bd4d32c45a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:07.059533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-87cd3cf3-6de1-41f6-8617-bd4d32c45a77 None None] MFA Rules not processed for user `92870867b169496fa8913b2ab93eac37`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:07.066851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-87cd3cf3-6de1-41f6-8617-bd4d32c45a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:07.109283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:07.154299 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 688/1372] 10.222.0.64 () {58 vars in 1061 bytes} [Thu Sep 1 13:59:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:07.164704 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0c275-7656-49e2-8e88-7c274ef58f08 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:07.166169 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7de0c275-7656-49e2-8e88-7c274ef58f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:07.232739 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:07.308487 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0c275-7656-49e2-8e88-7c274ef58f08 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:07.397843 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c62acf-7cd7-468f-ae95-d73e3fcb5cfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:07.398447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c62acf-7cd7-468f-ae95-d73e3fcb5cfe service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:07.398778 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c62acf-7cd7-468f-ae95-d73e3fcb5cfe service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:07.399309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c62acf-7cd7-468f-ae95-d73e3fcb5cfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:07.401294 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-42c62acf-7cd7-468f-ae95-d73e3fcb5cfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:07.525218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:07.539303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c62acf-7cd7-468f-ae95-d73e3fcb5cfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:07.540779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c62acf-7cd7-468f-ae95-d73e3fcb5cfe service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:07.559417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 685/1373] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:07.624122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fa13e-f78a-4435-bc04-b8b1b72e104c None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:07.624693 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fa13e-f78a-4435-bc04-b8b1b72e104c None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:07.624793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fa13e-f78a-4435-bc04-b8b1b72e104c None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:07.626176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 689/1374] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:07.632154 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82858b82-9ab6-4d86-a18c-c281b3d7651f None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:07.632474 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82858b82-9ab6-4d86-a18c-c281b3d7651f None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:07.632748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82858b82-9ab6-4d86-a18c-c281b3d7651f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:07.699278 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-82858b82-9ab6-4d86-a18c-c281b3d7651f None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:07.700521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-82858b82-9ab6-4d86-a18c-c281b3d7651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:07.798950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 686/1375] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:08.088326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fa13e-f78a-4435-bc04-b8b1b72e104c None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:08.090009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f56fa13e-f78a-4435-bc04-b8b1b72e104c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:08.253098 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fa13e-f78a-4435-bc04-b8b1b72e104c None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:08.306447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:08.368366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2d5fb-5526-47ea-ad0a-06655ffc3ba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:08.368895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2d5fb-5526-47ea-ad0a-06655ffc3ba8 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:08.369201 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2d5fb-5526-47ea-ad0a-06655ffc3ba8 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:08.369473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2d5fb-5526-47ea-ad0a-06655ffc3ba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:08.371083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-47c2d5fb-5526-47ea-ad0a-06655ffc3ba8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:08.464205 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2d5fb-5526-47ea-ad0a-06655ffc3ba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:08.465798 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2d5fb-5526-47ea-ad0a-06655ffc3ba8 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:08.484645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 690/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:10.661423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8d41-a2bf-49ec-ab37-7d8986ff659b None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:10.662008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8d41-a2bf-49ec-ab37-7d8986ff659b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:10.662008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8d41-a2bf-49ec-ab37-7d8986ff659b None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:10.663543 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 687/1377] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:10.671368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc2242-e4cb-488d-8cc3-38677c212c4a None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:10.671929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc2242-e4cb-488d-8cc3-38677c212c4a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:10.672189 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc2242-e4cb-488d-8cc3-38677c212c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:10.744426 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-2cfc2242-e4cb-488d-8cc3-38677c212c4a None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:10.746793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2cfc2242-e4cb-488d-8cc3-38677c212c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:10.754968 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:10.861830 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 691/1378] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:11.192452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e8d41-a2bf-49ec-ab37-7d8986ff659b None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:11.193955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7a7e8d41-a2bf-49ec-ab37-7d8986ff659b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:11.257826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:11.386214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e8d41-a2bf-49ec-ab37-7d8986ff659b None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:11.529415 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ffe7a-20fb-415e-b6e6-54ab241cc52a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:11.529974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ffe7a-20fb-415e-b6e6-54ab241cc52a service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:11.530251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ffe7a-20fb-415e-b6e6-54ab241cc52a service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:11.530519 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ffe7a-20fb-415e-b6e6-54ab241cc52a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:11.532246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-9b5ffe7a-20fb-415e-b6e6-54ab241cc52a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:11.553992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:11.639324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ffe7a-20fb-415e-b6e6-54ab241cc52a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:11.640939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ffe7a-20fb-415e-b6e6-54ab241cc52a service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:11.660621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 688/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:13.754433 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a407c8-02d5-41fb-a3e0-1d0463853075 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:13.754892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a407c8-02d5-41fb-a3e0-1d0463853075 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:13.754980 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a407c8-02d5-41fb-a3e0-1d0463853075 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:13.760299 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 692/1380] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:59:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:13.762391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9d907-0c1f-4343-9d10-bedb32fd2b2f None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:13.762821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9d907-0c1f-4343-9d10-bedb32fd2b2f None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:13.763032 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9d907-0c1f-4343-9d10-bedb32fd2b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:13.834859 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-0ec9d907-0c1f-4343-9d10-bedb32fd2b2f None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:13.836361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-0ec9d907-0c1f-4343-9d10-bedb32fd2b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:13.934955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:13.941179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 689/1381] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:14.232346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a407c8-02d5-41fb-a3e0-1d0463853075 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:14.233907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-78a407c8-02d5-41fb-a3e0-1d0463853075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:14.390393 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:14.403581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a407c8-02d5-41fb-a3e0-1d0463853075 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:14.532301 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef07e6-1caa-464d-bf92-4fc8d7f00ead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:14.532844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef07e6-1caa-464d-bf92-4fc8d7f00ead service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:14.533121 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef07e6-1caa-464d-bf92-4fc8d7f00ead service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:14.533392 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef07e6-1caa-464d-bf92-4fc8d7f00ead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:14.535523 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c2ef07e6-1caa-464d-bf92-4fc8d7f00ead service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:14.638795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef07e6-1caa-464d-bf92-4fc8d7f00ead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:14.704116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef07e6-1caa-464d-bf92-4fc8d7f00ead service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:14.704116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:14.704116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 693/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:17.322557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad319849-d043-417b-9443-27710df5c649 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:17.323091 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad319849-d043-417b-9443-27710df5c649 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:17.323318 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad319849-d043-417b-9443-27710df5c649 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:17.325174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 690/1383] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:17.331498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a06bf-4ee4-48c3-957f-779eaf412974 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:17.332010 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a06bf-4ee4-48c3-957f-779eaf412974 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:17.332123 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a06bf-4ee4-48c3-957f-779eaf412974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:17.401020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-c28a06bf-4ee4-48c3-957f-779eaf412974 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:17.402195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c28a06bf-4ee4-48c3-957f-779eaf412974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:17.515316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 694/1384] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:17.801588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad319849-d043-417b-9443-27710df5c649 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:17.803249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ad319849-d043-417b-9443-27710df5c649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:17.958491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad319849-d043-417b-9443-27710df5c649 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:18.043781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:18.105489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf7c04-737b-44ce-9d6f-9fbf83775a1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:18.106534 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf7c04-737b-44ce-9d6f-9fbf83775a1d service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:18.106891 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf7c04-737b-44ce-9d6f-9fbf83775a1d service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:18.107239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf7c04-737b-44ce-9d6f-9fbf83775a1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:18.109580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6ccf7c04-737b-44ce-9d6f-9fbf83775a1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:18.219845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf7c04-737b-44ce-9d6f-9fbf83775a1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:18.221464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf7c04-737b-44ce-9d6f-9fbf83775a1d service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:18.240717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 691/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:20.169777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12245b9e-2041-4d5a-9d78-73ab0f92e461 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:20.170367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12245b9e-2041-4d5a-9d78-73ab0f92e461 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:20.170585 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12245b9e-2041-4d5a-9d78-73ab0f92e461 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:20.171820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 695/1386] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:20.177838 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e15bf-4aad-4407-96a9-a1238736ed48 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:20.180342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e15bf-4aad-4407-96a9-a1238736ed48 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:20.180342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e15bf-4aad-4407-96a9-a1238736ed48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:20.247876 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-1b6e15bf-4aad-4407-96a9-a1238736ed48 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:20.249161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1b6e15bf-4aad-4407-96a9-a1238736ed48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:20.286725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:20.353256 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 692/1387] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:20.649106 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12245b9e-2041-4d5a-9d78-73ab0f92e461 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:20.650692 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-12245b9e-2041-4d5a-9d78-73ab0f92e461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:20.743225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:20.825531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12245b9e-2041-4d5a-9d78-73ab0f92e461 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:20.963643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26b694-4f32-44cc-acec-60666cddde5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:20.964925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26b694-4f32-44cc-acec-60666cddde5f service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:20.965402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26b694-4f32-44cc-acec-60666cddde5f service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:20.965988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26b694-4f32-44cc-acec-60666cddde5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:20.969125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ac26b694-4f32-44cc-acec-60666cddde5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:21.027585 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:21.095795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26b694-4f32-44cc-acec-60666cddde5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:21.098399 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26b694-4f32-44cc-acec-60666cddde5f service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:21.123165 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 696/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:23.250150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6ea96-5075-49ef-88a4-fdb312f5812b None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:23.250771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6ea96-5075-49ef-88a4-fdb312f5812b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:23.250771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6ea96-5075-49ef-88a4-fdb312f5812b None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:23.252201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 693/1389] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:23.257900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272527f-fb78-428c-b557-a9356ce599c7 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:23.258428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272527f-fb78-428c-b557-a9356ce599c7 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:23.258518 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272527f-fb78-428c-b557-a9356ce599c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:23.313494 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b965bd3-b509-4740-bc80-d4a1e109aa85 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:23.313785 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b965bd3-b509-4740-bc80-d4a1e109aa85 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:23.314031 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b965bd3-b509-4740-bc80-d4a1e109aa85 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:23.315418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 694/1390] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:59:23.320516 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118570df-4947-402a-8679-44b5124fa575 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:23.320803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118570df-4947-402a-8679-44b5124fa575 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:23.321080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118570df-4947-402a-8679-44b5124fa575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:23.328431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1272527f-fb78-428c-b557-a9356ce599c7 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:23.329757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1272527f-fb78-428c-b557-a9356ce599c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:23.390305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-118570df-4947-402a-8679-44b5124fa575 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:23.391590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-118570df-4947-402a-8679-44b5124fa575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:23.434460 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 697/1391] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:23.493754 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 695/1392] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:59:23.725985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272527f-fb78-428c-b557-a9356ce599c7 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:23.727286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1272527f-fb78-428c-b557-a9356ce599c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:23.742311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:23.797919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998f050-141e-4c8b-b136-43f07001c56d None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:23.798202 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998f050-141e-4c8b-b136-43f07001c56d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:23.798474 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998f050-141e-4c8b-b136-43f07001c56d None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:23.800361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 696/1393] 10.222.0.64 () {54 vars in 967 bytes} [Thu Sep 1 13:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:23.805672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467188e-7907-48a2-9609-18f767f0779e None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:23.805953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467188e-7907-48a2-9609-18f767f0779e None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:23.806227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467188e-7907-48a2-9609-18f767f0779e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:23.822507 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:23.849230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272527f-fb78-428c-b557-a9356ce599c7 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:23.888700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b467188e-7907-48a2-9609-18f767f0779e None None] MFA Rules not processed for user `0f750815038d404d9d39a68bf62db8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:23.889955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b467188e-7907-48a2-9609-18f767f0779e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:23.967929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 697/1394] 10.222.0.64 () {58 vars in 1064 bytes} [Thu Sep 1 13:59:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:59:23.970444 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4be5d-b563-4045-a58b-70ff824fe3e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:23.971064 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4be5d-b563-4045-a58b-70ff824fe3e5 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:23.971394 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4be5d-b563-4045-a58b-70ff824fe3e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:23.972233 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4be5d-b563-4045-a58b-70ff824fe3e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:23.974002 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b1c4be5d-b563-4045-a58b-70ff824fe3e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:23.975831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467188e-7907-48a2-9609-18f767f0779e None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:23.983692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467188e-7907-48a2-9609-18f767f0779e None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:23.983920 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:24.064553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bee9cd-7644-43bf-8285-33d1bcb4d90f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f750815038d404d9d39a68bf62db8c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:24.065168 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bee9cd-7644-43bf-8285-33d1bcb4d90f service glance] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:24.065951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bee9cd-7644-43bf-8285-33d1bcb4d90f service glance] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:24.066224 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bee9cd-7644-43bf-8285-33d1bcb4d90f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:24.067919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c3bee9cd-7644-43bf-8285-33d1bcb4d90f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:24.072624 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4be5d-b563-4045-a58b-70ff824fe3e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:24.074251 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4be5d-b563-4045-a58b-70ff824fe3e5 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:24.094311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 698/1395] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:24.101202 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:24.184970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bee9cd-7644-43bf-8285-33d1bcb4d90f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:24.186421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bee9cd-7644-43bf-8285-33d1bcb4d90f service glance] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:24.206152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 698/1396] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 13:59:25.147522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be78b6-bff8-4150-9ee6-bc80c43a6c68 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:25.148061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be78b6-bff8-4150-9ee6-bc80c43a6c68 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:25.148148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be78b6-bff8-4150-9ee6-bc80c43a6c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:25.223018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-13be78b6-bff8-4150-9ee6-bc80c43a6c68 None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:25.224305 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-13be78b6-bff8-4150-9ee6-bc80c43a6c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:25.318661 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:25.322892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 699/1397] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 13:59:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:25.367175 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa919893-2fcb-4162-8595-b19f4b79cee0 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:25.367935 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa919893-2fcb-4162-8595-b19f4b79cee0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:25.367935 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa919893-2fcb-4162-8595-b19f4b79cee0 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:25.369216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 699/1398] 10.222.0.64 () {54 vars in 943 bytes} [Thu Sep 1 13:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:25.375669 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d132a64-3a75-440d-ad59-753795e774d1 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:25.375995 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d132a64-3a75-440d-ad59-753795e774d1 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:25.376273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d132a64-3a75-440d-ad59-753795e774d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:25.456167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1d132a64-3a75-440d-ad59-753795e774d1 None None] MFA Rules not processed for user `cdebe1b674cc4b2bb6bf962de01a24ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:25.457379 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1d132a64-3a75-440d-ad59-753795e774d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:25.566979 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 700/1399] 10.222.0.64 () {58 vars in 1040 bytes} [Thu Sep 1 13:59:25 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:25.577193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa919893-2fcb-4162-8595-b19f4b79cee0 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:25.578744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-aa919893-2fcb-4162-8595-b19f4b79cee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:25.722419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:25.725031 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa919893-2fcb-4162-8595-b19f4b79cee0 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:25.831037 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281d720-646e-4407-9e07-5100e510355b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:25.831560 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281d720-646e-4407-9e07-5100e510355b service swift] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:25.831842 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281d720-646e-4407-9e07-5100e510355b service swift] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:25.832145 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281d720-646e-4407-9e07-5100e510355b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:25.833770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2281d720-646e-4407-9e07-5100e510355b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:25.919136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281d720-646e-4407-9e07-5100e510355b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:25.920757 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281d720-646e-4407-9e07-5100e510355b service swift] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:25.929487 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 700/1400] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 13:59:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 13:59:26.264229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70137683-1657-4d04-89b8-198273f3034b None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:26.264761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70137683-1657-4d04-89b8-198273f3034b None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:26.264761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70137683-1657-4d04-89b8-198273f3034b None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:26.266134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 701/1401] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:26.272072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b116e8-e65b-4aca-8a76-328fbffda9c5 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:26.272361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b116e8-e65b-4aca-8a76-328fbffda9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:26.272638 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b116e8-e65b-4aca-8a76-328fbffda9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:26.309085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:26.339449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-00b116e8-e65b-4aca-8a76-328fbffda9c5 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:26.340698 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-00b116e8-e65b-4aca-8a76-328fbffda9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:26.455901 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 701/1402] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:26.745897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70137683-1657-4d04-89b8-198273f3034b None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:26.747488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-70137683-1657-4d04-89b8-198273f3034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:26.816911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:26.923288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70137683-1657-4d04-89b8-198273f3034b None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:27.072844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e2ba7-2da6-45ff-9e6d-84a89c470a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:27.073463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e2ba7-2da6-45ff-9e6d-84a89c470a27 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:27.073774 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e2ba7-2da6-45ff-9e6d-84a89c470a27 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:27.074054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e2ba7-2da6-45ff-9e6d-84a89c470a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:27.075686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-629e2ba7-2da6-45ff-9e6d-84a89c470a27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:27.097430 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:27.189220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e2ba7-2da6-45ff-9e6d-84a89c470a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:27.190908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e2ba7-2da6-45ff-9e6d-84a89c470a27 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:27.213597 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 702/1403] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:29.491659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bbefb-ff4a-4c8e-9095-40cda1f3215c None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:29.492256 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bbefb-ff4a-4c8e-9095-40cda1f3215c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:29.492256 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bbefb-ff4a-4c8e-9095-40cda1f3215c None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:29.493762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 702/1404] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:29.501592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbe4bc-5621-4fcf-94cc-d60cea62f9cd None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:29.502112 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbe4bc-5621-4fcf-94cc-d60cea62f9cd None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:29.502456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbe4bc-5621-4fcf-94cc-d60cea62f9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:29.601399 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-15dbe4bc-5621-4fcf-94cc-d60cea62f9cd None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:29.602683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-15dbe4bc-5621-4fcf-94cc-d60cea62f9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:29.708090 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:29.716268 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 703/1405] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:30.018515 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bbefb-ff4a-4c8e-9095-40cda1f3215c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:30.020216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-3b7bbefb-ff4a-4c8e-9095-40cda1f3215c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:30.152712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:30.211045 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bbefb-ff4a-4c8e-9095-40cda1f3215c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:30.340334 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2349724-21d9-4d68-8286-442a4e2cde3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:30.341155 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2349724-21d9-4d68-8286-442a4e2cde3d service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:30.341539 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2349724-21d9-4d68-8286-442a4e2cde3d service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:30.341938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2349724-21d9-4d68-8286-442a4e2cde3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:30.343743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b2349724-21d9-4d68-8286-442a4e2cde3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:30.468462 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2349724-21d9-4d68-8286-442a4e2cde3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:30.470155 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2349724-21d9-4d68-8286-442a4e2cde3d service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:30.500857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 703/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:30.585723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:33.613759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24db47b-d1af-4354-afc4-68562cf3a38e None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:33.614350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24db47b-d1af-4354-afc4-68562cf3a38e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:33.614350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24db47b-d1af-4354-afc4-68562cf3a38e None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:33.615662 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 704/1407] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 13:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:33.620973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33adcf-9688-4505-875c-064ccab1b9cc None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:33.621887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33adcf-9688-4505-875c-064ccab1b9cc None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:33.622169 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33adcf-9688-4505-875c-064ccab1b9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:33.696193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-1e33adcf-9688-4505-875c-064ccab1b9cc None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:33.697918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1e33adcf-9688-4505-875c-064ccab1b9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:33.808528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 704/1408] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 13:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 13:59:34.119716 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24db47b-d1af-4354-afc4-68562cf3a38e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:34.121327 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c24db47b-d1af-4354-afc4-68562cf3a38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:34.318808 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24db47b-d1af-4354-afc4-68562cf3a38e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:34.406974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:34.463381 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c197a0-3615-486f-89fe-3b48071ce0b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:34.464050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c197a0-3615-486f-89fe-3b48071ce0b4 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:34.464333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c197a0-3615-486f-89fe-3b48071ce0b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:34.464605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c197a0-3615-486f-89fe-3b48071ce0b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:34.466225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-21c197a0-3615-486f-89fe-3b48071ce0b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:34.565744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c197a0-3615-486f-89fe-3b48071ce0b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:34.567510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c197a0-3615-486f-89fe-3b48071ce0b4 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:34.589388 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 705/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:43.806632 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=79 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:44.586226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=64 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:50.366887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16453a8f-6255-4b12-978d-3a62f0115bfc None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:50.367463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16453a8f-6255-4b12-978d-3a62f0115bfc None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:50.367463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16453a8f-6255-4b12-978d-3a62f0115bfc None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:50.368951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 705/1410] 10.222.0.64 () {54 vars in 918 bytes} [Thu Sep 1 13:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:50.374144 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f51d98-5821-4751-ba53-c310082d3d53 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:50.374580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f51d98-5821-4751-ba53-c310082d3d53 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:50.374701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f51d98-5821-4751-ba53-c310082d3d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:50.453335 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-59f51d98-5821-4751-ba53-c310082d3d53 None None] MFA Rules not processed for user `cec4f437077c41039cae3d505b43b558`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:50.454463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-59f51d98-5821-4751-ba53-c310082d3d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:50.559704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 706/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Sep 1 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:50.574799 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1255535-a9f2-4180-a668-58c2fac209a0 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:50.575163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1255535-a9f2-4180-a668-58c2fac209a0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:50.575437 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1255535-a9f2-4180-a668-58c2fac209a0 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:50.576826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 706/1412] 10.222.0.64 () {54 vars in 918 bytes} [Thu Sep 1 13:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:50.581438 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1870a-6cfa-4e79-a9dd-695c11a2c48b None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:50.581726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1870a-6cfa-4e79-a9dd-695c11a2c48b None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:50.582004 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1870a-6cfa-4e79-a9dd-695c11a2c48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:50.654404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:50.657430 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-29d1870a-6cfa-4e79-a9dd-695c11a2c48b None None] MFA Rules not processed for user `4b3c8a90b97246a98612b627b5f8da80`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:50.658650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-29d1870a-6cfa-4e79-a9dd-695c11a2c48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:50.779730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 707/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Sep 1 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:53.233461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22714ec2-b0f9-4ad9-b30c-5e7656714592 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:53.234015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22714ec2-b0f9-4ad9-b30c-5e7656714592 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:53.234015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22714ec2-b0f9-4ad9-b30c-5e7656714592 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:53.235427 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 13:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:53.241280 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03da7ff-27c4-44b6-b97d-3f979af0dbdd None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:53.241718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03da7ff-27c4-44b6-b97d-3f979af0dbdd None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:53.241828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03da7ff-27c4-44b6-b97d-3f979af0dbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:53.308148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-e03da7ff-27c4-44b6-b97d-3f979af0dbdd None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:53.309344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e03da7ff-27c4-44b6-b97d-3f979af0dbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:53.367801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:53.409765 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 13:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:53.709132 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22714ec2-b0f9-4ad9-b30c-5e7656714592 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:53.710679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-22714ec2-b0f9-4ad9-b30c-5e7656714592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:53.862417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22714ec2-b0f9-4ad9-b30c-5e7656714592 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:53.934070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:53.974643 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1d1de-c621-4e7a-9ddc-dcbd5a48c2c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:53.975260 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1d1de-c621-4e7a-9ddc-dcbd5a48c2c9 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:53.975546 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1d1de-c621-4e7a-9ddc-dcbd5a48c2c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:53.975822 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1d1de-c621-4e7a-9ddc-dcbd5a48c2c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:53.977472 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f0d1d1de-c621-4e7a-9ddc-dcbd5a48c2c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:54.072971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1d1de-c621-4e7a-9ddc-dcbd5a48c2c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:54.074551 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1d1de-c621-4e7a-9ddc-dcbd5a48c2c9 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:54.092579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 708/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:54.992458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c374c-dfce-46c1-94c7-bc32230380fc None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:54.993050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c374c-dfce-46c1-94c7-bc32230380fc None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:54.993050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c374c-dfce-46c1-94c7-bc32230380fc None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:54.994338 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:54.999249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953b52-e0eb-4a39-8f08-c2456cacd133 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:54.999664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953b52-e0eb-4a39-8f08-c2456cacd133 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:54.999804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1953b52-e0eb-4a39-8f08-c2456cacd133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:55.076249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e1953b52-e0eb-4a39-8f08-c2456cacd133 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:55.077491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e1953b52-e0eb-4a39-8f08-c2456cacd133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:55.104054 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:55.174864 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:55.326392 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c374c-dfce-46c1-94c7-bc32230380fc None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:55.327998 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-665c374c-dfce-46c1-94c7-bc32230380fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:55.475024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c374c-dfce-46c1-94c7-bc32230380fc None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:55.516272 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:55.590060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a67820-06fd-4961-a590-84245e29fc56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:55.590674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a67820-06fd-4961-a590-84245e29fc56 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:55.590964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a67820-06fd-4961-a590-84245e29fc56 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:55.591235 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a67820-06fd-4961-a590-84245e29fc56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:55.592867 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c9a67820-06fd-4961-a590-84245e29fc56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:55.682202 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a67820-06fd-4961-a590-84245e29fc56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:55.683826 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a67820-06fd-4961-a590-84245e29fc56 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:55.701703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 710/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:56.601875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2005c-5960-455c-b874-8443e733afc1 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:56.602431 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2005c-5960-455c-b874-8443e733afc1 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:56.602431 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2005c-5960-455c-b874-8443e733afc1 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:56.604124 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:56.608988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0c12a-22ac-4550-9aa1-d415445644ac None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:56.609378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0c12a-22ac-4550-9aa1-d415445644ac None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:56.609549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0c12a-22ac-4550-9aa1-d415445644ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:56.664582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:56.685941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-8ac0c12a-22ac-4550-9aa1-d415445644ac None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:56.687155 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-8ac0c12a-22ac-4550-9aa1-d415445644ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:56.785591 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:56.944686 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2005c-5960-455c-b874-8443e733afc1 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:56.946306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c5d2005c-5960-455c-b874-8443e733afc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:57.091672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2005c-5960-455c-b874-8443e733afc1 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:57.104579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:57.216607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23be34e-8da8-43f9-aea7-089719d634e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:57.217463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23be34e-8da8-43f9-aea7-089719d634e6 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:57.217892 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23be34e-8da8-43f9-aea7-089719d634e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:57.218306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23be34e-8da8-43f9-aea7-089719d634e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:57.220876 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a23be34e-8da8-43f9-aea7-089719d634e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:57.324027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23be34e-8da8-43f9-aea7-089719d634e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:57.325631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23be34e-8da8-43f9-aea7-089719d634e6 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:57.343342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 711/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:58.229945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd78375-fb95-406e-9396-34dc6dd921f3 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:58.230509 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd78375-fb95-406e-9396-34dc6dd921f3 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:58.230509 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd78375-fb95-406e-9396-34dc6dd921f3 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:58.231842 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 13:59:58.237298 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824e70e-4d3b-4d1c-aae5-e7a6dc8b3d3b None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:58.237714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824e70e-4d3b-4d1c-aae5-e7a6dc8b3d3b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:58.240107 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824e70e-4d3b-4d1c-aae5-e7a6dc8b3d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:58.258247 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:58.316496 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b824e70e-4d3b-4d1c-aae5-e7a6dc8b3d3b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:58.317701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b824e70e-4d3b-4d1c-aae5-e7a6dc8b3d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:58.415962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 13:59:58.568025 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd78375-fb95-406e-9396-34dc6dd921f3 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 13:59:58.569790 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1fd78375-fb95-406e-9396-34dc6dd921f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:58.684289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:58.721332 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd78375-fb95-406e-9396-34dc6dd921f3 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 13:59:58.831584 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8214d2-09b4-4675-802a-257415269fd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 13:59:58.832207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8214d2-09b4-4675-802a-257415269fd6 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:58.832481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8214d2-09b4-4675-802a-257415269fd6 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:58.832747 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8214d2-09b4-4675-802a-257415269fd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:58.834325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ef8214d2-09b4-4675-802a-257415269fd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 13:59:58.934642 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:59:58.948705 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8214d2-09b4-4675-802a-257415269fd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 13:59:58.950334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8214d2-09b4-4675-802a-257415269fd6 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 13:59:58.969707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 713/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 13:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 13:59:59.832311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ee258-00f3-40a9-aa89-a906af93cea7 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:59.832903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ee258-00f3-40a9-aa89-a906af93cea7 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:59.832903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ee258-00f3-40a9-aa89-a906af93cea7 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:59.834235 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 13:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 13:59:59.839323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f1336-2d4c-4b86-a976-a8cc7cb41423 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 13:59:59.839738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f1336-2d4c-4b86-a976-a8cc7cb41423 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 13:59:59.839899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f1336-2d4c-4b86-a976-a8cc7cb41423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 13:59:59.915399 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-6f5f1336-2d4c-4b86-a976-a8cc7cb41423 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 13:59:59.916655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6f5f1336-2d4c-4b86-a976-a8cc7cb41423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:00.013923 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 13:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:00.163404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ee258-00f3-40a9-aa89-a906af93cea7 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:00.164914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-722ee258-00f3-40a9-aa89-a906af93cea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:00.254850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:00.320492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ee258-00f3-40a9-aa89-a906af93cea7 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:00.433541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851236c-707c-4107-a5da-fd2965f05fd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:00.434065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851236c-707c-4107-a5da-fd2965f05fd4 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:00.434345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851236c-707c-4107-a5da-fd2965f05fd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:00.434617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851236c-707c-4107-a5da-fd2965f05fd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:00.436240 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7851236c-707c-4107-a5da-fd2965f05fd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:00.485230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:00.529094 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851236c-707c-4107-a5da-fd2965f05fd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:00.530696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851236c-707c-4107-a5da-fd2965f05fd4 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:00.549295 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 714/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:01.458673 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86c419-ab05-4ebf-87a7-6bd6c9d9ca38 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:01.459196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86c419-ab05-4ebf-87a7-6bd6c9d9ca38 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:01.459196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86c419-ab05-4ebf-87a7-6bd6c9d9ca38 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:01.460542 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 14:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:00:01.465627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5019d46-bf99-43e5-8ed9-3b061e3d9036 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:01.466028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5019d46-bf99-43e5-8ed9-3b061e3d9036 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:01.466185 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5019d46-bf99-43e5-8ed9-3b061e3d9036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:01.543968 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b5019d46-bf99-43e5-8ed9-3b061e3d9036 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:01.545189 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b5019d46-bf99-43e5-8ed9-3b061e3d9036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:01.642384 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 14:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:01.793533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86c419-ab05-4ebf-87a7-6bd6c9d9ca38 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:01.795063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6c86c419-ab05-4ebf-87a7-6bd6c9d9ca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:01.843879 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:01.940441 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86c419-ab05-4ebf-87a7-6bd6c9d9ca38 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:02.052157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cede9f-2b6d-429e-ba6c-93b3b0897422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:02.052679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cede9f-2b6d-429e-ba6c-93b3b0897422 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:02.052961 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cede9f-2b6d-429e-ba6c-93b3b0897422 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:02.053236 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cede9f-2b6d-429e-ba6c-93b3b0897422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:02.054852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-65cede9f-2b6d-429e-ba6c-93b3b0897422 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:02.061777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:02.145258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cede9f-2b6d-429e-ba6c-93b3b0897422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:02.146853 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cede9f-2b6d-429e-ba6c-93b3b0897422 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:02.165632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 716/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:03.049819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c979383-c830-4409-89cb-aed4daf9361a None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:03.050436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c979383-c830-4409-89cb-aed4daf9361a None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:03.050436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c979383-c830-4409-89cb-aed4daf9361a None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:03.051727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 14:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 14:00:03.056732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be368d62-7ef3-4b32-aa04-613be9692c55 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:03.057167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be368d62-7ef3-4b32-aa04-613be9692c55 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:03.057278 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be368d62-7ef3-4b32-aa04-613be9692c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:03.134816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-be368d62-7ef3-4b32-aa04-613be9692c55 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:03.135973 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-be368d62-7ef3-4b32-aa04-613be9692c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:03.204346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:03.233400 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 14:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:03.385536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c979383-c830-4409-89cb-aed4daf9361a None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:03.386989 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4c979383-c830-4409-89cb-aed4daf9361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:03.404639 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:03.534367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c979383-c830-4409-89cb-aed4daf9361a None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:03.624778 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:03.651499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe06cb-ee55-45d6-b82f-e9f7b61a8241 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:03.652084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe06cb-ee55-45d6-b82f-e9f7b61a8241 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:03.652358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe06cb-ee55-45d6-b82f-e9f7b61a8241 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:03.652626 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe06cb-ee55-45d6-b82f-e9f7b61a8241 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:03.654205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-febe06cb-ee55-45d6-b82f-e9f7b61a8241 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:03.744841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe06cb-ee55-45d6-b82f-e9f7b61a8241 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:03.746424 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe06cb-ee55-45d6-b82f-e9f7b61a8241 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:03.764392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 717/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:04.646582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e84c3-c298-4489-95a5-78e6df5ea0cc None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:04.647162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e84c3-c298-4489-95a5-78e6df5ea0cc None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:04.647162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e84c3-c298-4489-95a5-78e6df5ea0cc None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:04.648623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 14:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:00:04.653544 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dc514-04c5-49ed-b68b-28294219e59b None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:04.653979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dc514-04c5-49ed-b68b-28294219e59b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:04.654126 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dc514-04c5-49ed-b68b-28294219e59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:04.729703 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-116dc514-04c5-49ed-b68b-28294219e59b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:04.730897 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-116dc514-04c5-49ed-b68b-28294219e59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:04.773286 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:04.828205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 14:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:04.987578 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e84c3-c298-4489-95a5-78e6df5ea0cc None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:04.989070 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-8f6e84c3-c298-4489-95a5-78e6df5ea0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:05.134680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e84c3-c298-4489-95a5-78e6df5ea0cc None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:05.189984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:05.250508 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17235d24-25ea-45c7-993d-3cc13d6c2790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:05.251061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17235d24-25ea-45c7-993d-3cc13d6c2790 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:05.251326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17235d24-25ea-45c7-993d-3cc13d6c2790 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:05.251732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17235d24-25ea-45c7-993d-3cc13d6c2790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:05.253373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-17235d24-25ea-45c7-993d-3cc13d6c2790 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:05.341041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17235d24-25ea-45c7-993d-3cc13d6c2790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:05.342624 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17235d24-25ea-45c7-993d-3cc13d6c2790 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:05.361529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 719/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:06.233516 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c942f-9e92-4346-a5ef-319502691e68 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:06.234075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c942f-9e92-4346-a5ef-319502691e68 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:06.234075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c942f-9e92-4346-a5ef-319502691e68 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:06.235575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 14:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:00:06.240702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959de7f-4ef5-471f-ba43-aa78f59defd4 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:06.241101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959de7f-4ef5-471f-ba43-aa78f59defd4 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:06.241264 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959de7f-4ef5-471f-ba43-aa78f59defd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:06.319857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1959de7f-4ef5-471f-ba43-aa78f59defd4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:06.321107 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1959de7f-4ef5-471f-ba43-aa78f59defd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:06.323145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:06.417699 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 14:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:06.569645 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c942f-9e92-4346-a5ef-319502691e68 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:06.571197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c66c942f-9e92-4346-a5ef-319502691e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:06.722913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c942f-9e92-4346-a5ef-319502691e68 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:06.750707 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:06.835770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaeb272-7c36-4c46-a8cf-d8d113828126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:06.836413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeb272-7c36-4c46-a8cf-d8d113828126 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:06.836692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeb272-7c36-4c46-a8cf-d8d113828126 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:06.836959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeb272-7c36-4c46-a8cf-d8d113828126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:06.838553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-dfaeb272-7c36-4c46-a8cf-d8d113828126 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:06.935143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaeb272-7c36-4c46-a8cf-d8d113828126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:06.935143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaeb272-7c36-4c46-a8cf-d8d113828126 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:06.952214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 720/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:08.783456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe2986-3d2e-4157-a1a3-6dcb1c57a14c None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:08.784072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe2986-3d2e-4157-a1a3-6dcb1c57a14c None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:08.784072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe2986-3d2e-4157-a1a3-6dcb1c57a14c None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:08.785379 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 14:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:00:08.790910 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7048e-98a5-4253-acca-69066c13a6ac None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:08.791346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7048e-98a5-4253-acca-69066c13a6ac None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:08.791456 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7048e-98a5-4253-acca-69066c13a6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:08.833301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:08.858279 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-f4c7048e-98a5-4253-acca-69066c13a6ac None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:08.859490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f4c7048e-98a5-4253-acca-69066c13a6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:08.957666 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 14:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:09.243203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe2986-3d2e-4157-a1a3-6dcb1c57a14c None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:09.244791 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-16fe2986-3d2e-4157-a1a3-6dcb1c57a14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:09.346588 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe2986-3d2e-4157-a1a3-6dcb1c57a14c None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:09.378778 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:09.419969 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4830da-426c-4176-8eac-a32f2d13a16a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:09.420498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4830da-426c-4176-8eac-a32f2d13a16a service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:09.420778 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4830da-426c-4176-8eac-a32f2d13a16a service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:09.421048 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4830da-426c-4176-8eac-a32f2d13a16a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:09.422663 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-cb4830da-426c-4176-8eac-a32f2d13a16a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:09.535539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4830da-426c-4176-8eac-a32f2d13a16a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:09.537100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4830da-426c-4176-8eac-a32f2d13a16a service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:09.555622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 722/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:11.614709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb4b5b-4bb8-454e-84ef-92c57741407f None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:11.615285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb4b5b-4bb8-454e-84ef-92c57741407f None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:11.615285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb4b5b-4bb8-454e-84ef-92c57741407f None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:11.616661 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 14:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:00:11.621983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88508bcf-8dd4-4bcd-b6a6-95ca6d7febb7 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:11.622385 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88508bcf-8dd4-4bcd-b6a6-95ca6d7febb7 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:11.622540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88508bcf-8dd4-4bcd-b6a6-95ca6d7febb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:11.689773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-88508bcf-8dd4-4bcd-b6a6-95ca6d7febb7 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:11.691021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-88508bcf-8dd4-4bcd-b6a6-95ca6d7febb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:11.704221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:11.789342 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 14:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:12.100966 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb4b5b-4bb8-454e-84ef-92c57741407f None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:12.102796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d4bb4b5b-4bb8-454e-84ef-92c57741407f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:12.214386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb4b5b-4bb8-454e-84ef-92c57741407f None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:12.228188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:12.298139 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270be621-3f3a-4927-86da-1260b79be865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:12.298758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270be621-3f3a-4927-86da-1260b79be865 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:12.299043 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270be621-3f3a-4927-86da-1260b79be865 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:12.299366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270be621-3f3a-4927-86da-1260b79be865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:12.301015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-270be621-3f3a-4927-86da-1260b79be865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:12.428593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270be621-3f3a-4927-86da-1260b79be865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:12.431113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270be621-3f3a-4927-86da-1260b79be865 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:12.456505 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 723/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:14.768157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca4f2f-5bec-490b-aaf6-e06a7b5b73d4 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:14.768737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca4f2f-5bec-490b-aaf6-e06a7b5b73d4 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:14.768737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca4f2f-5bec-490b-aaf6-e06a7b5b73d4 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:14.770109 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 14:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:00:14.775212 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f39ddd-8e57-49bd-92e5-5618744af0af None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:14.775617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f39ddd-8e57-49bd-92e5-5618744af0af None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:14.775767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f39ddd-8e57-49bd-92e5-5618744af0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:14.824221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:14.841989 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-37f39ddd-8e57-49bd-92e5-5618744af0af None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:14.843205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-37f39ddd-8e57-49bd-92e5-5618744af0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:14.942726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 14:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:15.237742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca4f2f-5bec-490b-aaf6-e06a7b5b73d4 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:15.239675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-40ca4f2f-5bec-490b-aaf6-e06a7b5b73d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:15.346706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca4f2f-5bec-490b-aaf6-e06a7b5b73d4 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:15.386773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:15.425628 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ba8fc-c14b-424e-a4af-ef328bbc81f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:15.426154 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ba8fc-c14b-424e-a4af-ef328bbc81f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:15.426445 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ba8fc-c14b-424e-a4af-ef328bbc81f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:15.426771 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ba8fc-c14b-424e-a4af-ef328bbc81f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:15.428400 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c88ba8fc-c14b-424e-a4af-ef328bbc81f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:15.535529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ba8fc-c14b-424e-a4af-ef328bbc81f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:15.537016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ba8fc-c14b-424e-a4af-ef328bbc81f4 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:15.555818 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 725/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:17.669612 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb07939-2999-424f-9bb7-dad75f3ff5c0 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:17.670162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb07939-2999-424f-9bb7-dad75f3ff5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:17.670162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb07939-2999-424f-9bb7-dad75f3ff5c0 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:17.671529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 14:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 14:00:17.676869 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b08dc3-dc9d-400f-a096-2f44bcdeb745 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:17.677319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b08dc3-dc9d-400f-a096-2f44bcdeb745 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:17.677457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b08dc3-dc9d-400f-a096-2f44bcdeb745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:17.750434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-94b08dc3-dc9d-400f-a096-2f44bcdeb745 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:17.751697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-94b08dc3-dc9d-400f-a096-2f44bcdeb745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:17.773239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:17.850560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:18.142643 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb07939-2999-424f-9bb7-dad75f3ff5c0 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:18.143584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-8cb07939-2999-424f-9bb7-dad75f3ff5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:18.252150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb07939-2999-424f-9bb7-dad75f3ff5c0 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:18.292845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:18.349682 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83da83-2f36-457d-a411-6a72e0608f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:18.350355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83da83-2f36-457d-a411-6a72e0608f91 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:18.350631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83da83-2f36-457d-a411-6a72e0608f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:18.350901 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83da83-2f36-457d-a411-6a72e0608f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:18.352769 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-eb83da83-2f36-457d-a411-6a72e0608f91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:18.464287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83da83-2f36-457d-a411-6a72e0608f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:18.465630 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83da83-2f36-457d-a411-6a72e0608f91 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:18.484492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 726/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:20.620887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b56886-c117-4f61-8371-7a3d30e09c90 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:20.621505 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b56886-c117-4f61-8371-7a3d30e09c90 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:20.621505 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b56886-c117-4f61-8371-7a3d30e09c90 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:20.622895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 14:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:00:20.628921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ccd21-ec6f-48b2-afbb-bfe16e8af8ff None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:20.629403 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ccd21-ec6f-48b2-afbb-bfe16e8af8ff None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:20.629513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ccd21-ec6f-48b2-afbb-bfe16e8af8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:20.696985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:20.699578 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-877ccd21-ec6f-48b2-afbb-bfe16e8af8ff None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:20.700839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-877ccd21-ec6f-48b2-afbb-bfe16e8af8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:20.799677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 14:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:21.090635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b56886-c117-4f61-8371-7a3d30e09c90 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:21.092238 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-71b56886-c117-4f61-8371-7a3d30e09c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:21.197673 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b56886-c117-4f61-8371-7a3d30e09c90 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:21.247039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:21.272991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784247d6-d494-4d63-b604-4817c08c0793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:21.273606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784247d6-d494-4d63-b604-4817c08c0793 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:21.273890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784247d6-d494-4d63-b604-4817c08c0793 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:21.274167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784247d6-d494-4d63-b604-4817c08c0793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:21.275773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-784247d6-d494-4d63-b604-4817c08c0793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:21.386505 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784247d6-d494-4d63-b604-4817c08c0793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:21.387855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784247d6-d494-4d63-b604-4817c08c0793 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:21.407237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 728/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:23.377658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab11b6a-ebae-4f33-b362-5c55be7029dc None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:23.378354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab11b6a-ebae-4f33-b362-5c55be7029dc None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:23.378354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab11b6a-ebae-4f33-b362-5c55be7029dc None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:23.379608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 14:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 14:00:23.385036 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037abf7-4337-4011-a677-ac9a05010f02 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:23.385465 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037abf7-4337-4011-a677-ac9a05010f02 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:23.385594 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037abf7-4337-4011-a677-ac9a05010f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:23.453599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-c037abf7-4337-4011-a677-ac9a05010f02 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:23.454860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c037abf7-4337-4011-a677-ac9a05010f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:23.485428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:23.574062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 14:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:23.864403 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab11b6a-ebae-4f33-b362-5c55be7029dc None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:23.866113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-dab11b6a-ebae-4f33-b362-5c55be7029dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:23.996642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab11b6a-ebae-4f33-b362-5c55be7029dc None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:24.027084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:24.074544 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e8572-f59e-4681-992b-14dab61ff0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:24.075162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e8572-f59e-4681-992b-14dab61ff0ad service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:24.075442 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e8572-f59e-4681-992b-14dab61ff0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:24.075713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e8572-f59e-4681-992b-14dab61ff0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:24.078264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1c4e8572-f59e-4681-992b-14dab61ff0ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:24.189395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e8572-f59e-4681-992b-14dab61ff0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:24.190835 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e8572-f59e-4681-992b-14dab61ff0ad service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:24.210807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 729/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:26.230738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df9792-fbdc-48c1-9850-5363404d0148 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:26.231271 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df9792-fbdc-48c1-9850-5363404d0148 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:26.231393 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df9792-fbdc-48c1-9850-5363404d0148 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:26.232735 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 14:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:00:26.238056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e43b8-daaf-466c-baa5-52db50ac9ab4 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:26.238447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e43b8-daaf-466c-baa5-52db50ac9ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:26.244682 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e43b8-daaf-466c-baa5-52db50ac9ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:26.305459 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-cd9e43b8-daaf-466c-baa5-52db50ac9ab4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:26.306683 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-cd9e43b8-daaf-466c-baa5-52db50ac9ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:26.315708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:26.407590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 14:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:26.692012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df9792-fbdc-48c1-9850-5363404d0148 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:26.694395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-02df9792-fbdc-48c1-9850-5363404d0148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:26.811147 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df9792-fbdc-48c1-9850-5363404d0148 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:26.867373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:26.886791 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be2bb6-781d-474a-a539-508f6f904f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:26.887343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be2bb6-781d-474a-a539-508f6f904f38 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:26.887638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be2bb6-781d-474a-a539-508f6f904f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:26.888008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be2bb6-781d-474a-a539-508f6f904f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:26.889537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-99be2bb6-781d-474a-a539-508f6f904f38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:27.001269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be2bb6-781d-474a-a539-508f6f904f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:27.002715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be2bb6-781d-474a-a539-508f6f904f38 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:27.021925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 731/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:29.007418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757255b-10dc-4f8d-adda-07e934c1bc0d None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:29.007950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757255b-10dc-4f8d-adda-07e934c1bc0d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:29.008069 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757255b-10dc-4f8d-adda-07e934c1bc0d None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:29.009472 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 14:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:00:29.014762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1269a-7ec8-4e81-8550-a3b2d0b284e3 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:29.015812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1269a-7ec8-4e81-8550-a3b2d0b284e3 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:29.016049 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1269a-7ec8-4e81-8550-a3b2d0b284e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:29.097633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-74e1269a-7ec8-4e81-8550-a3b2d0b284e3 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:29.098879 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-74e1269a-7ec8-4e81-8550-a3b2d0b284e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:29.141770 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:29.214478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 14:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:29.498040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757255b-10dc-4f8d-adda-07e934c1bc0d None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:29.499708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-0757255b-10dc-4f8d-adda-07e934c1bc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:29.606881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757255b-10dc-4f8d-adda-07e934c1bc0d None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:29.645469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:29.681411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f373f5-1d62-4176-bafc-ab68d590bd5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:29.682027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f373f5-1d62-4176-bafc-ab68d590bd5c service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:29.682309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f373f5-1d62-4176-bafc-ab68d590bd5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:29.682583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f373f5-1d62-4176-bafc-ab68d590bd5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:29.684220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-38f373f5-1d62-4176-bafc-ab68d590bd5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:29.795817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f373f5-1d62-4176-bafc-ab68d590bd5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:29.797805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f373f5-1d62-4176-bafc-ab68d590bd5c service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:29.816932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 732/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:31.767341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f3ced-5ba9-4194-85a5-c903aeb32761 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:31.767924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f3ced-5ba9-4194-85a5-c903aeb32761 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:31.767924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f3ced-5ba9-4194-85a5-c903aeb32761 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:31.769319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 14:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:00:31.774638 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fd4f2-2e09-4672-a13b-cdde25d51e6e None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:31.775049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fd4f2-2e09-4672-a13b-cdde25d51e6e None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:31.775198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fd4f2-2e09-4672-a13b-cdde25d51e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:31.841809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-cf0fd4f2-2e09-4672-a13b-cdde25d51e6e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:31.843018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-cf0fd4f2-2e09-4672-a13b-cdde25d51e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:31.861538 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:31.943136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 14:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:32.232805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f3ced-5ba9-4194-85a5-c903aeb32761 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:32.234972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-247f3ced-5ba9-4194-85a5-c903aeb32761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:32.345664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f3ced-5ba9-4194-85a5-c903aeb32761 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:32.413127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:32.422538 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a056037-6573-47af-a6ab-eacb87808e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:32.423080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a056037-6573-47af-a6ab-eacb87808e61 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:32.423368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a056037-6573-47af-a6ab-eacb87808e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:32.423630 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a056037-6573-47af-a6ab-eacb87808e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:32.425249 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3a056037-6573-47af-a6ab-eacb87808e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:32.537177 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a056037-6573-47af-a6ab-eacb87808e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:32.538609 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a056037-6573-47af-a6ab-eacb87808e61 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:32.558066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 734/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:34.513660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a3cf5-ed98-4a94-863f-b78ef8ac1c08 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:34.514231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a3cf5-ed98-4a94-863f-b78ef8ac1c08 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:34.514231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a3cf5-ed98-4a94-863f-b78ef8ac1c08 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:34.516255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 14:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:00:34.521425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5a086-94e6-438c-8840-2dc57770c993 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:34.521892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5a086-94e6-438c-8840-2dc57770c993 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:34.521995 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5a086-94e6-438c-8840-2dc57770c993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:34.587612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-2fd5a086-94e6-438c-8840-2dc57770c993 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:34.588873 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2fd5a086-94e6-438c-8840-2dc57770c993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:34.639616 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:34.688449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 14:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:34.973470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a3cf5-ed98-4a94-863f-b78ef8ac1c08 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:34.975017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a09a3cf5-ed98-4a94-863f-b78ef8ac1c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:35.083452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a3cf5-ed98-4a94-863f-b78ef8ac1c08 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:35.131854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:35.158821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f07fdf-215a-4efa-bae8-5b58c3347f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:35.159594 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f07fdf-215a-4efa-bae8-5b58c3347f0b service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:35.159925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f07fdf-215a-4efa-bae8-5b58c3347f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:35.160248 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f07fdf-215a-4efa-bae8-5b58c3347f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:35.162189 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-40f07fdf-215a-4efa-bae8-5b58c3347f0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:35.279416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f07fdf-215a-4efa-bae8-5b58c3347f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:35.281384 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f07fdf-215a-4efa-bae8-5b58c3347f0b service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:35.300225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 735/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:44.686781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=22 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:45.297926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=66 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:55.154635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566789f7-cca1-4afe-be3a-a8bd7fd2ae89 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:55.155163 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566789f7-cca1-4afe-be3a-a8bd7fd2ae89 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:55.155163 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566789f7-cca1-4afe-be3a-a8bd7fd2ae89 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:55.156491 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 736/1471] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 14:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:00:55.161550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0268099-4db2-4901-8a05-88e19e4cff11 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:55.161967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0268099-4db2-4901-8a05-88e19e4cff11 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:55.162100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0268099-4db2-4901-8a05-88e19e4cff11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:55.228918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-d0268099-4db2-4901-8a05-88e19e4cff11 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:55.230163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d0268099-4db2-4901-8a05-88e19e4cff11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:55.331236 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 736/1472] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 14:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:55.642029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5eccb-65f2-4c80-9dfa-07adfdb44b40 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:55.642322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5eccb-65f2-4c80-9dfa-07adfdb44b40 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:55.642603 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5eccb-65f2-4c80-9dfa-07adfdb44b40 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:55.644279 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 737/1473] 10.222.0.64 () {54 vars in 967 bytes} [Thu Sep 1 14:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 14:00:55.648751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc724b-04f7-45b3-b266-96e888ee168b None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:55.649039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc724b-04f7-45b3-b266-96e888ee168b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:55.649312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc724b-04f7-45b3-b266-96e888ee168b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:55.734185 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-d7fc724b-04f7-45b3-b266-96e888ee168b None None] MFA Rules not processed for user `0f750815038d404d9d39a68bf62db8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:55.735397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d7fc724b-04f7-45b3-b266-96e888ee168b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:55.757064 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:55.818275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 737/1474] 10.222.0.64 () {58 vars in 1064 bytes} [Thu Sep 1 14:00:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:55.826428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5eccb-65f2-4c80-9dfa-07adfdb44b40 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:55.828041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-bdc5eccb-65f2-4c80-9dfa-07adfdb44b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:55.934222 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5eccb-65f2-4c80-9dfa-07adfdb44b40 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:56.012719 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac7a09-5780-499a-8770-d765b8bb5950 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f750815038d404d9d39a68bf62db8c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:56.013331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac7a09-5780-499a-8770-d765b8bb5950 service glance] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:56.014101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac7a09-5780-499a-8770-d765b8bb5950 service glance] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:56.014374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac7a09-5780-499a-8770-d765b8bb5950 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:56.016023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ecac7a09-5780-499a-8770-d765b8bb5950 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:56.197989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:56.253914 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac7a09-5780-499a-8770-d765b8bb5950 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:56.255346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac7a09-5780-499a-8770-d765b8bb5950 service glance] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:56.273993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 738/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:00:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:00:58.273877 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b320847-059a-4705-b6ba-aa5610aeccbb None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:58.274446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b320847-059a-4705-b6ba-aa5610aeccbb None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:58.274446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b320847-059a-4705-b6ba-aa5610aeccbb None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:58.275824 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 738/1476] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 14:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:00:58.281457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049255b-b442-4d5c-8a21-d7ada135cdad None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:58.281895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049255b-b442-4d5c-8a21-d7ada135cdad None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:58.281993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049255b-b442-4d5c-8a21-d7ada135cdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:58.349585 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-6049255b-b442-4d5c-8a21-d7ada135cdad None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:00:58.351108 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6049255b-b442-4d5c-8a21-d7ada135cdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:58.448172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 739/1477] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 14:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:00:58.718182 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b320847-059a-4705-b6ba-aa5610aeccbb None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:00:58.719635 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4b320847-059a-4705-b6ba-aa5610aeccbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:00:58.859053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b320847-059a-4705-b6ba-aa5610aeccbb None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:00:58.913958 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:58.963159 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487a1b3-cbfb-4ca3-a4ca-edec50fcd4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:00:58.963812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487a1b3-cbfb-4ca3-a4ca-edec50fcd4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:00:58.964119 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487a1b3-cbfb-4ca3-a4ca-edec50fcd4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:00:58.964389 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487a1b3-cbfb-4ca3-a4ca-edec50fcd4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:00:58.965020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487a1b3-cbfb-4ca3-a4ca-edec50fcd4e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:00:58.966933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: WARNING py.warnings [None req-a487a1b3-cbfb-4ca3-a4ca-edec50fcd4e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 14:00:58.966933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: warnings.warn(msg) Sep 01 14:00:58.966933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: Sep 01 14:00:58.968166 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487a1b3-cbfb-4ca3-a4ca-edec50fcd4e1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:00:58.989037 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 739/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Sep 1 14:00:58 2022] GET /identity/v3/projects => generated 2553 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:01:00.960845 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4609645-f5cc-4b51-9182-9e08e48af7e6 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:00.961382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4609645-f5cc-4b51-9182-9e08e48af7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:00.961382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4609645-f5cc-4b51-9182-9e08e48af7e6 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:00.962798 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 740/1479] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 14:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:01:00.968121 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656b353-5f18-4db3-a4b7-a8a8aadf862b None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:00.968563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656b353-5f18-4db3-a4b7-a8a8aadf862b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:00.968673 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656b353-5f18-4db3-a4b7-a8a8aadf862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:01.034827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-f656b353-5f18-4db3-a4b7-a8a8aadf862b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:01.037402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f656b353-5f18-4db3-a4b7-a8a8aadf862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:01.254206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 740/1480] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:01.555360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4609645-f5cc-4b51-9182-9e08e48af7e6 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:01.556951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c4609645-f5cc-4b51-9182-9e08e48af7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:01.567184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:01.704097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4609645-f5cc-4b51-9182-9e08e48af7e6 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:01.785302 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:01.818930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bc9c7-4d3c-47db-99b1-cb1711afa0d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:01.819464 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bc9c7-4d3c-47db-99b1-cb1711afa0d3 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:01.819747 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bc9c7-4d3c-47db-99b1-cb1711afa0d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:01.820056 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bc9c7-4d3c-47db-99b1-cb1711afa0d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:01.821652 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f06bc9c7-4d3c-47db-99b1-cb1711afa0d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:01.909639 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bc9c7-4d3c-47db-99b1-cb1711afa0d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:01.911210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bc9c7-4d3c-47db-99b1-cb1711afa0d3 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:01.929357 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 741/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:04.056320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517dec4-d041-42bb-8b43-75df731c9214 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:04.056977 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517dec4-d041-42bb-8b43-75df731c9214 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:04.057094 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517dec4-d041-42bb-8b43-75df731c9214 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:04.058528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 741/1482] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 14:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:01:04.063714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bbe85-4a4f-4fd3-ad41-e4ca2d534996 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:04.064186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bbe85-4a4f-4fd3-ad41-e4ca2d534996 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:04.064421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bbe85-4a4f-4fd3-ad41-e4ca2d534996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:04.131276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-db2bbe85-4a4f-4fd3-ad41-e4ca2d534996 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:04.132504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-db2bbe85-4a4f-4fd3-ad41-e4ca2d534996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:04.179199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:04.230432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 742/1483] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 14:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:04.516397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517dec4-d041-42bb-8b43-75df731c9214 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:04.517936 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a517dec4-d041-42bb-8b43-75df731c9214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:04.541987 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:04.621966 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517dec4-d041-42bb-8b43-75df731c9214 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:04.695220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e36814-d237-488f-9a69-ce30bed6e819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:04.695824 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e36814-d237-488f-9a69-ce30bed6e819 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:04.696204 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e36814-d237-488f-9a69-ce30bed6e819 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:04.696475 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e36814-d237-488f-9a69-ce30bed6e819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:04.698071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c8e36814-d237-488f-9a69-ce30bed6e819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:04.771098 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:04.805502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e36814-d237-488f-9a69-ce30bed6e819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:04.806981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e36814-d237-488f-9a69-ce30bed6e819 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:04.825981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 742/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:06.803715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53b318-fec8-4a8a-ad00-8da390278b05 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:06.804326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53b318-fec8-4a8a-ad00-8da390278b05 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:06.804326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53b318-fec8-4a8a-ad00-8da390278b05 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:06.805652 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 743/1485] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 14:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:01:06.811336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d2f8c-7d14-4a9f-a0f5-8a27f8ade65f None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:06.811736 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d2f8c-7d14-4a9f-a0f5-8a27f8ade65f None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:06.811919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d2f8c-7d14-4a9f-a0f5-8a27f8ade65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:06.881475 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-710d2f8c-7d14-4a9f-a0f5-8a27f8ade65f None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:06.882688 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-710d2f8c-7d14-4a9f-a0f5-8a27f8ade65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:06.978482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 743/1486] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 14:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:07.266966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53b318-fec8-4a8a-ad00-8da390278b05 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:07.268545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-8c53b318-fec8-4a8a-ad00-8da390278b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:07.372272 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53b318-fec8-4a8a-ad00-8da390278b05 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:07.444312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:07.446005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481f258-5a2f-4924-8802-a801b19a5962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:07.446607 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481f258-5a2f-4924-8802-a801b19a5962 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:07.446887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481f258-5a2f-4924-8802-a801b19a5962 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:07.447157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481f258-5a2f-4924-8802-a801b19a5962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:07.448789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6481f258-5a2f-4924-8802-a801b19a5962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:07.561755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481f258-5a2f-4924-8802-a801b19a5962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:07.563200 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481f258-5a2f-4924-8802-a801b19a5962 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:07.583747 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 744/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:09.621203 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd34b3-524a-4f10-8396-1f1ee79423e9 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:09.621796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd34b3-524a-4f10-8396-1f1ee79423e9 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:09.621796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd34b3-524a-4f10-8396-1f1ee79423e9 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:09.623160 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 744/1488] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 14:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:01:09.628572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de491cf-c366-4406-9f95-87af1cbf922a None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:09.628984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de491cf-c366-4406-9f95-87af1cbf922a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:09.629117 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de491cf-c366-4406-9f95-87af1cbf922a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:09.696661 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-4de491cf-c366-4406-9f95-87af1cbf922a None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:09.697883 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-4de491cf-c366-4406-9f95-87af1cbf922a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:09.751171 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:09.794921 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 745/1489] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 14:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:10.085468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd34b3-524a-4f10-8396-1f1ee79423e9 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:10.087020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-dbdd34b3-524a-4f10-8396-1f1ee79423e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:10.123056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:10.191060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd34b3-524a-4f10-8396-1f1ee79423e9 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:10.265683 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dac319-0861-4b43-9e09-12166b20bcc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:10.266294 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dac319-0861-4b43-9e09-12166b20bcc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:10.266619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dac319-0861-4b43-9e09-12166b20bcc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:10.266895 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dac319-0861-4b43-9e09-12166b20bcc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:10.268534 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f2dac319-0861-4b43-9e09-12166b20bcc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:10.348329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:10.376773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dac319-0861-4b43-9e09-12166b20bcc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:10.378202 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dac319-0861-4b43-9e09-12166b20bcc6 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:10.396235 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 745/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:12.759136 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b473e-e39c-40fd-a76e-e6e07459cb9a None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:12.759723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b473e-e39c-40fd-a76e-e6e07459cb9a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:12.759723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b473e-e39c-40fd-a76e-e6e07459cb9a None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:12.761075 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 746/1491] 10.222.0.64 () {54 vars in 927 bytes} [Thu Sep 1 14:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:01:12.766905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58021f-3fa8-4eb4-a950-a4dfd436a88f None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:12.767338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58021f-3fa8-4eb4-a950-a4dfd436a88f None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:12.767442 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58021f-3fa8-4eb4-a950-a4dfd436a88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:12.835576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-7d58021f-3fa8-4eb4-a950-a4dfd436a88f None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:01:12.836833 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7d58021f-3fa8-4eb4-a950-a4dfd436a88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:12.937391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 746/1492] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Sep 1 14:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:01:13.234309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b473e-e39c-40fd-a76e-e6e07459cb9a None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:01:13.235855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e79b473e-e39c-40fd-a76e-e6e07459cb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:13.351622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b473e-e39c-40fd-a76e-e6e07459cb9a None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:01:13.440103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f6686-23be-4ed1-adcd-125b26f3cd45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:01:13.440606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f6686-23be-4ed1-adcd-125b26f3cd45 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:01:13.440880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f6686-23be-4ed1-adcd-125b26f3cd45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:01:13.441176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f6686-23be-4ed1-adcd-125b26f3cd45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:01:13.442885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-840f6686-23be-4ed1-adcd-125b26f3cd45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:01:13.452856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:13.563837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f6686-23be-4ed1-adcd-125b26f3cd45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:01:13.565345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f6686-23be-4ed1-adcd-125b26f3cd45 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:01:13.583688 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 747/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:01:22.935035 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=82 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:23.581404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=50 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:37.517787 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adb46f-1fa0-404f-bbb2-70cd8caff598 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:37.518362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adb46f-1fa0-404f-bbb2-70cd8caff598 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:37.518362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adb46f-1fa0-404f-bbb2-70cd8caff598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:37.603325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-d7adb46f-1fa0-404f-bbb2-70cd8caff598 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:37.604567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d7adb46f-1fa0-404f-bbb2-70cd8caff598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:37.702709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 747/1494] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:37.710893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf4524-dd9d-49ad-913e-2cbbd2fdac0d None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:37.711402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf4524-dd9d-49ad-913e-2cbbd2fdac0d None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:37.711524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf4524-dd9d-49ad-913e-2cbbd2fdac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:37.790577 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-6bdf4524-dd9d-49ad-913e-2cbbd2fdac0d None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:37.791788 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6bdf4524-dd9d-49ad-913e-2cbbd2fdac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:37.888906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 748/1495] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:37.893642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adb46f-1fa0-404f-bbb2-70cd8caff598 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:37.894832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d7adb46f-1fa0-404f-bbb2-70cd8caff598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:37.906092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adb46f-1fa0-404f-bbb2-70cd8caff598 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:37.965893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:37.999072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b714853-23dd-488b-ae0d-9f2009c10995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:37.999672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b714853-23dd-488b-ae0d-9f2009c10995 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:37.999976 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b714853-23dd-488b-ae0d-9f2009c10995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:38.000247 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b714853-23dd-488b-ae0d-9f2009c10995 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:38.000881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b714853-23dd-488b-ae0d-9f2009c10995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:02:38.001183 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b714853-23dd-488b-ae0d-9f2009c10995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:38.002269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: WARNING py.warnings [None req-2b714853-23dd-488b-ae0d-9f2009c10995 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 14:02:38.002269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: warnings.warn(msg) Sep 01 14:02:38.002269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: Sep 01 14:02:38.003147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b714853-23dd-488b-ae0d-9f2009c10995 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:38.014077 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 748/1496] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:02:38.022428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf4524-dd9d-49ad-913e-2cbbd2fdac0d None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:38.031523 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf4524-dd9d-49ad-913e-2cbbd2fdac0d None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:38.093255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:38.127382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce6fed-4e98-4cd6-8017-5c35db4a2c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:38.128060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce6fed-4e98-4cd6-8017-5c35db4a2c14 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:38.128544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce6fed-4e98-4cd6-8017-5c35db4a2c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:38.129033 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce6fed-4e98-4cd6-8017-5c35db4a2c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:38.129975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce6fed-4e98-4cd6-8017-5c35db4a2c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:38.131761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: WARNING py.warnings [None req-dcce6fed-4e98-4cd6-8017-5c35db4a2c14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 14:02:38.131761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: warnings.warn(msg) Sep 01 14:02:38.131761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: Sep 01 14:02:38.133090 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce6fed-4e98-4cd6-8017-5c35db4a2c14 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:38.262910 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 749/1497] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:02:38 2022] POST /identity/v3/projects => generated 377 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:38.266913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b714853-23dd-488b-ae0d-9f2009c10995 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:38.268451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2b714853-23dd-488b-ae0d-9f2009c10995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:38.302352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b714853-23dd-488b-ae0d-9f2009c10995 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:38.397309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20743db-262b-4bd0-b360-13a93f1cb723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:38.397918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20743db-262b-4bd0-b360-13a93f1cb723 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:38.398197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20743db-262b-4bd0-b360-13a93f1cb723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:38.398967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20743db-262b-4bd0-b360-13a93f1cb723 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:38.399586 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20743db-262b-4bd0-b360-13a93f1cb723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:38.400627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: WARNING py.warnings [None req-a20743db-262b-4bd0-b360-13a93f1cb723 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 14:02:38.400627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: warnings.warn(msg) Sep 01 14:02:38.400627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: Sep 01 14:02:38.401827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20743db-262b-4bd0-b360-13a93f1cb723 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:38.511054 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 749/1498] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:02:38 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:02:38.515117 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce6fed-4e98-4cd6-8017-5c35db4a2c14 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:38.516664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-dcce6fed-4e98-4cd6-8017-5c35db4a2c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:38.577850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce6fed-4e98-4cd6-8017-5c35db4a2c14 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:38.660470 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:38.671953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7d2ab-1ac9-4066-a507-e9911beba9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:38.673394 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7d2ab-1ac9-4066-a507-e9911beba9fc admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:38.673394 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7d2ab-1ac9-4066-a507-e9911beba9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:38.673394 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7d2ab-1ac9-4066-a507-e9911beba9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:38.673848 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7d2ab-1ac9-4066-a507-e9911beba9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:38.674847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: WARNING py.warnings [None req-f8e7d2ab-1ac9-4066-a507-e9911beba9fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 14:02:38.674847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: warnings.warn(msg) Sep 01 14:02:38.674847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: Sep 01 14:02:38.675729 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7d2ab-1ac9-4066-a507-e9911beba9fc admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:38.688898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 750/1499] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:02:38.692950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20743db-262b-4bd0-b360-13a93f1cb723 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:38.694461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a20743db-262b-4bd0-b360-13a93f1cb723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:38.705946 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20743db-262b-4bd0-b360-13a93f1cb723 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:38.731596 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:38.802421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d159bc6-d037-47e5-99ca-005c5bbea1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:38.803037 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d159bc6-d037-47e5-99ca-005c5bbea1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:38.803319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d159bc6-d037-47e5-99ca-005c5bbea1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:38.803592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d159bc6-d037-47e5-99ca-005c5bbea1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:38.804273 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d159bc6-d037-47e5-99ca-005c5bbea1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:38.805818 dv-cinder-852211-7-smb devstack@keystone.service[81699]: WARNING py.warnings [None req-3d159bc6-d037-47e5-99ca-005c5bbea1c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 14:02:38.805818 dv-cinder-852211-7-smb devstack@keystone.service[81699]: warnings.warn(msg) Sep 01 14:02:38.805818 dv-cinder-852211-7-smb devstack@keystone.service[81699]: Sep 01 14:02:38.806702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d159bc6-d037-47e5-99ca-005c5bbea1c0 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:38.818929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 750/1500] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:02:38.823380 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7d2ab-1ac9-4066-a507-e9911beba9fc admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:38.824923 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f8e7d2ab-1ac9-4066-a507-e9911beba9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:38.859025 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7d2ab-1ac9-4066-a507-e9911beba9fc admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:38.951898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7565e-ec30-4280-9455-b23a171e5e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:38.952551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7565e-ec30-4280-9455-b23a171e5e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:38.952823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7565e-ec30-4280-9455-b23a171e5e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:38.953088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7565e-ec30-4280-9455-b23a171e5e90 admin admin] PATH_INFO: `/v3/projects/920298e016b141679d70ba76a6e67c1b/users/29b7308be5194f75b5febd57218f9b9c/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:38.975124 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7565e-ec30-4280-9455-b23a171e5e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=920298e016b141679d70ba76a6e67c1b, user_id=29b7308be5194f75b5febd57218f9b9c, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:38.976185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: WARNING py.warnings [None req-97c7565e-ec30-4280-9455-b23a171e5e90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 14:02:38.976185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: warnings.warn(msg) Sep 01 14:02:38.976185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: Sep 01 14:02:38.978698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7565e-ec30-4280-9455-b23a171e5e90 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:39.059170 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 751/1501] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:02:38 2022] PUT /identity/v3/projects/920298e016b141679d70ba76a6e67c1b/users/29b7308be5194f75b5febd57218f9b9c/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:39.071680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3616b32-b194-4873-adf3-adbf66bd0273 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:39.071990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3616b32-b194-4873-adf3-adbf66bd0273 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:39.072270 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3616b32-b194-4873-adf3-adbf66bd0273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:39.131292 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-d3616b32-b194-4873-adf3-adbf66bd0273 None None] MFA Rules not processed for user `29b7308be5194f75b5febd57218f9b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:39.132517 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d3616b32-b194-4873-adf3-adbf66bd0273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:39.210710 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 751/1502] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:02:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:39.224229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60870ccd-1956-4c33-bf10-3d373e34f1ee None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:39.224521 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60870ccd-1956-4c33-bf10-3d373e34f1ee None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:39.224793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60870ccd-1956-4c33-bf10-3d373e34f1ee None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:39.226127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 752/1503] 10.222.0.64 () {54 vars in 964 bytes} [Thu Sep 1 14:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:02:39.231580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48b580-7d0e-46f8-bc9d-002a54652204 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:39.231896 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48b580-7d0e-46f8-bc9d-002a54652204 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:39.232168 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48b580-7d0e-46f8-bc9d-002a54652204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:39.264928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:39.308877 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6b48b580-7d0e-46f8-bc9d-002a54652204 None None] MFA Rules not processed for user `92870867b169496fa8913b2ab93eac37`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:39.310140 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6b48b580-7d0e-46f8-bc9d-002a54652204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:39.386357 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 752/1504] 10.222.0.64 () {58 vars in 1061 bytes} [Thu Sep 1 14:02:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:39.396006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60870ccd-1956-4c33-bf10-3d373e34f1ee None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:39.397524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-60870ccd-1956-4c33-bf10-3d373e34f1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:39.447959 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:39.502541 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60870ccd-1956-4c33-bf10-3d373e34f1ee None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:39.576126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21af02e-4b47-4136-9a26-043318c73039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:39.576653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21af02e-4b47-4136-9a26-043318c73039 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:39.576932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21af02e-4b47-4136-9a26-043318c73039 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:39.577227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21af02e-4b47-4136-9a26-043318c73039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:39.578819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b21af02e-4b47-4136-9a26-043318c73039 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:39.677801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21af02e-4b47-4136-9a26-043318c73039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:39.679227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21af02e-4b47-4136-9a26-043318c73039 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:39.683315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:39.697982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 753/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:02:39.743459 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dfab2-e9aa-4bd9-84c3-2d045d0855fd None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:39.743936 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dfab2-e9aa-4bd9-84c3-2d045d0855fd None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:39.744055 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dfab2-e9aa-4bd9-84c3-2d045d0855fd None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:39.745400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 753/1506] 10.222.0.64 () {52 vars in 830 bytes} [Thu Sep 1 14:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:02:39.749011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21af02e-4b47-4136-9a26-043318c73039 service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:39.750247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b21af02e-4b47-4136-9a26-043318c73039 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:39.848237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21af02e-4b47-4136-9a26-043318c73039 service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:39.941760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d7f49-677b-4797-9468-e6d62a4aa7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:39.942387 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d7f49-677b-4797-9468-e6d62a4aa7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:39.942667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d7f49-677b-4797-9468-e6d62a4aa7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:39.942940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d7f49-677b-4797-9468-e6d62a4aa7c2 admin admin] PATH_INFO: `/v3/users/29b7308be5194f75b5febd57218f9b9c` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:39.955580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d7f49-677b-4797-9468-e6d62a4aa7c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b7308be5194f75b5febd57218f9b9c)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:39.956649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: WARNING py.warnings [None req-526d7f49-677b-4797-9468-e6d62a4aa7c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 14:02:39.956649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: warnings.warn(msg) Sep 01 14:02:39.956649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: Sep 01 14:02:39.957860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d7f49-677b-4797-9468-e6d62a4aa7c2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:39.968142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:40.212764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-526d7f49-677b-4797-9468-e6d62a4aa7c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b7308be5194f75b5febd57218f9b9c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:40.236142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-526d7f49-677b-4797-9468-e6d62a4aa7c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b7308be5194f75b5febd57218f9b9c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:40.352752 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-526d7f49-677b-4797-9468-e6d62a4aa7c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b7308be5194f75b5febd57218f9b9c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:40.367334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-526d7f49-677b-4797-9468-e6d62a4aa7c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b7308be5194f75b5febd57218f9b9c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:40.367893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-526d7f49-677b-4797-9468-e6d62a4aa7c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b7308be5194f75b5febd57218f9b9c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:40.373891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 754/1507] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:02:39 2022] DELETE /identity/v3/users/29b7308be5194f75b5febd57218f9b9c => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:40.378453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec8b0c-f1d8-4377-b40c-e32f1c856cb4 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:40.378744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec8b0c-f1d8-4377-b40c-e32f1c856cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:40.379018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec8b0c-f1d8-4377-b40c-e32f1c856cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:40.437278 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-bdec8b0c-f1d8-4377-b40c-e32f1c856cb4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:02:40.438411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bdec8b0c-f1d8-4377-b40c-e32f1c856cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:40.519887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:40.530667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 754/1508] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:02:40.540351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d7f49-677b-4797-9468-e6d62a4aa7c2 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:40.541586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-526d7f49-677b-4797-9468-e6d62a4aa7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:40.641351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d7f49-677b-4797-9468-e6d62a4aa7c2 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:40.696398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:40.715888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cc75a-005f-4c59-a2b3-e743b2672672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:40.716552 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cc75a-005f-4c59-a2b3-e743b2672672 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:40.716838 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cc75a-005f-4c59-a2b3-e743b2672672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:40.717115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cc75a-005f-4c59-a2b3-e743b2672672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:40.718773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3d4cc75a-005f-4c59-a2b3-e743b2672672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:40.829153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cc75a-005f-4c59-a2b3-e743b2672672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:40.830625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cc75a-005f-4c59-a2b3-e743b2672672 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:40.849442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 755/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:02:41.324099 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec8b0c-f1d8-4377-b40c-e32f1c856cb4 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:02:41.325411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bdec8b0c-f1d8-4377-b40c-e32f1c856cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:02:41.337742 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec8b0c-f1d8-4377-b40c-e32f1c856cb4 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:02:41.439749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759486b-ce87-4b16-8dbb-9a4dce18fe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:02:41.442655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759486b-ce87-4b16-8dbb-9a4dce18fe42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:02:41.442655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759486b-ce87-4b16-8dbb-9a4dce18fe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:02:41.442655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759486b-ce87-4b16-8dbb-9a4dce18fe42 admin admin] PATH_INFO: `/v3/projects/920298e016b141679d70ba76a6e67c1b` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:02:41.450871 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759486b-ce87-4b16-8dbb-9a4dce18fe42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=920298e016b141679d70ba76a6e67c1b)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:02:41.451931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: WARNING py.warnings [None req-5759486b-ce87-4b16-8dbb-9a4dce18fe42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 14:02:41.451931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: warnings.warn(msg) Sep 01 14:02:41.451931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: Sep 01 14:02:41.453156 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759486b-ce87-4b16-8dbb-9a4dce18fe42 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:02:41.657167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-5759486b-ce87-4b16-8dbb-9a4dce18fe42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920298e016b141679d70ba76a6e67c1b', 'request_id': 'req-5759486b-ce87-4b16-8dbb-9a4dce18fe42'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:41.663395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-5759486b-ce87-4b16-8dbb-9a4dce18fe42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920298e016b141679d70ba76a6e67c1b', 'request_id': 'req-5759486b-ce87-4b16-8dbb-9a4dce18fe42'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:41.772827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-5759486b-ce87-4b16-8dbb-9a4dce18fe42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920298e016b141679d70ba76a6e67c1b', 'request_id': 'req-5759486b-ce87-4b16-8dbb-9a4dce18fe42'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:41.802719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-5759486b-ce87-4b16-8dbb-9a4dce18fe42 admin admin] The token cache is being invalidate because project 920298e016b141679d70ba76a6e67c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:02:41.803003 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-5759486b-ce87-4b16-8dbb-9a4dce18fe42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:41.803684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-5759486b-ce87-4b16-8dbb-9a4dce18fe42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:02:41.805600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 755/1510] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:02:41 2022] DELETE /identity/v3/projects/920298e016b141679d70ba76a6e67c1b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:02:50.846901 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=62 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:51.800738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:19.388552 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b31504-4a0b-42c7-92b0-a070208acdb2 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:19.419657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b31504-4a0b-42c7-92b0-a070208acdb2 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:19.419657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b31504-4a0b-42c7-92b0-a070208acdb2 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:19.419657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 14:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:04:19.420165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff42d62-4160-41d4-9e2d-7b393de79386 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:19.420165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff42d62-4160-41d4-9e2d-7b393de79386 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:19.420165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff42d62-4160-41d4-9e2d-7b393de79386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:19.487500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-2ff42d62-4160-41d4-9e2d-7b393de79386 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:04:19.488746 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2ff42d62-4160-41d4-9e2d-7b393de79386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:19.597867 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 14:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:04:19.753113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b31504-4a0b-42c7-92b0-a070208acdb2 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:04:19.755257 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-38b31504-4a0b-42c7-92b0-a070208acdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:19.874887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b31504-4a0b-42c7-92b0-a070208acdb2 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:04:19.880399 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7a3d9-2f0a-47c0-ad87-1cc97e63af18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:04:19.881003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7a3d9-2f0a-47c0-ad87-1cc97e63af18 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:19.881287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7a3d9-2f0a-47c0-ad87-1cc97e63af18 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:19.881561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7a3d9-2f0a-47c0-ad87-1cc97e63af18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:19.889528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7a3d9-2f0a-47c0-ad87-1cc97e63af18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:04:19.891109 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7a3d9-2f0a-47c0-ad87-1cc97e63af18 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:04:19.900667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 757/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:04:20.737102 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa99289-303d-4602-a96f-dd3d77e0f678 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:20.737834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa99289-303d-4602-a96f-dd3d77e0f678 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:20.737834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa99289-303d-4602-a96f-dd3d77e0f678 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:20.739013 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 14:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:04:20.743683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fe5fb-8efa-478c-bec5-f5226b5579dc None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:20.744169 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fe5fb-8efa-478c-bec5-f5226b5579dc None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:20.744276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fe5fb-8efa-478c-bec5-f5226b5579dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:20.764150 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-f85fe5fb-8efa-478c-bec5-f5226b5579dc None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:04:20.765358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f85fe5fb-8efa-478c-bec5-f5226b5579dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:20.774087 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 14:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:04:20.932681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa99289-303d-4602-a96f-dd3d77e0f678 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:04:20.947004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa99289-303d-4602-a96f-dd3d77e0f678 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:04:20.952478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99998f71-1695-4e6f-bf20-f96836035915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:04:20.953073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99998f71-1695-4e6f-bf20-f96836035915 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:20.953355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99998f71-1695-4e6f-bf20-f96836035915 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:20.953628 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99998f71-1695-4e6f-bf20-f96836035915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:20.962154 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99998f71-1695-4e6f-bf20-f96836035915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:04:20.963748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99998f71-1695-4e6f-bf20-f96836035915 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:04:20.974453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 758/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:04:21.325987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f8331-5c54-4a64-9d6b-1dd93ee965f8 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:21.326274 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f8331-5c54-4a64-9d6b-1dd93ee965f8 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:21.326551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f8331-5c54-4a64-9d6b-1dd93ee965f8 None None] PATH_INFO: `/v3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:21.327832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 759/1517] 10.222.0.69 () {54 vars in 925 bytes} [Thu Sep 1 14:04:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:04:21.333963 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd806bc-8c4b-4093-800c-43f6975699a0 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:21.334250 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd806bc-8c4b-4093-800c-43f6975699a0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:21.334519 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd806bc-8c4b-4093-800c-43f6975699a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:21.396231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-ffd806bc-8c4b-4093-800c-43f6975699a0 None None] MFA Rules not processed for user `cec4f437077c41039cae3d505b43b558`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:04:21.397433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ffd806bc-8c4b-4093-800c-43f6975699a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:21.414010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:21.474332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 759/1518] 10.222.0.69 () {58 vars in 1015 bytes} [Thu Sep 1 14:04:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:04:30.759067 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=56 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:31.292991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2146dc1-068d-4f8e-a2eb-421e00512fb7 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:31.293282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2146dc1-068d-4f8e-a2eb-421e00512fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:31.293559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2146dc1-068d-4f8e-a2eb-421e00512fb7 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:31.294896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 760/1519] 10.222.0.64 () {54 vars in 961 bytes} [Thu Sep 1 14:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:04:31.300372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56a67d-6ce2-4c3a-8067-71a1d59cdb2e None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:31.300948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56a67d-6ce2-4c3a-8067-71a1d59cdb2e None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:31.300948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56a67d-6ce2-4c3a-8067-71a1d59cdb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:31.321523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-be56a67d-6ce2-4c3a-8067-71a1d59cdb2e None None] MFA Rules not processed for user `cec4f437077c41039cae3d505b43b558`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:04:31.322796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-be56a67d-6ce2-4c3a-8067-71a1d59cdb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:31.331564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 760/1520] 10.222.0.64 () {58 vars in 1058 bytes} [Thu Sep 1 14:04:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:04:31.340093 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2146dc1-068d-4f8e-a2eb-421e00512fb7 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:04:31.353989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2146dc1-068d-4f8e-a2eb-421e00512fb7 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:04:31.358914 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba16b0-dc8d-4a66-911e-800f371ab0d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec4f437077c41039cae3d505b43b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:04:31.359556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba16b0-dc8d-4a66-911e-800f371ab0d7 service placement] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:31.359838 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba16b0-dc8d-4a66-911e-800f371ab0d7 service placement] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:31.360137 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba16b0-dc8d-4a66-911e-800f371ab0d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:31.370025 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba16b0-dc8d-4a66-911e-800f371ab0d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:04:31.371629 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba16b0-dc8d-4a66-911e-800f371ab0d7 service placement] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:04:31.382890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 761/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:04:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:04:32.233834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07219ae1-705a-45c6-95f2-587f40239192 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:32.237402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07219ae1-705a-45c6-95f2-587f40239192 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:32.237402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07219ae1-705a-45c6-95f2-587f40239192 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:32.237402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 14:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:04:32.241316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d896d63-a88d-4a3d-8e00-b48bc2030b66 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:32.241794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d896d63-a88d-4a3d-8e00-b48bc2030b66 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:32.241896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d896d63-a88d-4a3d-8e00-b48bc2030b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:32.261627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-6d896d63-a88d-4a3d-8e00-b48bc2030b66 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:04:32.262828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6d896d63-a88d-4a3d-8e00-b48bc2030b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:32.270696 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 14:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:04:32.432363 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07219ae1-705a-45c6-95f2-587f40239192 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:04:32.444309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07219ae1-705a-45c6-95f2-587f40239192 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:04:32.449741 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55765e45-b5aa-4e12-aeb3-c449fe923e05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:04:32.450333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55765e45-b5aa-4e12-aeb3-c449fe923e05 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:32.450612 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55765e45-b5aa-4e12-aeb3-c449fe923e05 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:32.450887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55765e45-b5aa-4e12-aeb3-c449fe923e05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:32.458956 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55765e45-b5aa-4e12-aeb3-c449fe923e05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:04:32.460614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55765e45-b5aa-4e12-aeb3-c449fe923e05 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:04:32.470122 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 762/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:04:33.320676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7e660-b4d0-47f5-a3a8-208c6fec94c5 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:33.321236 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7e660-b4d0-47f5-a3a8-208c6fec94c5 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:33.321579 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7e660-b4d0-47f5-a3a8-208c6fec94c5 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:33.323011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 14:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:04:33.327846 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba5fc2-247e-4a65-95f0-82631576b452 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:33.328164 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba5fc2-247e-4a65-95f0-82631576b452 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:33.328447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba5fc2-247e-4a65-95f0-82631576b452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:33.348524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-bdba5fc2-247e-4a65-95f0-82631576b452 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:04:33.349717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bdba5fc2-247e-4a65-95f0-82631576b452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:33.357540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 14:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:04:33.508924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7e660-b4d0-47f5-a3a8-208c6fec94c5 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:04:33.523804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7e660-b4d0-47f5-a3a8-208c6fec94c5 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:04:33.529383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93001e-4e1c-4cdf-b819-d2259e99b35b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:04:33.529981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93001e-4e1c-4cdf-b819-d2259e99b35b service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:33.530264 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93001e-4e1c-4cdf-b819-d2259e99b35b service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:33.530542 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93001e-4e1c-4cdf-b819-d2259e99b35b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:33.538778 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93001e-4e1c-4cdf-b819-d2259e99b35b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:04:33.540402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93001e-4e1c-4cdf-b819-d2259e99b35b service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:04:33.551628 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 764/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:04:37.571462 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51cb42-afd8-4044-8da1-1c2fb553affd None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:37.572058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51cb42-afd8-4044-8da1-1c2fb553affd None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:37.572058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51cb42-afd8-4044-8da1-1c2fb553affd None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:37.573408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 14:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:04:37.578795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34caa1-fac5-4f07-9052-479355acac88 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:37.581236 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34caa1-fac5-4f07-9052-479355acac88 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:37.581236 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34caa1-fac5-4f07-9052-479355acac88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:37.599307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-ae34caa1-fac5-4f07-9052-479355acac88 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:04:37.600543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ae34caa1-fac5-4f07-9052-479355acac88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:37.608437 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 14:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:04:37.898477 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51cb42-afd8-4044-8da1-1c2fb553affd None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:04:37.900222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6e51cb42-afd8-4044-8da1-1c2fb553affd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:37.978194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51cb42-afd8-4044-8da1-1c2fb553affd None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:04:37.981884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5de541-221c-43bd-bb4d-470e0aba74d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:04:37.982485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5de541-221c-43bd-bb4d-470e0aba74d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:37.982762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5de541-221c-43bd-bb4d-470e0aba74d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:37.983033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5de541-221c-43bd-bb4d-470e0aba74d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:37.992368 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5de541-221c-43bd-bb4d-470e0aba74d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:04:37.993791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5de541-221c-43bd-bb4d-470e0aba74d6 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:04:38.003071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 765/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:04:39.943614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f56a76-0912-4f09-a933-458774c09505 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:39.944270 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f56a76-0912-4f09-a933-458774c09505 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:39.944270 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f56a76-0912-4f09-a933-458774c09505 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:39.945545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 14:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:04:39.950777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76472a77-7e5c-4034-ac2d-b814aa3faec7 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:39.951217 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76472a77-7e5c-4034-ac2d-b814aa3faec7 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:39.951329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76472a77-7e5c-4034-ac2d-b814aa3faec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:39.972208 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-76472a77-7e5c-4034-ac2d-b814aa3faec7 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:04:39.973407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-76472a77-7e5c-4034-ac2d-b814aa3faec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:39.981897 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 14:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:04:40.284943 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f56a76-0912-4f09-a933-458774c09505 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:04:40.286660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-09f56a76-0912-4f09-a933-458774c09505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:40.299983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f56a76-0912-4f09-a933-458774c09505 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:04:40.303847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cfdbf-c6d0-4098-bfa2-21027e62d256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:04:40.304475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cfdbf-c6d0-4098-bfa2-21027e62d256 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:40.304757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cfdbf-c6d0-4098-bfa2-21027e62d256 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:40.305032 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cfdbf-c6d0-4098-bfa2-21027e62d256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:40.314435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cfdbf-c6d0-4098-bfa2-21027e62d256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:04:40.315897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cfdbf-c6d0-4098-bfa2-21027e62d256 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:04:40.325280 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 767/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:04:43.910166 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280a016-100f-462a-85b7-2a391b6ba900 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:43.910778 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280a016-100f-462a-85b7-2a391b6ba900 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:43.910778 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280a016-100f-462a-85b7-2a391b6ba900 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:43.912085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 14:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:04:43.918039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b54d3-b32a-46dd-8fc9-738bbc5a2cfd None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:43.918514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b54d3-b32a-46dd-8fc9-738bbc5a2cfd None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:43.918612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b54d3-b32a-46dd-8fc9-738bbc5a2cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:43.940643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-8a4b54d3-b32a-46dd-8fc9-738bbc5a2cfd None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:04:43.941849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-8a4b54d3-b32a-46dd-8fc9-738bbc5a2cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:43.949782 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 14:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:04:44.520259 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280a016-100f-462a-85b7-2a391b6ba900 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:04:44.521980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e280a016-100f-462a-85b7-2a391b6ba900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:44.587599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:44.601600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280a016-100f-462a-85b7-2a391b6ba900 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:04:44.605643 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e7e51-b736-4ad3-897b-58bafac10ba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:04:44.606258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e7e51-b736-4ad3-897b-58bafac10ba2 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:44.606535 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e7e51-b736-4ad3-897b-58bafac10ba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:44.606804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e7e51-b736-4ad3-897b-58bafac10ba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:44.615724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e7e51-b736-4ad3-897b-58bafac10ba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:04:44.617176 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e7e51-b736-4ad3-897b-58bafac10ba2 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:04:44.626761 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 768/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:04:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:04:46.581417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daa12d-a354-41b7-b680-339737c9e673 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:46.581962 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daa12d-a354-41b7-b680-339737c9e673 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:46.582085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27daa12d-a354-41b7-b680-339737c9e673 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:46.583399 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 14:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:04:46.588807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28159461-f5ea-4b87-aa91-bde1dc753a5a None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:46.589226 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28159461-f5ea-4b87-aa91-bde1dc753a5a None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:46.589361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28159461-f5ea-4b87-aa91-bde1dc753a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:46.609694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-28159461-f5ea-4b87-aa91-bde1dc753a5a None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:04:46.611438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-28159461-f5ea-4b87-aa91-bde1dc753a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:46.619260 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 14:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:04:47.172183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27daa12d-a354-41b7-b680-339737c9e673 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:04:47.174371 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-27daa12d-a354-41b7-b680-339737c9e673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:04:47.187330 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27daa12d-a354-41b7-b680-339737c9e673 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:04:47.191406 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a2f71-4def-496f-b85a-5e0682738a03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:04:47.192064 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a2f71-4def-496f-b85a-5e0682738a03 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:04:47.192351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a2f71-4def-496f-b85a-5e0682738a03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:04:47.192627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a2f71-4def-496f-b85a-5e0682738a03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:04:47.201547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a2f71-4def-496f-b85a-5e0682738a03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:04:47.203046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a2f71-4def-496f-b85a-5e0682738a03 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:04:47.212461 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 770/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:04:56.604822 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=11 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:57.208316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=33 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:21.726407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865d41b-8afc-4a7a-83bc-926e34e04900 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:21.728117 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865d41b-8afc-4a7a-83bc-926e34e04900 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:21.728117 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865d41b-8afc-4a7a-83bc-926e34e04900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:21.754367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6865d41b-8afc-4a7a-83bc-926e34e04900 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:21.755619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6865d41b-8afc-4a7a-83bc-926e34e04900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:21.768446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 770/1540] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:21.777707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e41f4-1159-454e-a495-ad5645c9e58c None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:21.778780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e41f4-1159-454e-a495-ad5645c9e58c None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:21.779309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e41f4-1159-454e-a495-ad5645c9e58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:21.810408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-697e41f4-1159-454e-a495-ad5645c9e58c None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:21.812114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-697e41f4-1159-454e-a495-ad5645c9e58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:21.826874 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 771/1541] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:06:21.832402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865d41b-8afc-4a7a-83bc-926e34e04900 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:21.848053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865d41b-8afc-4a7a-83bc-926e34e04900 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:21.851908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18fc2b-85a2-42d7-832b-2ea376b05526 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:21.853304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18fc2b-85a2-42d7-832b-2ea376b05526 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:21.855388 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18fc2b-85a2-42d7-832b-2ea376b05526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:21.861061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e163fa-867f-46a2-b5ed-12cef7909ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:21.862125 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e163fa-867f-46a2-b5ed-12cef7909ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:21.863275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e163fa-867f-46a2-b5ed-12cef7909ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:21.863784 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e163fa-867f-46a2-b5ed-12cef7909ff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:21.869728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e163fa-867f-46a2-b5ed-12cef7909ff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:06:21.871355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e163fa-867f-46a2-b5ed-12cef7909ff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:21.873291 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e163fa-867f-46a2-b5ed-12cef7909ff4 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:21.904382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-db18fc2b-85a2-42d7-832b-2ea376b05526 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:21.905108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 771/1542] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:06:21.910523 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-db18fc2b-85a2-42d7-832b-2ea376b05526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:21.919766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e163fa-867f-46a2-b5ed-12cef7909ff4 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:21.922790 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 772/1543] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:21.932777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297fa15-092c-4ebd-9fba-a12f5c9d8f95 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:21.934050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297fa15-092c-4ebd-9fba-a12f5c9d8f95 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:21.934798 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297fa15-092c-4ebd-9fba-a12f5c9d8f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:21.938214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e163fa-867f-46a2-b5ed-12cef7909ff4 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:21.951275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e5dcd-22e9-49e7-b232-1161bebbd52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:21.954362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5dcd-22e9-49e7-b232-1161bebbd52b admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:21.954935 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5dcd-22e9-49e7-b232-1161bebbd52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:21.955438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5dcd-22e9-49e7-b232-1161bebbd52b admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:21.956374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e5dcd-22e9-49e7-b232-1161bebbd52b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:21.957676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: WARNING py.warnings [None req-537e5dcd-22e9-49e7-b232-1161bebbd52b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 14:06:21.957676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: warnings.warn(msg) Sep 01 14:06:21.957676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: Sep 01 14:06:21.959605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e5dcd-22e9-49e7-b232-1161bebbd52b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:21.971092 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-d297fa15-092c-4ebd-9fba-a12f5c9d8f95 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:21.972887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d297fa15-092c-4ebd-9fba-a12f5c9d8f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:21.996872 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 773/1544] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:06:21.998736 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ddbb5-4a48-45bb-981a-e7dbf247ef68 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:21.999278 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ddbb5-4a48-45bb-981a-e7dbf247ef68 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:21.999797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ddbb5-4a48-45bb-981a-e7dbf247ef68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.025275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-960ddbb5-4a48-45bb-981a-e7dbf247ef68 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:22.027496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-960ddbb5-4a48-45bb-981a-e7dbf247ef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:22.037565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 774/1545] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:22.038858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43643327-bf63-43af-bed4-4962d307dff4 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.039266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43643327-bf63-43af-bed4-4962d307dff4 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.039443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43643327-bf63-43af-bed4-4962d307dff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.061080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-43643327-bf63-43af-bed4-4962d307dff4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:22.068256 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-43643327-bf63-43af-bed4-4962d307dff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:22.070670 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 775/1546] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:22.071911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cf07d-4b42-46ad-b319-b1ca0ee76c77 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.072201 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cf07d-4b42-46ad-b319-b1ca0ee76c77 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.072476 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cf07d-4b42-46ad-b319-b1ca0ee76c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.093227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-423cf07d-4b42-46ad-b319-b1ca0ee76c77 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:22.094490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-423cf07d-4b42-46ad-b319-b1ca0ee76c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:22.102729 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 776/1547] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:22.103968 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf956-134a-45e3-8741-248e78f20fa6 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.104258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf956-134a-45e3-8741-248e78f20fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.104533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5caf956-134a-45e3-8741-248e78f20fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.118267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 772/1548] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:21 2022] POST /identity/v3/projects => generated 363 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:06:22.118267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e5dcd-22e9-49e7-b232-1161bebbd52b admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:22.126770 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-b5caf956-134a-45e3-8741-248e78f20fa6 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:22.128101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b5caf956-134a-45e3-8741-248e78f20fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:22.200120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e5dcd-22e9-49e7-b232-1161bebbd52b admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:22.207470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968f4b8-15bf-4bc8-be58-6a7a4cc7acc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:22.207470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968f4b8-15bf-4bc8-be58-6a7a4cc7acc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.207470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968f4b8-15bf-4bc8-be58-6a7a4cc7acc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.207470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968f4b8-15bf-4bc8-be58-6a7a4cc7acc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.208217 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968f4b8-15bf-4bc8-be58-6a7a4cc7acc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:06:22.208388 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968f4b8-15bf-4bc8-be58-6a7a4cc7acc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:22.209942 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968f4b8-15bf-4bc8-be58-6a7a4cc7acc6 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:22.210837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 777/1549] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:22.212213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7e7c0-1c35-42f3-b12e-00db34c4d7f0 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.212504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7e7c0-1c35-42f3-b12e-00db34c4d7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.212862 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7e7c0-1c35-42f3-b12e-00db34c4d7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.232356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 773/1550] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:06:22.233672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f55eac-e65e-41f2-b88d-073dbe19319b None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.233966 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f55eac-e65e-41f2-b88d-073dbe19319b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.234244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f55eac-e65e-41f2-b88d-073dbe19319b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.234427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-49e7e7c0-1c35-42f3-b12e-00db34c4d7f0 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:22.235823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-49e7e7c0-1c35-42f3-b12e-00db34c4d7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:22.247011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 778/1551] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:22.248547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9230a28-3372-440a-ae45-ce0c1364adad None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.249210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9230a28-3372-440a-ae45-ce0c1364adad None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.249650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9230a28-3372-440a-ae45-ce0c1364adad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.258298 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-a0f55eac-e65e-41f2-b88d-073dbe19319b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:22.259518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a0f55eac-e65e-41f2-b88d-073dbe19319b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:22.268688 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 774/1552] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:22.269490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-b9230a28-3372-440a-ae45-ce0c1364adad None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:22.269946 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c2ccb-a9b8-4d52-ab65-5ef8cacec56a None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.270232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c2ccb-a9b8-4d52-ab65-5ef8cacec56a None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.270509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c2ccb-a9b8-4d52-ab65-5ef8cacec56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.270757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b9230a28-3372-440a-ae45-ce0c1364adad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:22.279323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 779/1553] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:22.280575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656427-e217-4acb-a759-c0be1df42b6e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.280857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656427-e217-4acb-a759-c0be1df42b6e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.281130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656427-e217-4acb-a759-c0be1df42b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.295040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-bf3c2ccb-a9b8-4d52-ab65-5ef8cacec56a None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:22.296300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bf3c2ccb-a9b8-4d52-ab65-5ef8cacec56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:22.301335 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-75656427-e217-4acb-a759-c0be1df42b6e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:22.302647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-75656427-e217-4acb-a759-c0be1df42b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:22.305335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 775/1554] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:22.306188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c2ccb-a9b8-4d52-ab65-5ef8cacec56a None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:22.315835 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 780/1555] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:22.317127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3d635-cb74-4f1e-b373-1b8fe906a5b9 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.317417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3d635-cb74-4f1e-b373-1b8fe906a5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.317697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3d635-cb74-4f1e-b373-1b8fe906a5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.325408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c2ccb-a9b8-4d52-ab65-5ef8cacec56a None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:22.330336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5f6a8-2639-49c7-88fd-8f08abfb7f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:22.331087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5f6a8-2639-49c7-88fd-8f08abfb7f9b admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.331374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5f6a8-2639-49c7-88fd-8f08abfb7f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.331648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5f6a8-2639-49c7-88fd-8f08abfb7f9b admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.332330 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5f6a8-2639-49c7-88fd-8f08abfb7f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:22.334345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5f6a8-2639-49c7-88fd-8f08abfb7f9b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:22.339884 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-b7a3d635-cb74-4f1e-b373-1b8fe906a5b9 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:22.341124 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b7a3d635-cb74-4f1e-b373-1b8fe906a5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:22.349821 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 781/1556] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:22.350633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3d635-cb74-4f1e-b373-1b8fe906a5b9 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:22.360804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3d635-cb74-4f1e-b373-1b8fe906a5b9 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:22.365832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060a460-77a1-401f-980a-ec935d1d9c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:22.366448 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060a460-77a1-401f-980a-ec935d1d9c1f admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.366730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060a460-77a1-401f-980a-ec935d1d9c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.367006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060a460-77a1-401f-980a-ec935d1d9c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.367645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060a460-77a1-401f-980a-ec935d1d9c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:22.369604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060a460-77a1-401f-980a-ec935d1d9c1f admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:22.512981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 776/1557] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/users => generated 282 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:22.513922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80ff7a-3e12-48f4-a411-ab4f85f3b7df None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.514278 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80ff7a-3e12-48f4-a411-ab4f85f3b7df None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.514615 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80ff7a-3e12-48f4-a411-ab4f85f3b7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.537703 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-0a80ff7a-3e12-48f4-a411-ab4f85f3b7df None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:22.544607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-0a80ff7a-3e12-48f4-a411-ab4f85f3b7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:22.544753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 782/1558] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/projects => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:22.544753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b24d-aae2-442b-8315-2bd947a29e01 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.544753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b24d-aae2-442b-8315-2bd947a29e01 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.544753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689b24d-aae2-442b-8315-2bd947a29e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.563815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-0689b24d-aae2-442b-8315-2bd947a29e01 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:22.565267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0689b24d-aae2-442b-8315-2bd947a29e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:22.605598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 777/1559] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:22.606274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80ff7a-3e12-48f4-a411-ab4f85f3b7df None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:22.616485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80ff7a-3e12-48f4-a411-ab4f85f3b7df None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:22.621230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543c75-c02a-4287-b0f3-62395f7d7d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:22.621912 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543c75-c02a-4287-b0f3-62395f7d7d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.622140 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543c75-c02a-4287-b0f3-62395f7d7d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.622397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543c75-c02a-4287-b0f3-62395f7d7d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.623063 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f543c75-c02a-4287-b0f3-62395f7d7d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:06:22.623363 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f543c75-c02a-4287-b0f3-62395f7d7d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:22.625126 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f543c75-c02a-4287-b0f3-62395f7d7d6b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:22.633762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:22.634073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 783/1560] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:22.635030 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689b24d-aae2-442b-8315-2bd947a29e01 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:22.638416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 778/1561] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:06:22.639426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543c75-c02a-4287-b0f3-62395f7d7d6b admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:22.649090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543c75-c02a-4287-b0f3-62395f7d7d6b admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:22.649289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689b24d-aae2-442b-8315-2bd947a29e01 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:22.653851 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39babac9-72e6-4432-8a65-ab1fb4835a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:22.654312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd359e4c-f0ec-40a2-8716-94136fcbd8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:22.654456 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39babac9-72e6-4432-8a65-ab1fb4835a3d admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.654701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39babac9-72e6-4432-8a65-ab1fb4835a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.654978 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39babac9-72e6-4432-8a65-ab1fb4835a3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.655074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd359e4c-f0ec-40a2-8716-94136fcbd8ed admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.655356 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd359e4c-f0ec-40a2-8716-94136fcbd8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.655607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39babac9-72e6-4432-8a65-ab1fb4835a3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:06:22.655705 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd359e4c-f0ec-40a2-8716-94136fcbd8ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.655943 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39babac9-72e6-4432-8a65-ab1fb4835a3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:22.656300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd359e4c-f0ec-40a2-8716-94136fcbd8ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:06:22.656609 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd359e4c-f0ec-40a2-8716-94136fcbd8ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:22.657519 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39babac9-72e6-4432-8a65-ab1fb4835a3d admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:22.657628 dv-cinder-852211-7-smb devstack@keystone.service[81700]: WARNING py.warnings [None req-fd359e4c-f0ec-40a2-8716-94136fcbd8ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 14:06:22.657628 dv-cinder-852211-7-smb devstack@keystone.service[81700]: warnings.warn(msg) Sep 01 14:06:22.657628 dv-cinder-852211-7-smb devstack@keystone.service[81700]: Sep 01 14:06:22.658524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd359e4c-f0ec-40a2-8716-94136fcbd8ed admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:22.670801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 779/1562] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:06:22.671688 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39babac9-72e6-4432-8a65-ab1fb4835a3d admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:22.671811 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:22.681434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 784/1563] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:06:22.681614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39babac9-72e6-4432-8a65-ab1fb4835a3d admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:22.682703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd359e4c-f0ec-40a2-8716-94136fcbd8ed admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:22.687037 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5df74f-a4b5-46a2-b76d-e3ec6ca05f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:22.687808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df74f-a4b5-46a2-b76d-e3ec6ca05f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.688064 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df74f-a4b5-46a2-b76d-e3ec6ca05f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.688266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df74f-a4b5-46a2-b76d-e3ec6ca05f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.688914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5df74f-a4b5-46a2-b76d-e3ec6ca05f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:06:22.689223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5df74f-a4b5-46a2-b76d-e3ec6ca05f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:22.690822 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5df74f-a4b5-46a2-b76d-e3ec6ca05f80 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:22.693979 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd359e4c-f0ec-40a2-8716-94136fcbd8ed admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:22.698562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c013c70-8728-416d-aa63-560093f05755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:22.699166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c013c70-8728-416d-aa63-560093f05755 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.699457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c013c70-8728-416d-aa63-560093f05755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.699720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c013c70-8728-416d-aa63-560093f05755 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.700383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c013c70-8728-416d-aa63-560093f05755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:22.701964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c013c70-8728-416d-aa63-560093f05755 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:22.706214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 780/1564] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:06:22.707053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5df74f-a4b5-46a2-b76d-e3ec6ca05f80 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:22.718502 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 785/1565] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:22.718502 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c013c70-8728-416d-aa63-560093f05755 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:22.721903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5df74f-a4b5-46a2-b76d-e3ec6ca05f80 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:22.726653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f3db3-d17c-4ad7-8a46-f610590cdf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:22.727292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c013c70-8728-416d-aa63-560093f05755 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:22.727411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f3db3-d17c-4ad7-8a46-f610590cdf14 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.727509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f3db3-d17c-4ad7-8a46-f610590cdf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.727784 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f3db3-d17c-4ad7-8a46-f610590cdf14 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.728439 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f3db3-d17c-4ad7-8a46-f610590cdf14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:22.730993 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f3db3-d17c-4ad7-8a46-f610590cdf14 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:22.732368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0afd1-d8a7-447c-9fc4-12dd2bf30886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:22.732967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0afd1-d8a7-447c-9fc4-12dd2bf30886 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.733251 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0afd1-d8a7-447c-9fc4-12dd2bf30886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.733565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0afd1-d8a7-447c-9fc4-12dd2bf30886 admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.734170 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0afd1-d8a7-447c-9fc4-12dd2bf30886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:06:22.734473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0afd1-d8a7-447c-9fc4-12dd2bf30886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:22.736250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0afd1-d8a7-447c-9fc4-12dd2bf30886 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:22.751842 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 786/1566] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:06:22.752787 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0afd1-d8a7-447c-9fc4-12dd2bf30886 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:22.762596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0afd1-d8a7-447c-9fc4-12dd2bf30886 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:22.767262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed3e7-eee8-46ac-9d06-7615ea9b942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:22.767801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed3e7-eee8-46ac-9d06-7615ea9b942d admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.768117 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed3e7-eee8-46ac-9d06-7615ea9b942d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.768395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed3e7-eee8-46ac-9d06-7615ea9b942d admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.769032 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaed3e7-eee8-46ac-9d06-7615ea9b942d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:06:22.769339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaed3e7-eee8-46ac-9d06-7615ea9b942d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:22.771474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaed3e7-eee8-46ac-9d06-7615ea9b942d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:22.784620 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 787/1567] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:06:22.785566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed3e7-eee8-46ac-9d06-7615ea9b942d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:22.795940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed3e7-eee8-46ac-9d06-7615ea9b942d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:22.800582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da008e0-7a81-47b5-8501-615138b0c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:22.801144 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da008e0-7a81-47b5-8501-615138b0c0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.801430 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da008e0-7a81-47b5-8501-615138b0c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.801704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da008e0-7a81-47b5-8501-615138b0c0e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.802368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da008e0-7a81-47b5-8501-615138b0c0e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:22.804302 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da008e0-7a81-47b5-8501-615138b0c0e3 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:22.863615 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 781/1568] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:22.864309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f3db3-d17c-4ad7-8a46-f610590cdf14 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:22.873744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f3db3-d17c-4ad7-8a46-f610590cdf14 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:22.878467 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356096-7b88-40f1-92d8-99e62d4662b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:22.879090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356096-7b88-40f1-92d8-99e62d4662b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.879379 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356096-7b88-40f1-92d8-99e62d4662b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.879655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70356096-7b88-40f1-92d8-99e62d4662b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.880321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70356096-7b88-40f1-92d8-99e62d4662b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:22.882231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70356096-7b88-40f1-92d8-99e62d4662b5 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:22.910003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 788/1569] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:22.910890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da008e0-7a81-47b5-8501-615138b0c0e3 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:22.973496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da008e0-7a81-47b5-8501-615138b0c0e3 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:22.978178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa26d0-55c4-49f7-afb1-ea8026b57e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:22.981360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa26d0-55c4-49f7-afb1-ea8026b57e78 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:22.981360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa26d0-55c4-49f7-afb1-ea8026b57e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:22.981360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa26d0-55c4-49f7-afb1-ea8026b57e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:22.981360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa26d0-55c4-49f7-afb1-ea8026b57e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:22.981982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa26d0-55c4-49f7-afb1-ea8026b57e78 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:22.985311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 782/1570] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:22.986233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356096-7b88-40f1-92d8-99e62d4662b5 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:23.058528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70356096-7b88-40f1-92d8-99e62d4662b5 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:23.058528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e79ac-71ca-4f25-a29a-e5c68bb37094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:23.058528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e79ac-71ca-4f25-a29a-e5c68bb37094 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:23.058528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e79ac-71ca-4f25-a29a-e5c68bb37094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:23.058877 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e79ac-71ca-4f25-a29a-e5c68bb37094 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:23.059259 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e79ac-71ca-4f25-a29a-e5c68bb37094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:23.061231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e79ac-71ca-4f25-a29a-e5c68bb37094 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:23.098942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 789/1571] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:23.099765 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa26d0-55c4-49f7-afb1-ea8026b57e78 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:23.167195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa26d0-55c4-49f7-afb1-ea8026b57e78 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:23.171937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27d016-40eb-4a75-8756-4b7635ba1f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:23.172693 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27d016-40eb-4a75-8756-4b7635ba1f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:23.173092 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27d016-40eb-4a75-8756-4b7635ba1f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:23.173367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27d016-40eb-4a75-8756-4b7635ba1f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:23.174014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27d016-40eb-4a75-8756-4b7635ba1f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:23.175618 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27d016-40eb-4a75-8756-4b7635ba1f89 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:23.186259 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 790/1572] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:23.187034 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27d016-40eb-4a75-8756-4b7635ba1f89 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:23.196554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27d016-40eb-4a75-8756-4b7635ba1f89 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:23.201641 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69ab23-d6b8-4e2e-ab45-7be40b0554d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:23.203832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69ab23-d6b8-4e2e-ab45-7be40b0554d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:23.203832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69ab23-d6b8-4e2e-ab45-7be40b0554d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:23.203832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69ab23-d6b8-4e2e-ab45-7be40b0554d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:23.203832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69ab23-d6b8-4e2e-ab45-7be40b0554d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:23.205242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69ab23-d6b8-4e2e-ab45-7be40b0554d9 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:23.247356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 783/1573] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:22 2022] POST /identity/v3/projects => generated 355 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:23.248201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e79ac-71ca-4f25-a29a-e5c68bb37094 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:23.312092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e79ac-71ca-4f25-a29a-e5c68bb37094 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:23.316664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b62fea-c82f-4819-b713-7aad1785c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:23.317275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b62fea-c82f-4819-b713-7aad1785c56d admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:23.317557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b62fea-c82f-4819-b713-7aad1785c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:23.317832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b62fea-c82f-4819-b713-7aad1785c56d admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:23.318461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b62fea-c82f-4819-b713-7aad1785c56d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:23.320401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b62fea-c82f-4819-b713-7aad1785c56d admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:23.356312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:23.362775 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 791/1574] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:23 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:23.363754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69ab23-d6b8-4e2e-ab45-7be40b0554d9 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:23.423295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69ab23-d6b8-4e2e-ab45-7be40b0554d9 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:23.428257 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893dd7d6-52cf-498a-88cc-653bdf4775c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:23.428902 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dd7d6-52cf-498a-88cc-653bdf4775c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:23.429197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dd7d6-52cf-498a-88cc-653bdf4775c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:23.429474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dd7d6-52cf-498a-88cc-653bdf4775c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:23.430124 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dd7d6-52cf-498a-88cc-653bdf4775c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:23.431774 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dd7d6-52cf-498a-88cc-653bdf4775c0 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:23.439785 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 784/1575] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:23 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:23.439785 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b62fea-c82f-4819-b713-7aad1785c56d admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:23.444100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 792/1576] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:23.444100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893dd7d6-52cf-498a-88cc-653bdf4775c0 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:23.446445 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:23.454906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893dd7d6-52cf-498a-88cc-653bdf4775c0 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:23.502777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b62fea-c82f-4819-b713-7aad1785c56d admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:23.507685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989eb72b-c8ee-4721-b9ed-f34672319249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:23.508404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eb72b-c8ee-4721-b9ed-f34672319249 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:23.508764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eb72b-c8ee-4721-b9ed-f34672319249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:23.509116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eb72b-c8ee-4721-b9ed-f34672319249 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:23.509821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989eb72b-c8ee-4721-b9ed-f34672319249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:23.511987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f7881-5c67-47db-83cd-19d935c02c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:23.512568 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989eb72b-c8ee-4721-b9ed-f34672319249 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:23.512670 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f7881-5c67-47db-83cd-19d935c02c51 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:23.512886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f7881-5c67-47db-83cd-19d935c02c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:23.513152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f7881-5c67-47db-83cd-19d935c02c51 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:23.513764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f7881-5c67-47db-83cd-19d935c02c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:23.514762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: WARNING py.warnings [None req-c37f7881-5c67-47db-83cd-19d935c02c51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 14:06:23.514762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: warnings.warn(msg) Sep 01 14:06:23.514762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: Sep 01 14:06:23.516016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f7881-5c67-47db-83cd-19d935c02c51 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:23.702305 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 793/1577] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:23 2022] POST /identity/v3/users => generated 290 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:23.702305 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f7881-5c67-47db-83cd-19d935c02c51 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:23.702808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 785/1578] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:23 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:23.702808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989eb72b-c8ee-4721-b9ed-f34672319249 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:23.711988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f7881-5c67-47db-83cd-19d935c02c51 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:23.712144 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989eb72b-c8ee-4721-b9ed-f34672319249 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:23.716980 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d265c-418f-4232-a5d5-bd5a39dfb7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:23.717269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a5684-2a9b-457f-81fd-432485b6e0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:23.717580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d265c-418f-4232-a5d5-bd5a39dfb7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:23.717864 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d265c-418f-4232-a5d5-bd5a39dfb7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:23.717969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a5684-2a9b-457f-81fd-432485b6e0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:23.718138 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d265c-418f-4232-a5d5-bd5a39dfb7c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:23.718244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a5684-2a9b-457f-81fd-432485b6e0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:23.718430 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a5684-2a9b-457f-81fd-432485b6e0ff admin admin] PATH_INFO: `/v3/projects/8ff53148106a45bfbdab940059811d17/users/dbbe63616dfb435cab0b0cdfe3c6b098/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:23.719048 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d265c-418f-4232-a5d5-bd5a39dfb7c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:23.720729 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d265c-418f-4232-a5d5-bd5a39dfb7c5 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:23.734569 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a5684-2a9b-457f-81fd-432485b6e0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff53148106a45bfbdab940059811d17, user_id=dbbe63616dfb435cab0b0cdfe3c6b098, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:23.735631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: WARNING py.warnings [None req-893a5684-2a9b-457f-81fd-432485b6e0ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 14:06:23.735631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: warnings.warn(msg) Sep 01 14:06:23.735631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: Sep 01 14:06:23.737660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a5684-2a9b-457f-81fd-432485b6e0ff admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:23.938650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 786/1579] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:23 2022] PUT /identity/v3/projects/8ff53148106a45bfbdab940059811d17/users/dbbe63616dfb435cab0b0cdfe3c6b098/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:23.939623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a5684-2a9b-457f-81fd-432485b6e0ff admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:23.942108 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 794/1580] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:23 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:23.943085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d265c-418f-4232-a5d5-bd5a39dfb7c5 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:23.964841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d265c-418f-4232-a5d5-bd5a39dfb7c5 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.013899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a5684-2a9b-457f-81fd-432485b6e0ff admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.015609 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958d36e-eb1b-457f-9037-5d21955d702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.016268 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d36e-eb1b-457f-9037-5d21955d702e admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.027923 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d36e-eb1b-457f-9037-5d21955d702e admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.027923 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d36e-eb1b-457f-9037-5d21955d702e admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.027923 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958d36e-eb1b-457f-9037-5d21955d702e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.028205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59778d-c260-4c0b-9557-fb2a4072b9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.028310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958d36e-eb1b-457f-9037-5d21955d702e admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.028398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59778d-c260-4c0b-9557-fb2a4072b9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.028398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59778d-c260-4c0b-9557-fb2a4072b9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.028398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59778d-c260-4c0b-9557-fb2a4072b9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.028398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59778d-c260-4c0b-9557-fb2a4072b9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.028398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59778d-c260-4c0b-9557-fb2a4072b9e2 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.133028 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:24.139229 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 787/1581] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:23 2022] POST /identity/v3/users => generated 278 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:24.141745 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59778d-c260-4c0b-9557-fb2a4072b9e2 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.141854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 795/1582] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:23 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:24.141854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958d36e-eb1b-457f-9037-5d21955d702e admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.151625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958d36e-eb1b-457f-9037-5d21955d702e admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.155288 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59778d-c260-4c0b-9557-fb2a4072b9e2 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.157006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e64459-2de5-455b-9ee6-1a9cc59b98aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.157615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e64459-2de5-455b-9ee6-1a9cc59b98aa admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.157898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e64459-2de5-455b-9ee6-1a9cc59b98aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.158174 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e64459-2de5-455b-9ee6-1a9cc59b98aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.158886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e64459-2de5-455b-9ee6-1a9cc59b98aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.160434 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fadf1-5115-49ea-9ff1-4fbfaaccc1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.160563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e64459-2de5-455b-9ee6-1a9cc59b98aa admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.161044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fadf1-5115-49ea-9ff1-4fbfaaccc1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.161329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fadf1-5115-49ea-9ff1-4fbfaaccc1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.161605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fadf1-5115-49ea-9ff1-4fbfaaccc1f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.162247 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fadf1-5115-49ea-9ff1-4fbfaaccc1f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.164260 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fadf1-5115-49ea-9ff1-4fbfaaccc1f4 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.171738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 796/1583] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:24.172714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e64459-2de5-455b-9ee6-1a9cc59b98aa admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.184872 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e64459-2de5-455b-9ee6-1a9cc59b98aa admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.189396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88785382-972a-4580-8134-d74e8507c4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.189982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88785382-972a-4580-8134-d74e8507c4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.190262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88785382-972a-4580-8134-d74e8507c4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.190532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88785382-972a-4580-8134-d74e8507c4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.191157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88785382-972a-4580-8134-d74e8507c4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.192766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88785382-972a-4580-8134-d74e8507c4b5 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.202965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 797/1584] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:24.203771 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88785382-972a-4580-8134-d74e8507c4b5 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.213928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88785382-972a-4580-8134-d74e8507c4b5 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.218503 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddcb6a-2df1-4bc7-9cb3-afe5b7e85000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.219045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddcb6a-2df1-4bc7-9cb3-afe5b7e85000 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.219328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddcb6a-2df1-4bc7-9cb3-afe5b7e85000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.219605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddcb6a-2df1-4bc7-9cb3-afe5b7e85000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.220273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddcb6a-2df1-4bc7-9cb3-afe5b7e85000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.221947 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddcb6a-2df1-4bc7-9cb3-afe5b7e85000 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.231615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 798/1585] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:24.232419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddcb6a-2df1-4bc7-9cb3-afe5b7e85000 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.241618 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddcb6a-2df1-4bc7-9cb3-afe5b7e85000 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.246719 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae730d96-5380-49cd-bbb4-cc330735a882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.247292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae730d96-5380-49cd-bbb4-cc330735a882 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.247574 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae730d96-5380-49cd-bbb4-cc330735a882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.247848 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae730d96-5380-49cd-bbb4-cc330735a882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.248491 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae730d96-5380-49cd-bbb4-cc330735a882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.250047 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae730d96-5380-49cd-bbb4-cc330735a882 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.260303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 799/1586] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:24.262051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd038a2-40b3-4fa5-9a2e-46750597e744 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.262538 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd038a2-40b3-4fa5-9a2e-46750597e744 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.262650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd038a2-40b3-4fa5-9a2e-46750597e744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.286933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 788/1587] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:24 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:24.289366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fadf1-5115-49ea-9ff1-4fbfaaccc1f4 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.293893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1dd038a2-40b3-4fa5-9a2e-46750597e744 None None] MFA Rules not processed for user `dbbe63616dfb435cab0b0cdfe3c6b098`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:24.295163 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1dd038a2-40b3-4fa5-9a2e-46750597e744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:24.298333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fadf1-5115-49ea-9ff1-4fbfaaccc1f4 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.303063 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bc505-db51-4832-add9-269fb94560cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.303671 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bc505-db51-4832-add9-269fb94560cb admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.303982 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bc505-db51-4832-add9-269fb94560cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.304260 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bc505-db51-4832-add9-269fb94560cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.304906 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2bc505-db51-4832-add9-269fb94560cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.306518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2bc505-db51-4832-add9-269fb94560cb admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.317207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 789/1588] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:24.318025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bc505-db51-4832-add9-269fb94560cb admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.327450 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bc505-db51-4832-add9-269fb94560cb admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.332258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3963da6-f363-4b6f-b089-0eb43e45cc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.332959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3963da6-f363-4b6f-b089-0eb43e45cc89 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.333246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3963da6-f363-4b6f-b089-0eb43e45cc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.333574 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3963da6-f363-4b6f-b089-0eb43e45cc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.334212 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3963da6-f363-4b6f-b089-0eb43e45cc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.335885 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3963da6-f363-4b6f-b089-0eb43e45cc89 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.346992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 790/1589] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:24.347920 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3963da6-f363-4b6f-b089-0eb43e45cc89 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.358197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3963da6-f363-4b6f-b089-0eb43e45cc89 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.363933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50636284-7a16-465f-a93a-a89e3c542ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.364585 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50636284-7a16-465f-a93a-a89e3c542ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.364864 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50636284-7a16-465f-a93a-a89e3c542ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.365141 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50636284-7a16-465f-a93a-a89e3c542ee6 admin admin] PATH_INFO: `/v3/projects/742adedaed5249168c4254a24554762c/users/f48ccec319ea4ecaba227a46dea29c80/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.365699 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 800/1590] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:24.366413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd038a2-40b3-4fa5-9a2e-46750597e744 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.379405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd038a2-40b3-4fa5-9a2e-46750597e744 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.385804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50636284-7a16-465f-a93a-a89e3c542ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=742adedaed5249168c4254a24554762c, user_id=f48ccec319ea4ecaba227a46dea29c80, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.388662 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50636284-7a16-465f-a93a-a89e3c542ee6 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.389477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f1261-5c57-4945-8fa2-f3b061ea4e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.390235 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f1261-5c57-4945-8fa2-f3b061ea4e8e admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.390598 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f1261-5c57-4945-8fa2-f3b061ea4e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.390931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f1261-5c57-4945-8fa2-f3b061ea4e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.391659 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f1261-5c57-4945-8fa2-f3b061ea4e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.392141 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:24.393982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f1261-5c57-4945-8fa2-f3b061ea4e8e admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.406946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 801/1591] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:24.411363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f1261-5c57-4945-8fa2-f3b061ea4e8e admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.418949 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f1261-5c57-4945-8fa2-f3b061ea4e8e admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.423781 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490c7cb-cb91-4b42-a3ae-e88190700b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.424421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490c7cb-cb91-4b42-a3ae-e88190700b66 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.424703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490c7cb-cb91-4b42-a3ae-e88190700b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.424977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490c7cb-cb91-4b42-a3ae-e88190700b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.425611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490c7cb-cb91-4b42-a3ae-e88190700b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.427356 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490c7cb-cb91-4b42-a3ae-e88190700b66 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.437508 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 802/1592] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:24.438295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490c7cb-cb91-4b42-a3ae-e88190700b66 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.447751 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490c7cb-cb91-4b42-a3ae-e88190700b66 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.452603 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097323c-6588-4f35-9d9e-fc16a89cea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.453188 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097323c-6588-4f35-9d9e-fc16a89cea41 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.453470 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097323c-6588-4f35-9d9e-fc16a89cea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.453748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097323c-6588-4f35-9d9e-fc16a89cea41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.454373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097323c-6588-4f35-9d9e-fc16a89cea41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.456382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097323c-6588-4f35-9d9e-fc16a89cea41 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.468774 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 803/1593] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:24.469517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097323c-6588-4f35-9d9e-fc16a89cea41 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.478497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 791/1594] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:24 2022] PUT /identity/v3/projects/742adedaed5249168c4254a24554762c/users/f48ccec319ea4ecaba227a46dea29c80/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:24.479187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097323c-6588-4f35-9d9e-fc16a89cea41 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.479391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50636284-7a16-465f-a93a-a89e3c542ee6 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.538631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0188a9-a131-4ff5-b819-c79845f288a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.539280 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0188a9-a131-4ff5-b819-c79845f288a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.540168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0188a9-a131-4ff5-b819-c79845f288a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.540464 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0188a9-a131-4ff5-b819-c79845f288a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.541129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0188a9-a131-4ff5-b819-c79845f288a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.543665 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0188a9-a131-4ff5-b819-c79845f288a3 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.553656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50636284-7a16-465f-a93a-a89e3c542ee6 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.557847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 804/1595] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:24.557847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0188a9-a131-4ff5-b819-c79845f288a3 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.558698 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa8794-5689-492f-9f04-886b6df469d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.559392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa8794-5689-492f-9f04-886b6df469d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.559671 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa8794-5689-492f-9f04-886b6df469d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.559972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa8794-5689-492f-9f04-886b6df469d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.560607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa8794-5689-492f-9f04-886b6df469d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.562188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa8794-5689-492f-9f04-886b6df469d5 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.565678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0188a9-a131-4ff5-b819-c79845f288a3 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.570542 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b92216-6da2-49c7-a6d8-ccf56f638dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.571137 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b92216-6da2-49c7-a6d8-ccf56f638dae admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.571419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b92216-6da2-49c7-a6d8-ccf56f638dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.571732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b92216-6da2-49c7-a6d8-ccf56f638dae admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.572426 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b92216-6da2-49c7-a6d8-ccf56f638dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.577414 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 792/1596] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:24.577564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b92216-6da2-49c7-a6d8-ccf56f638dae admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.577679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa8794-5689-492f-9f04-886b6df469d5 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.577773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:24.586463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa8794-5689-492f-9f04-886b6df469d5 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.587308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 805/1597] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:24.591266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b92216-6da2-49c7-a6d8-ccf56f638dae admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.591671 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16266433-73f3-49fc-b469-a9af0ae4ee76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.592315 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16266433-73f3-49fc-b469-a9af0ae4ee76 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.592604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16266433-73f3-49fc-b469-a9af0ae4ee76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.592881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16266433-73f3-49fc-b469-a9af0ae4ee76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.593584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16266433-73f3-49fc-b469-a9af0ae4ee76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.595502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16266433-73f3-49fc-b469-a9af0ae4ee76 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.598043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b92216-6da2-49c7-a6d8-ccf56f638dae admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.602738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf5106-94f9-4e34-bb89-ef8be9407330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.603421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5106-94f9-4e34-bb89-ef8be9407330 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.603749 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5106-94f9-4e34-bb89-ef8be9407330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.604166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5106-94f9-4e34-bb89-ef8be9407330 admin admin] PATH_INFO: `/v3/projects/5e805ffe19644a489c6a406729062b24/users/6e998aa9209342ad8cd504c440273c3b/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.619827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf5106-94f9-4e34-bb89-ef8be9407330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e805ffe19644a489c6a406729062b24, user_id=6e998aa9209342ad8cd504c440273c3b, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.623133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf5106-94f9-4e34-bb89-ef8be9407330 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.683984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 793/1598] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:24 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:24.683984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16266433-73f3-49fc-b469-a9af0ae4ee76 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.723533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 806/1599] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:24 2022] PUT /identity/v3/projects/5e805ffe19644a489c6a406729062b24/users/6e998aa9209342ad8cd504c440273c3b/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:24.724750 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf5106-94f9-4e34-bb89-ef8be9407330 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.750813 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16266433-73f3-49fc-b469-a9af0ae4ee76 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.791761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf5106-94f9-4e34-bb89-ef8be9407330 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:24.797254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7ce43-48bd-4661-902f-1e27b20f30b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.797908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7ce43-48bd-4661-902f-1e27b20f30b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.798189 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7ce43-48bd-4661-902f-1e27b20f30b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.798472 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7ce43-48bd-4661-902f-1e27b20f30b6 admin admin] PATH_INFO: `/v3/projects/ec831d080adc4d5cabe9df5b81a81958/users/9b6dee114b0b4db3ac98075847d613c5/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.807423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad01a88-3edf-4d90-8005-5619e21f2380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:24.808650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad01a88-3edf-4d90-8005-5619e21f2380 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.808932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad01a88-3edf-4d90-8005-5619e21f2380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.809207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad01a88-3edf-4d90-8005-5619e21f2380 admin admin] PATH_INFO: `/v3/projects/3b4abbd87d2345438f246a98f5a0d011/users/50b3952a90ce47f48cc0a820111604f0/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.814185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7ce43-48bd-4661-902f-1e27b20f30b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec831d080adc4d5cabe9df5b81a81958, user_id=9b6dee114b0b4db3ac98075847d613c5, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.817224 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7ce43-48bd-4661-902f-1e27b20f30b6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.824115 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad01a88-3edf-4d90-8005-5619e21f2380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b4abbd87d2345438f246a98f5a0d011, user_id=50b3952a90ce47f48cc0a820111604f0, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:24.826782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad01a88-3edf-4d90-8005-5619e21f2380 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:24.926395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 807/1600] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:24 2022] PUT /identity/v3/projects/ec831d080adc4d5cabe9df5b81a81958/users/9b6dee114b0b4db3ac98075847d613c5/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:24.927739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547e8d3-3794-4e0f-b45f-d92e61801302 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:24.928062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547e8d3-3794-4e0f-b45f-d92e61801302 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:24.928340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547e8d3-3794-4e0f-b45f-d92e61801302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:24.945256 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:24.951253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 794/1601] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:24 2022] PUT /identity/v3/projects/3b4abbd87d2345438f246a98f5a0d011/users/50b3952a90ce47f48cc0a820111604f0/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:24.952165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad01a88-3edf-4d90-8005-5619e21f2380 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:24.958336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-7547e8d3-3794-4e0f-b45f-d92e61801302 None None] MFA Rules not processed for user `f48ccec319ea4ecaba227a46dea29c80`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:24.959638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-7547e8d3-3794-4e0f-b45f-d92e61801302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:25.015491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad01a88-3edf-4d90-8005-5619e21f2380 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:25.020296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a620cc-15c9-4590-af9a-b5761d395413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:25.020916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a620cc-15c9-4590-af9a-b5761d395413 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.021201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a620cc-15c9-4590-af9a-b5761d395413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.021492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a620cc-15c9-4590-af9a-b5761d395413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.022161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a620cc-15c9-4590-af9a-b5761d395413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:25.023761 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a620cc-15c9-4590-af9a-b5761d395413 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:25.026997 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 808/1602] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:25.027698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547e8d3-3794-4e0f-b45f-d92e61801302 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:25.034246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 795/1603] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:25.034953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a620cc-15c9-4590-af9a-b5761d395413 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:25.042378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547e8d3-3794-4e0f-b45f-d92e61801302 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:25.046112 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a620cc-15c9-4590-af9a-b5761d395413 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:25.046969 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c18af-9a25-428e-9555-e19a64773e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:25.047632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c18af-9a25-428e-9555-e19a64773e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.047947 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c18af-9a25-428e-9555-e19a64773e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.048227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c18af-9a25-428e-9555-e19a64773e75 admin admin] PATH_INFO: `/v3/projects/947f0d0fbc694b1fb9699f42c6bda2f8/users/ada1059f4b50410f902be538d26a94fc/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.051573 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e2a4f-2844-4965-aed2-a1268ba653b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:25.052266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e2a4f-2844-4965-aed2-a1268ba653b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.055498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e2a4f-2844-4965-aed2-a1268ba653b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.055498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e2a4f-2844-4965-aed2-a1268ba653b5 admin admin] PATH_INFO: `/v3/projects/4379f93c234c401fa5a0e1329e113833/users/d7956f61efc44be8abbce5033cc95849/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.064522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c18af-9a25-428e-9555-e19a64773e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947f0d0fbc694b1fb9699f42c6bda2f8, user_id=ada1059f4b50410f902be538d26a94fc, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:25.067187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c18af-9a25-428e-9555-e19a64773e75 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:25.068998 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e2a4f-2844-4965-aed2-a1268ba653b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4379f93c234c401fa5a0e1329e113833, user_id=d7956f61efc44be8abbce5033cc95849, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:25.071646 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e2a4f-2844-4965-aed2-a1268ba653b5 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:25.189547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 809/1604] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:25 2022] PUT /identity/v3/projects/947f0d0fbc694b1fb9699f42c6bda2f8/users/ada1059f4b50410f902be538d26a94fc/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:25.190365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c18af-9a25-428e-9555-e19a64773e75 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:25.211694 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:25.215090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 796/1605] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:25 2022] PUT /identity/v3/projects/4379f93c234c401fa5a0e1329e113833/users/d7956f61efc44be8abbce5033cc95849/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:25.216525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bfa82-8738-4301-a828-ca7a18687d1a None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.216824 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bfa82-8738-4301-a828-ca7a18687d1a None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.217542 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bfa82-8738-4301-a828-ca7a18687d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.267817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-597bfa82-8738-4301-a828-ca7a18687d1a None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:25.269119 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-597bfa82-8738-4301-a828-ca7a18687d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:25.284828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c18af-9a25-428e-9555-e19a64773e75 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:25.330106 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 797/1606] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:25.331161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943da13e-2fe7-4934-bf64-c56361e0d45f None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.331452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943da13e-2fe7-4934-bf64-c56361e0d45f None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.331728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943da13e-2fe7-4934-bf64-c56361e0d45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.346474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6114c98-6898-4334-b743-ba5274ec5e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:25.347182 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6114c98-6898-4334-b743-ba5274ec5e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.347461 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6114c98-6898-4334-b743-ba5274ec5e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.347735 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6114c98-6898-4334-b743-ba5274ec5e89 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.348412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6114c98-6898-4334-b743-ba5274ec5e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:25.350460 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6114c98-6898-4334-b743-ba5274ec5e89 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:25.351033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-943da13e-2fe7-4934-bf64-c56361e0d45f None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:25.352283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-943da13e-2fe7-4934-bf64-c56361e0d45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:25.360758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 798/1607] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:25.361996 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefa511-d074-4ac2-af36-1c5f9aa66c54 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.362280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefa511-d074-4ac2-af36-1c5f9aa66c54 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.362554 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbefa511-d074-4ac2-af36-1c5f9aa66c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.385490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-fbefa511-d074-4ac2-af36-1c5f9aa66c54 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:25.395185 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-fbefa511-d074-4ac2-af36-1c5f9aa66c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:25.395767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 799/1608] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:25.396781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefa511-d074-4ac2-af36-1c5f9aa66c54 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:25.407636 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbefa511-d074-4ac2-af36-1c5f9aa66c54 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:25.412692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22805f8c-e42d-43c8-9ed4-855bf6c461e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:25.413405 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22805f8c-e42d-43c8-9ed4-855bf6c461e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.413739 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22805f8c-e42d-43c8-9ed4-855bf6c461e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.414048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22805f8c-e42d-43c8-9ed4-855bf6c461e9 admin admin] PATH_INFO: `/v3/projects/58abdaf45d7a4778a413b729b3666d88/users/486141aab1604926971019a4b37dfc0d/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.430508 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22805f8c-e42d-43c8-9ed4-855bf6c461e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58abdaf45d7a4778a413b729b3666d88, user_id=486141aab1604926971019a4b37dfc0d, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:25.434151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22805f8c-e42d-43c8-9ed4-855bf6c461e9 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:25.501179 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 810/1609] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:25 2022] POST /identity/v3/users => generated 288 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:25.501179 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6114c98-6898-4334-b743-ba5274ec5e89 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:25.538057 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 800/1610] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:25 2022] PUT /identity/v3/projects/58abdaf45d7a4778a413b729b3666d88/users/486141aab1604926971019a4b37dfc0d/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:25.539426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce71a62-e548-4517-a395-485db3732187 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.539720 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce71a62-e548-4517-a395-485db3732187 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.540081 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce71a62-e548-4517-a395-485db3732187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.557088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6114c98-6898-4334-b743-ba5274ec5e89 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:25.578500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-3ce71a62-e548-4517-a395-485db3732187 None None] MFA Rules not processed for user `ada1059f4b50410f902be538d26a94fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:25.579708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-3ce71a62-e548-4517-a395-485db3732187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:25.606357 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:25.610116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e318e55-12c3-43e8-b16a-3abe2026e98a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:25.610770 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e318e55-12c3-43e8-b16a-3abe2026e98a service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.611075 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e318e55-12c3-43e8-b16a-3abe2026e98a service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.611367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e318e55-12c3-43e8-b16a-3abe2026e98a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.640282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:25.647635 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 801/1611] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:25.648821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4b936-dce1-4a7e-9501-472faa3e5c83 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.649112 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4b936-dce1-4a7e-9501-472faa3e5c83 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.649528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4b936-dce1-4a7e-9501-472faa3e5c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.668620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-68f4b936-dce1-4a7e-9501-472faa3e5c83 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:25.669872 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-68f4b936-dce1-4a7e-9501-472faa3e5c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:25.675741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e318e55-12c3-43e8-b16a-3abe2026e98a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:25.677215 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e318e55-12c3-43e8-b16a-3abe2026e98a service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:25.687093 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 811/1612] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:25.688175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e318e55-12c3-43e8-b16a-3abe2026e98a service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:25.734887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 802/1613] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:25.735780 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4b936-dce1-4a7e-9501-472faa3e5c83 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:25.758337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e318e55-12c3-43e8-b16a-3abe2026e98a service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:25.764250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bf5be-fff7-4b37-8dd6-100d4f1d2df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:25.765165 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bf5be-fff7-4b37-8dd6-100d4f1d2df7 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.765558 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bf5be-fff7-4b37-8dd6-100d4f1d2df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.766132 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bf5be-fff7-4b37-8dd6-100d4f1d2df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.780883 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bf5be-fff7-4b37-8dd6-100d4f1d2df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:25.782534 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bf5be-fff7-4b37-8dd6-100d4f1d2df7 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:25.794619 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 812/1614] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:25.795406 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bf5be-fff7-4b37-8dd6-100d4f1d2df7 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:25.795896 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4b936-dce1-4a7e-9501-472faa3e5c83 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:25.802404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda29e46-34e9-42ca-8991-ec7a2dc55f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:25.803037 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda29e46-34e9-42ca-8991-ec7a2dc55f25 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.803325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda29e46-34e9-42ca-8991-ec7a2dc55f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.803600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda29e46-34e9-42ca-8991-ec7a2dc55f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.811369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bf5be-fff7-4b37-8dd6-100d4f1d2df7 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:25.815560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf04c60-b79c-4b2d-be37-88e1610e44ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:25.816236 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf04c60-b79c-4b2d-be37-88e1610e44ec service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.816522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf04c60-b79c-4b2d-be37-88e1610e44ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.816801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf04c60-b79c-4b2d-be37-88e1610e44ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.818532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda29e46-34e9-42ca-8991-ec7a2dc55f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:25.820027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda29e46-34e9-42ca-8991-ec7a2dc55f25 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:25.827933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf04c60-b79c-4b2d-be37-88e1610e44ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:25.834011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf04c60-b79c-4b2d-be37-88e1610e44ec service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:25.834146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 803/1615] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:25.836866 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda29e46-34e9-42ca-8991-ec7a2dc55f25 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:25.840080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 813/1616] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:25.841334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0803d-3fd4-46b1-b9c3-92cf99d5156f None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.841627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0803d-3fd4-46b1-b9c3-92cf99d5156f None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.841907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0803d-3fd4-46b1-b9c3-92cf99d5156f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.850618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda29e46-34e9-42ca-8991-ec7a2dc55f25 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:25.857534 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651834ef-1f2e-453b-8e14-11a6d9729bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:25.859729 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651834ef-1f2e-453b-8e14-11a6d9729bac admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.860199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651834ef-1f2e-453b-8e14-11a6d9729bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.860482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651834ef-1f2e-453b-8e14-11a6d9729bac admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.861207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651834ef-1f2e-453b-8e14-11a6d9729bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:25.863371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651834ef-1f2e-453b-8e14-11a6d9729bac admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:25.878944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 804/1617] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:25.880277 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651834ef-1f2e-453b-8e14-11a6d9729bac admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:25.891499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651834ef-1f2e-453b-8e14-11a6d9729bac admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:25.891695 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-8df0803d-3fd4-46b1-b9c3-92cf99d5156f None None] MFA Rules not processed for user `486141aab1604926971019a4b37dfc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:25.893305 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-8df0803d-3fd4-46b1-b9c3-92cf99d5156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:25.898013 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca02f57-72ef-4d22-b4cc-5fb75e6ad1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:25.898013 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02f57-72ef-4d22-b4cc-5fb75e6ad1be admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.898013 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02f57-72ef-4d22-b4cc-5fb75e6ad1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.898326 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02f57-72ef-4d22-b4cc-5fb75e6ad1be admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:25.898731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca02f57-72ef-4d22-b4cc-5fb75e6ad1be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:25.900775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca02f57-72ef-4d22-b4cc-5fb75e6ad1be admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:25.969437 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 814/1618] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:25.974208 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0803d-3fd4-46b1-b9c3-92cf99d5156f None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:25.986058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0803d-3fd4-46b1-b9c3-92cf99d5156f None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:25.992348 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfc063-53ad-4cf4-ad3e-68d0cd813ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:25.993152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfc063-53ad-4cf4-ad3e-68d0cd813ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:25.993709 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfc063-53ad-4cf4-ad3e-68d0cd813ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:25.994003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfc063-53ad-4cf4-ad3e-68d0cd813ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:26.005813 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebfc063-53ad-4cf4-ad3e-68d0cd813ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:26.007734 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebfc063-53ad-4cf4-ad3e-68d0cd813ad8 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:26.019654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 815/1619] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:26.020516 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfc063-53ad-4cf4-ad3e-68d0cd813ad8 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:26.038775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 805/1620] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:25 2022] POST /identity/v3/projects => generated 357 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:26.038775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806c3e9-d219-4675-a9f3-4ad9d046b34d None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:26.038775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806c3e9-d219-4675-a9f3-4ad9d046b34d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:26.038775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806c3e9-d219-4675-a9f3-4ad9d046b34d None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:26.039122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfc063-53ad-4cf4-ad3e-68d0cd813ad8 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:26.042950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 806/1621] 10.222.0.64 () {54 vars in 962 bytes} [Thu Sep 1 14:06:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:06:26.043792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806c3e9-d219-4675-a9f3-4ad9d046b34d None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:26.082086 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:26.099592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:26.134862 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806c3e9-d219-4675-a9f3-4ad9d046b34d None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:26.141148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe4f34-91ed-43c3-9c05-d54cb4cc6450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:26.141837 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe4f34-91ed-43c3-9c05-d54cb4cc6450 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:26.142122 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe4f34-91ed-43c3-9c05-d54cb4cc6450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:26.142394 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe4f34-91ed-43c3-9c05-d54cb4cc6450 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:26.143033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe4f34-91ed-43c3-9c05-d54cb4cc6450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:26.144054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bd0b2-3190-4fe3-bf22-c086e32d5f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:26.144826 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bd0b2-3190-4fe3-bf22-c086e32d5f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:26.145065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe4f34-91ed-43c3-9c05-d54cb4cc6450 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:26.145189 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bd0b2-3190-4fe3-bf22-c086e32d5f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:26.145494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bd0b2-3190-4fe3-bf22-c086e32d5f1d admin admin] PATH_INFO: `/v3/projects/f9411aeaf36c4707a0f46f8d1fc3dc96/users/ba7f41273885414dbb7556856593860a/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:26.172637 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bd0b2-3190-4fe3-bf22-c086e32d5f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9411aeaf36c4707a0f46f8d1fc3dc96, user_id=ba7f41273885414dbb7556856593860a, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:26.172637 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bd0b2-3190-4fe3-bf22-c086e32d5f1d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:26.269403 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 807/1622] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:26 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:26.269616 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a15f2-8a26-4375-a87d-2fe00f56055f None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:26.269873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a15f2-8a26-4375-a87d-2fe00f56055f None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:26.270151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a15f2-8a26-4375-a87d-2fe00f56055f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:26.288571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 816/1623] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:26 2022] PUT /identity/v3/projects/f9411aeaf36c4707a0f46f8d1fc3dc96/users/ba7f41273885414dbb7556856593860a/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:26.289812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bd0b2-3190-4fe3-bf22-c086e32d5f1d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:26.353776 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-461a15f2-8a26-4375-a87d-2fe00f56055f None None] MFA Rules not processed for user `4b3c8a90b97246a98612b627b5f8da80`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:26.355359 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-461a15f2-8a26-4375-a87d-2fe00f56055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:26.426515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bd0b2-3190-4fe3-bf22-c086e32d5f1d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:26.437423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f7638-37ef-4b72-8280-a8cf434a5808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:26.438119 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f7638-37ef-4b72-8280-a8cf434a5808 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:26.438406 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f7638-37ef-4b72-8280-a8cf434a5808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:26.438684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f7638-37ef-4b72-8280-a8cf434a5808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:26.439494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f7638-37ef-4b72-8280-a8cf434a5808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:26.448745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f7638-37ef-4b72-8280-a8cf434a5808 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:26.452960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 808/1624] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Sep 1 14:06:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:26.456508 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 817/1625] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:26.457688 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f7638-37ef-4b72-8280-a8cf434a5808 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:26.464970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a15f2-8a26-4375-a87d-2fe00f56055f None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:26.469210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f7638-37ef-4b72-8280-a8cf434a5808 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:26.475100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66305057-0592-412c-a72f-09ccfcfd4b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:26.475907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66305057-0592-412c-a72f-09ccfcfd4b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:26.476204 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66305057-0592-412c-a72f-09ccfcfd4b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:26.476463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66305057-0592-412c-a72f-09ccfcfd4b3b admin admin] PATH_INFO: `/v3/projects/5536561089574e7ea5532eee751ffd23/users/f2638825bc40432a87c821b997cb3314/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:26.477599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a15f2-8a26-4375-a87d-2fe00f56055f None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:26.485024 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa06c1-5286-488b-8104-c267a5621a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:26.485657 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa06c1-5286-488b-8104-c267a5621a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:26.485943 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa06c1-5286-488b-8104-c267a5621a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:26.491060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa06c1-5286-488b-8104-c267a5621a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:26.491060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa06c1-5286-488b-8104-c267a5621a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:26.491060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa06c1-5286-488b-8104-c267a5621a2d admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:26.497585 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66305057-0592-412c-a72f-09ccfcfd4b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5536561089574e7ea5532eee751ffd23, user_id=f2638825bc40432a87c821b997cb3314, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:26.500650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66305057-0592-412c-a72f-09ccfcfd4b3b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:26.502324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 809/1626] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:26.503245 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa06c1-5286-488b-8104-c267a5621a2d admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:26.517812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa06c1-5286-488b-8104-c267a5621a2d admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:26.523440 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e308cf-6b59-4605-867e-ae32afe5c0e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:26.524077 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e308cf-6b59-4605-867e-ae32afe5c0e1 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:26.524358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e308cf-6b59-4605-867e-ae32afe5c0e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:26.524649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e308cf-6b59-4605-867e-ae32afe5c0e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:26.584593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e308cf-6b59-4605-867e-ae32afe5c0e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:26.586209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e308cf-6b59-4605-867e-ae32afe5c0e1 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:26.606577 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 818/1627] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:26 2022] PUT /identity/v3/projects/5536561089574e7ea5532eee751ffd23/users/f2638825bc40432a87c821b997cb3314/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:26.606577 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66305057-0592-412c-a72f-09ccfcfd4b3b admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:26.609024 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 810/1628] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:26.609024 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e308cf-6b59-4605-867e-ae32afe5c0e1 service nova] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:26.631458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e308cf-6b59-4605-867e-ae32afe5c0e1 service nova] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:26.707833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66305057-0592-412c-a72f-09ccfcfd4b3b admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:26.714816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6145e-25db-46cd-bb5f-a0931dc27092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:26.717939 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6145e-25db-46cd-bb5f-a0931dc27092 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:26.717939 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6145e-25db-46cd-bb5f-a0931dc27092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:26.717939 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6145e-25db-46cd-bb5f-a0931dc27092 admin admin] PATH_INFO: `/v3/projects/f9411aeaf36c4707a0f46f8d1fc3dc96/users/ba7f41273885414dbb7556856593860a/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:26.718273 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b4f35-638b-4e4c-96a8-c6361da08405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:26.718637 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b4f35-638b-4e4c-96a8-c6361da08405 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:26.718966 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b4f35-638b-4e4c-96a8-c6361da08405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:26.719244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b4f35-638b-4e4c-96a8-c6361da08405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:26.719567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6145e-25db-46cd-bb5f-a0931dc27092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9411aeaf36c4707a0f46f8d1fc3dc96, user_id=ba7f41273885414dbb7556856593860a, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:26.719900 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b4f35-638b-4e4c-96a8-c6361da08405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:26.721933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b4f35-638b-4e4c-96a8-c6361da08405 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:26.723357 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6145e-25db-46cd-bb5f-a0931dc27092 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:26.742067 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 811/1629] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:26.749890 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b4f35-638b-4e4c-96a8-c6361da08405 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:26.750146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 819/1630] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:26 2022] PUT /identity/v3/projects/f9411aeaf36c4707a0f46f8d1fc3dc96/users/ba7f41273885414dbb7556856593860a/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:26.759057 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329c4d3-b118-4d0c-ac96-09c9b27fc969 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:26.759349 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329c4d3-b118-4d0c-ac96-09c9b27fc969 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:26.760255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329c4d3-b118-4d0c-ac96-09c9b27fc969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:26.770790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b4f35-638b-4e4c-96a8-c6361da08405 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:26.841766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:26.858467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-0329c4d3-b118-4d0c-ac96-09c9b27fc969 None None] MFA Rules not processed for user `ba7f41273885414dbb7556856593860a`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:26.859812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0329c4d3-b118-4d0c-ac96-09c9b27fc969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:26.896504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:26.933972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87870b-703a-4336-8b83-dc1f5dce45f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:26.934748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87870b-703a-4336-8b83-dc1f5dce45f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:26.935107 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87870b-703a-4336-8b83-dc1f5dce45f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:26.935457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87870b-703a-4336-8b83-dc1f5dce45f7 admin admin] PATH_INFO: `/v3/projects/5536561089574e7ea5532eee751ffd23/users/f2638825bc40432a87c821b997cb3314/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:26.937576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87870b-703a-4336-8b83-dc1f5dce45f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5536561089574e7ea5532eee751ffd23, user_id=f2638825bc40432a87c821b997cb3314, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:26.941487 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87870b-703a-4336-8b83-dc1f5dce45f7 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:26.952737 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 812/1631] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:26 2022] PUT /identity/v3/projects/5536561089574e7ea5532eee751ffd23/users/f2638825bc40432a87c821b997cb3314/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:26.963615 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865da0e-fa4e-4d64-ba76-43e48b8528ca None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:26.965926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865da0e-fa4e-4d64-ba76-43e48b8528ca None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:26.966284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865da0e-fa4e-4d64-ba76-43e48b8528ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:27.032633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-5865da0e-fa4e-4d64-ba76-43e48b8528ca None None] MFA Rules not processed for user `f2638825bc40432a87c821b997cb3314`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:27.034243 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-5865da0e-fa4e-4d64-ba76-43e48b8528ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:27.039030 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 820/1632] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:06:27.040708 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d3583-bc86-4bfd-b375-750068cc5570 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:27.051467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d3583-bc86-4bfd-b375-750068cc5570 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:27.053765 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d3583-bc86-4bfd-b375-750068cc5570 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:27.056522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 821/1633] 10.222.0.64 () {54 vars in 912 bytes} [Thu Sep 1 14:06:27 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:06:27.059481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d3583-bc86-4bfd-b375-750068cc5570 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:27.142827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d3583-bc86-4bfd-b375-750068cc5570 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:27.147346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10440a-d1ed-454b-8a9f-902227bfe403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:27.148100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10440a-d1ed-454b-8a9f-902227bfe403 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:27.497757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10440a-d1ed-454b-8a9f-902227bfe403 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:27.497757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10440a-d1ed-454b-8a9f-902227bfe403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:27.498602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 813/1634] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:27.498602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223a380-65d0-4f3d-a16d-b9c0d1e4e475 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:27.498602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223a380-65d0-4f3d-a16d-b9c0d1e4e475 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:27.498602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223a380-65d0-4f3d-a16d-b9c0d1e4e475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:27.509245 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10440a-d1ed-454b-8a9f-902227bfe403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:27.509245 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10440a-d1ed-454b-8a9f-902227bfe403 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:27.510200 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-2223a380-65d0-4f3d-a16d-b9c0d1e4e475 None None] MFA Rules not processed for user `4b3c8a90b97246a98612b627b5f8da80`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:27.510200 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2223a380-65d0-4f3d-a16d-b9c0d1e4e475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:27.510572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 822/1635] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:27.510572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10440a-d1ed-454b-8a9f-902227bfe403 service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:27.510572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10440a-d1ed-454b-8a9f-902227bfe403 service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:27.510572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374eb6a3-32bf-4d92-86df-3664c852ca05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:27.511386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374eb6a3-32bf-4d92-86df-3664c852ca05 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:27.511386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374eb6a3-32bf-4d92-86df-3664c852ca05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:27.511386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374eb6a3-32bf-4d92-86df-3664c852ca05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:27.511386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374eb6a3-32bf-4d92-86df-3664c852ca05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:27.511386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374eb6a3-32bf-4d92-86df-3664c852ca05 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:27.511386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 823/1636] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:27 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:27.514486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 814/1637] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 14:06:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:27.514799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374eb6a3-32bf-4d92-86df-3664c852ca05 service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:27.514799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374eb6a3-32bf-4d92-86df-3664c852ca05 service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:27.514799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e3117-b341-4e2a-9ffb-193a1efeca20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:27.514799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e3117-b341-4e2a-9ffb-193a1efeca20 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:27.515647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e3117-b341-4e2a-9ffb-193a1efeca20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:27.515647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e3117-b341-4e2a-9ffb-193a1efeca20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:27.515647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e3117-b341-4e2a-9ffb-193a1efeca20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:27.515647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e3117-b341-4e2a-9ffb-193a1efeca20 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:27.516453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:27.516946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 824/1638] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:27.834269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223a380-65d0-4f3d-a16d-b9c0d1e4e475 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:27.846025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223a380-65d0-4f3d-a16d-b9c0d1e4e475 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:27.856217 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bde87-8584-4d55-b72b-25dee10a2622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:27.857242 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bde87-8584-4d55-b72b-25dee10a2622 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:27.857696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bde87-8584-4d55-b72b-25dee10a2622 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:27.857980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bde87-8584-4d55-b72b-25dee10a2622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:27.916752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bde87-8584-4d55-b72b-25dee10a2622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:27.918277 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bde87-8584-4d55-b72b-25dee10a2622 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:27.927199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 815/1639] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:28.441561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e3117-b341-4e2a-9ffb-193a1efeca20 service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:28.450227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e3117-b341-4e2a-9ffb-193a1efeca20 service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:28.454206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54c67f-011d-46e7-895a-989283604d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:28.454822 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54c67f-011d-46e7-895a-989283604d60 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:28.455118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54c67f-011d-46e7-895a-989283604d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:28.455406 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54c67f-011d-46e7-895a-989283604d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:28.490709 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:28.523991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54c67f-011d-46e7-895a-989283604d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:28.525566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54c67f-011d-46e7-895a-989283604d60 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:28.543085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 825/1640] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:29.282369 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b4e41-590d-444f-b5cd-3520da285444 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:29.282869 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b4e41-590d-444f-b5cd-3520da285444 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:29.283821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b4e41-590d-444f-b5cd-3520da285444 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:29.287737 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 816/1641] 10.222.0.64 () {54 vars in 962 bytes} [Thu Sep 1 14:06:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:06:29.297698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcaa76-d641-46f5-aad4-2fbf222189b9 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:29.297987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcaa76-d641-46f5-aad4-2fbf222189b9 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:29.298265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcaa76-d641-46f5-aad4-2fbf222189b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:29.365088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-0abcaa76-d641-46f5-aad4-2fbf222189b9 None None] MFA Rules not processed for user `4b3c8a90b97246a98612b627b5f8da80`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:29.366521 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0abcaa76-d641-46f5-aad4-2fbf222189b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:29.396225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 826/1642] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Sep 1 14:06:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:29.401832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5b80e-0b37-4d72-a9a9-9fa7bed11cc8 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:29.402130 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5b80e-0b37-4d72-a9a9-9fa7bed11cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:29.402410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5b80e-0b37-4d72-a9a9-9fa7bed11cc8 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:29.403765 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 817/1643] 10.222.0.64 () {54 vars in 912 bytes} [Thu Sep 1 14:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:06:29.409370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664acff5-5a5e-4381-a8d3-befe7bf3f4d2 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:29.410013 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664acff5-5a5e-4381-a8d3-befe7bf3f4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:29.410506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664acff5-5a5e-4381-a8d3-befe7bf3f4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:29.437972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-664acff5-5a5e-4381-a8d3-befe7bf3f4d2 None None] MFA Rules not processed for user `4b3c8a90b97246a98612b627b5f8da80`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:29.440376 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-664acff5-5a5e-4381-a8d3-befe7bf3f4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:29.456922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 827/1644] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 14:06:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:29.470392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5b80e-0b37-4d72-a9a9-9fa7bed11cc8 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:29.492987 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5b80e-0b37-4d72-a9a9-9fa7bed11cc8 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:29.500897 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2e4a2-bbdc-42a3-9530-247aace67f52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:29.502159 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2e4a2-bbdc-42a3-9530-247aace67f52 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:29.502842 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2e4a2-bbdc-42a3-9530-247aace67f52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:29.503300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2e4a2-bbdc-42a3-9530-247aace67f52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:29.521686 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2e4a2-bbdc-42a3-9530-247aace67f52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:29.524050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2e4a2-bbdc-42a3-9530-247aace67f52 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:29.543118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 818/1645] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:06:33.093369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664acff5-5a5e-4381-a8d3-befe7bf3f4d2 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:33.401770 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664acff5-5a5e-4381-a8d3-befe7bf3f4d2 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:33.427768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da1f1a-52d9-4ab0-8e42-62b8a25686c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:33.427768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da1f1a-52d9-4ab0-8e42-62b8a25686c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:33.427768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da1f1a-52d9-4ab0-8e42-62b8a25686c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:33.427768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da1f1a-52d9-4ab0-8e42-62b8a25686c3 admin admin] PATH_INFO: `/v3/users/486141aab1604926971019a4b37dfc0d` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:33.428136 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da1f1a-52d9-4ab0-8e42-62b8a25686c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=486141aab1604926971019a4b37dfc0d)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:33.431100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da1f1a-52d9-4ab0-8e42-62b8a25686c3 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:33.884646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-36da1f1a-52d9-4ab0-8e42-62b8a25686c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486141aab1604926971019a4b37dfc0d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:33.931684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-36da1f1a-52d9-4ab0-8e42-62b8a25686c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486141aab1604926971019a4b37dfc0d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:34.035682 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-36da1f1a-52d9-4ab0-8e42-62b8a25686c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486141aab1604926971019a4b37dfc0d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:34.049950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-36da1f1a-52d9-4ab0-8e42-62b8a25686c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486141aab1604926971019a4b37dfc0d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:34.051528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-36da1f1a-52d9-4ab0-8e42-62b8a25686c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486141aab1604926971019a4b37dfc0d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:34.081219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 828/1646] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:06:33 2022] DELETE /identity/v3/users/486141aab1604926971019a4b37dfc0d => generated 0 bytes in 988 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:34.085485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54375ab9-058a-4885-bf53-6eff28aff811 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:34.085947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54375ab9-058a-4885-bf53-6eff28aff811 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:34.086030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54375ab9-058a-4885-bf53-6eff28aff811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:34.126505 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-54375ab9-058a-4885-bf53-6eff28aff811 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:34.128535 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-54375ab9-058a-4885-bf53-6eff28aff811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:34.315743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 819/1647] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:34.349799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da1f1a-52d9-4ab0-8e42-62b8a25686c3 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:34.355524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-36da1f1a-52d9-4ab0-8e42-62b8a25686c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:34.490242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:34.553479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da1f1a-52d9-4ab0-8e42-62b8a25686c3 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:34.569166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2c907-c208-4ddb-8cb1-cc792c98b493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:34.569819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c907-c208-4ddb-8cb1-cc792c98b493 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:34.570106 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c907-c208-4ddb-8cb1-cc792c98b493 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:34.572713 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c907-c208-4ddb-8cb1-cc792c98b493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:34.599338 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2c907-c208-4ddb-8cb1-cc792c98b493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:34.602116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2c907-c208-4ddb-8cb1-cc792c98b493 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:34.629173 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 829/1648] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:36.004199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54375ab9-058a-4885-bf53-6eff28aff811 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:36.005649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-54375ab9-058a-4885-bf53-6eff28aff811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:36.028949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54375ab9-058a-4885-bf53-6eff28aff811 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:36.052860 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40eaeea-f58b-47f1-afa4-00c4a73c6b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:36.052860 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40eaeea-f58b-47f1-afa4-00c4a73c6b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:36.052860 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40eaeea-f58b-47f1-afa4-00c4a73c6b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:36.052860 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40eaeea-f58b-47f1-afa4-00c4a73c6b2f admin admin] PATH_INFO: `/v3/projects/58abdaf45d7a4778a413b729b3666d88` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:36.061200 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40eaeea-f58b-47f1-afa4-00c4a73c6b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=58abdaf45d7a4778a413b729b3666d88)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:36.067724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40eaeea-f58b-47f1-afa4-00c4a73c6b2f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:36.328016 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-e40eaeea-f58b-47f1-afa4-00c4a73c6b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58abdaf45d7a4778a413b729b3666d88', 'request_id': 'req-e40eaeea-f58b-47f1-afa4-00c4a73c6b2f'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:36.356647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-e40eaeea-f58b-47f1-afa4-00c4a73c6b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58abdaf45d7a4778a413b729b3666d88', 'request_id': 'req-e40eaeea-f58b-47f1-afa4-00c4a73c6b2f'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:36.362761 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:36.497914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-e40eaeea-f58b-47f1-afa4-00c4a73c6b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58abdaf45d7a4778a413b729b3666d88', 'request_id': 'req-e40eaeea-f58b-47f1-afa4-00c4a73c6b2f'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:36.521263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-e40eaeea-f58b-47f1-afa4-00c4a73c6b2f admin admin] The token cache is being invalidate because project 58abdaf45d7a4778a413b729b3666d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:06:36.521560 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-e40eaeea-f58b-47f1-afa4-00c4a73c6b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:36.522422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-e40eaeea-f58b-47f1-afa4-00c4a73c6b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:36.524456 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 820/1649] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:06:36 2022] DELETE /identity/v3/projects/58abdaf45d7a4778a413b729b3666d88 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:36.530514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e4a9d-3c43-42f6-8e73-87f3ccf2f0d5 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:36.531361 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e4a9d-3c43-42f6-8e73-87f3ccf2f0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:36.531884 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e4a9d-3c43-42f6-8e73-87f3ccf2f0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:36.561248 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-317e4a9d-3c43-42f6-8e73-87f3ccf2f0d5 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:36.562986 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-317e4a9d-3c43-42f6-8e73-87f3ccf2f0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:36.773406 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 830/1650] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:36.780955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11827955-3505-4ce2-8308-6d1dcf0bc0b0 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:36.781255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11827955-3505-4ce2-8308-6d1dcf0bc0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:36.781535 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11827955-3505-4ce2-8308-6d1dcf0bc0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:36.834175 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-11827955-3505-4ce2-8308-6d1dcf0bc0b0 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:36.838175 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-11827955-3505-4ce2-8308-6d1dcf0bc0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:36.875290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 821/1651] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:36.885626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e4a9d-3c43-42f6-8e73-87f3ccf2f0d5 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:36.921863 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e4a9d-3c43-42f6-8e73-87f3ccf2f0d5 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:36.930325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded202ac-5cb8-49ec-b0b0-f2deed4b3bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:36.933109 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded202ac-5cb8-49ec-b0b0-f2deed4b3bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:36.933671 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded202ac-5cb8-49ec-b0b0-f2deed4b3bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:36.934238 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded202ac-5cb8-49ec-b0b0-f2deed4b3bd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:36.935475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded202ac-5cb8-49ec-b0b0-f2deed4b3bd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:06:36.935984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded202ac-5cb8-49ec-b0b0-f2deed4b3bd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:36.938100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded202ac-5cb8-49ec-b0b0-f2deed4b3bd4 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:36.971593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 831/1652] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:06:36.972593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11827955-3505-4ce2-8308-6d1dcf0bc0b0 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:36.985132 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11827955-3505-4ce2-8308-6d1dcf0bc0b0 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:37.013982 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642e53d-a4c0-4081-ba3c-3f4785c355b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:37.020556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642e53d-a4c0-4081-ba3c-3f4785c355b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:37.020556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642e53d-a4c0-4081-ba3c-3f4785c355b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:37.020556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642e53d-a4c0-4081-ba3c-3f4785c355b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:37.020556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642e53d-a4c0-4081-ba3c-3f4785c355b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:37.020556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642e53d-a4c0-4081-ba3c-3f4785c355b5 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:37.165413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 822/1653] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:36 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:37.171638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded202ac-5cb8-49ec-b0b0-f2deed4b3bd4 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:37.187151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded202ac-5cb8-49ec-b0b0-f2deed4b3bd4 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:37.394157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c8204-9e72-4792-b79a-e4f5e8346a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:37.394845 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c8204-9e72-4792-b79a-e4f5e8346a3f admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:37.395205 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c8204-9e72-4792-b79a-e4f5e8346a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:37.395732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c8204-9e72-4792-b79a-e4f5e8346a3f admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:37.396811 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c8204-9e72-4792-b79a-e4f5e8346a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:37.401076 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c8204-9e72-4792-b79a-e4f5e8346a3f admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:37.549096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 832/1654] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:37 2022] POST /identity/v3/users => generated 286 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:37.550374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642e53d-a4c0-4081-ba3c-3f4785c355b5 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:37.565622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642e53d-a4c0-4081-ba3c-3f4785c355b5 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:37.596647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871ad11-f029-4d70-ac47-cd43fe4d2c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:37.597295 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871ad11-f029-4d70-ac47-cd43fe4d2c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:37.597582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871ad11-f029-4d70-ac47-cd43fe4d2c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:37.597855 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871ad11-f029-4d70-ac47-cd43fe4d2c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:37.598693 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871ad11-f029-4d70-ac47-cd43fe4d2c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:37.600543 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871ad11-f029-4d70-ac47-cd43fe4d2c17 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:37.631035 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e491e0-784c-42bb-9f24-09a398a70e66 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:37.631309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e491e0-784c-42bb-9f24-09a398a70e66 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:37.631593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e491e0-784c-42bb-9f24-09a398a70e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:37.646289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 823/1655] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:37.652578 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871ad11-f029-4d70-ac47-cd43fe4d2c17 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:37.689338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871ad11-f029-4d70-ac47-cd43fe4d2c17 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:37.704283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-56e491e0-784c-42bb-9f24-09a398a70e66 None None] MFA Rules not processed for user `6e998aa9209342ad8cd504c440273c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:37.707370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-56e491e0-784c-42bb-9f24-09a398a70e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:37.714744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375d5b0-44e3-4fc5-aa06-6d81dcbf0eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:37.719579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375d5b0-44e3-4fc5-aa06-6d81dcbf0eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:37.719579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375d5b0-44e3-4fc5-aa06-6d81dcbf0eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:37.719579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375d5b0-44e3-4fc5-aa06-6d81dcbf0eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:37.719579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375d5b0-44e3-4fc5-aa06-6d81dcbf0eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:37.720019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375d5b0-44e3-4fc5-aa06-6d81dcbf0eb0 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:37.760695 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 824/1656] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:37.762925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375d5b0-44e3-4fc5-aa06-6d81dcbf0eb0 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:37.790929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375d5b0-44e3-4fc5-aa06-6d81dcbf0eb0 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:37.810998 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fef623-2612-4b14-9db6-adfa2eabf146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:37.811690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fef623-2612-4b14-9db6-adfa2eabf146 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:37.812182 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fef623-2612-4b14-9db6-adfa2eabf146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:37.812605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fef623-2612-4b14-9db6-adfa2eabf146 admin admin] PATH_INFO: `/v3/projects/9d307548f15948e7ae69098e4f31d303/users/e6334e43aafd407489471af0a76037c6/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:37.843387 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:37.852477 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fef623-2612-4b14-9db6-adfa2eabf146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d307548f15948e7ae69098e4f31d303, user_id=e6334e43aafd407489471af0a76037c6, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:37.865165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fef623-2612-4b14-9db6-adfa2eabf146 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:37.912019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 833/1657] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:06:37.913423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaaecf-12e4-4a12-8e10-0c24b3d62e4c None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:37.913423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaaecf-12e4-4a12-8e10-0c24b3d62e4c None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:37.913423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaaecf-12e4-4a12-8e10-0c24b3d62e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:37.946748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-bceaaecf-12e4-4a12-8e10-0c24b3d62e4c None None] MFA Rules not processed for user `6e998aa9209342ad8cd504c440273c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:37.950283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-bceaaecf-12e4-4a12-8e10-0c24b3d62e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:37.962648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 825/1658] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:37 2022] PUT /identity/v3/projects/9d307548f15948e7ae69098e4f31d303/users/e6334e43aafd407489471af0a76037c6/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:06:37.975360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9d8a7-45ea-40c9-bc40-b0e14bcd9fb8 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:37.975783 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9d8a7-45ea-40c9-bc40-b0e14bcd9fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:37.976192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9d8a7-45ea-40c9-bc40-b0e14bcd9fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:38.037760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-91a9d8a7-45ea-40c9-bc40-b0e14bcd9fb8 None None] MFA Rules not processed for user `e6334e43aafd407489471af0a76037c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:38.039158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-91a9d8a7-45ea-40c9-bc40-b0e14bcd9fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:38.102534 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 834/1659] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:38.114086 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaaecf-12e4-4a12-8e10-0c24b3d62e4c None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:38.115950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-bceaaecf-12e4-4a12-8e10-0c24b3d62e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:38.208545 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 826/1660] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:06:38.209734 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9d8a7-45ea-40c9-bc40-b0e14bcd9fb8 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:38.383389 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaaecf-12e4-4a12-8e10-0c24b3d62e4c None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:38.384775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9d8a7-45ea-40c9-bc40-b0e14bcd9fb8 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:38.403074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea4577-924e-402e-8a54-42cfe2e1b61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:38.406418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea4577-924e-402e-8a54-42cfe2e1b61e admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:38.406418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea4577-924e-402e-8a54-42cfe2e1b61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:38.406418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea4577-924e-402e-8a54-42cfe2e1b61e admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:38.406418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea4577-924e-402e-8a54-42cfe2e1b61e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:38.406857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea4577-924e-402e-8a54-42cfe2e1b61e admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:38.409069 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1da5c-ec3e-45d2-9164-8cec2c1b8922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:38.409878 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1da5c-ec3e-45d2-9164-8cec2c1b8922 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:38.410304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1da5c-ec3e-45d2-9164-8cec2c1b8922 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:38.410718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1da5c-ec3e-45d2-9164-8cec2c1b8922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:38.425722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:38.437084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1da5c-ec3e-45d2-9164-8cec2c1b8922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:38.438942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1da5c-ec3e-45d2-9164-8cec2c1b8922 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:38.458317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 835/1661] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:06:38.579194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 827/1662] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:38 2022] POST /identity/v3/projects => generated 371 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:38.580807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1da5c-ec3e-45d2-9164-8cec2c1b8922 service nova] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:38.599059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1da5c-ec3e-45d2-9164-8cec2c1b8922 service nova] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:38.775367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e3bab-c794-4f09-813e-a17bd342014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:38.777113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e3bab-c794-4f09-813e-a17bd342014e admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:38.777636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e3bab-c794-4f09-813e-a17bd342014e admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:38.778744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e3bab-c794-4f09-813e-a17bd342014e admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:38.779684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e3bab-c794-4f09-813e-a17bd342014e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:38.782859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e3bab-c794-4f09-813e-a17bd342014e admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:38.946721 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 836/1663] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:38 2022] POST /identity/v3/users => generated 292 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:38.950344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea4577-924e-402e-8a54-42cfe2e1b61e admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:38.963142 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea4577-924e-402e-8a54-42cfe2e1b61e admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:38.984174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463edb69-d793-47ba-a1dd-c917045200c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:38.985944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463edb69-d793-47ba-a1dd-c917045200c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:38.986960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463edb69-d793-47ba-a1dd-c917045200c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:38.988320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463edb69-d793-47ba-a1dd-c917045200c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:38.989705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463edb69-d793-47ba-a1dd-c917045200c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:38.996319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463edb69-d793-47ba-a1dd-c917045200c0 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:39.025107 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 828/1664] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:39.030101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e3bab-c794-4f09-813e-a17bd342014e admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:39.044547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e3bab-c794-4f09-813e-a17bd342014e admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:39.066773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e47978-081d-4250-b27a-aa8055629885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:39.067539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e47978-081d-4250-b27a-aa8055629885 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:39.067855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e47978-081d-4250-b27a-aa8055629885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:39.068159 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e47978-081d-4250-b27a-aa8055629885 admin admin] PATH_INFO: `/v3/projects/732f1178c62346baad4d9515bcfd1b9d/users/f6f9657d260c46928837ab582d95239e/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:39.118407 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e47978-081d-4250-b27a-aa8055629885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732f1178c62346baad4d9515bcfd1b9d, user_id=f6f9657d260c46928837ab582d95239e, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:39.122759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e47978-081d-4250-b27a-aa8055629885 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:39.229074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 837/1665] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:39 2022] PUT /identity/v3/projects/732f1178c62346baad4d9515bcfd1b9d/users/f6f9657d260c46928837ab582d95239e/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:06:39.230328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463edb69-d793-47ba-a1dd-c917045200c0 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:39.251308 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463edb69-d793-47ba-a1dd-c917045200c0 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:39.372129 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16ccc0-3fa5-417e-b484-9a7b4483f55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:39.373497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16ccc0-3fa5-417e-b484-9a7b4483f55f admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:39.373497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16ccc0-3fa5-417e-b484-9a7b4483f55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:39.374012 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16ccc0-3fa5-417e-b484-9a7b4483f55f admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:39.374785 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16ccc0-3fa5-417e-b484-9a7b4483f55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:39.376803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16ccc0-3fa5-417e-b484-9a7b4483f55f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:39.388294 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 829/1666] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:06:39.393400 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e47978-081d-4250-b27a-aa8055629885 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:39.409071 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e47978-081d-4250-b27a-aa8055629885 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:39.428738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b0dca-2a80-465c-a249-1bf4b5043a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:39.429449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b0dca-2a80-465c-a249-1bf4b5043a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:39.429734 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b0dca-2a80-465c-a249-1bf4b5043a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:39.430009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b0dca-2a80-465c-a249-1bf4b5043a20 admin admin] PATH_INFO: `/v3/projects/732f1178c62346baad4d9515bcfd1b9d/users/f6f9657d260c46928837ab582d95239e/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:39.436820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b0dca-2a80-465c-a249-1bf4b5043a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732f1178c62346baad4d9515bcfd1b9d, user_id=f6f9657d260c46928837ab582d95239e, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:39.441465 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b0dca-2a80-465c-a249-1bf4b5043a20 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:39.466037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 838/1667] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:39 2022] PUT /identity/v3/projects/732f1178c62346baad4d9515bcfd1b9d/users/f6f9657d260c46928837ab582d95239e/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:39.468402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f452d6-b88d-4fad-9e8d-7e3c7cd65efc None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:39.468811 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f452d6-b88d-4fad-9e8d-7e3c7cd65efc None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:39.469231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f452d6-b88d-4fad-9e8d-7e3c7cd65efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:39.613867 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-13f452d6-b88d-4fad-9e8d-7e3c7cd65efc None None] MFA Rules not processed for user `f6f9657d260c46928837ab582d95239e`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:39.618367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-13f452d6-b88d-4fad-9e8d-7e3c7cd65efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:39.647080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8ced5-9e4e-4867-be73-f306ef0700af None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:39.647578 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8ced5-9e4e-4867-be73-f306ef0700af None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:39.647654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8ced5-9e4e-4867-be73-f306ef0700af None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:39.649155 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 839/1668] 10.222.0.64 () {54 vars in 912 bytes} [Thu Sep 1 14:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 14:06:39.670714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f781842-c771-47b0-af95-d50a2bf03a4e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:39.671005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f781842-c771-47b0-af95-d50a2bf03a4e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:39.671600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f781842-c771-47b0-af95-d50a2bf03a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:39.784319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-5f781842-c771-47b0-af95-d50a2bf03a4e None None] MFA Rules not processed for user `4a9703db64624bbeb392d693ca60c6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:39.824290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-5f781842-c771-47b0-af95-d50a2bf03a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:39.884332 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 840/1669] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 14:06:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:06:39.903748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f781842-c771-47b0-af95-d50a2bf03a4e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:39.905353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-5f781842-c771-47b0-af95-d50a2bf03a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:39.915194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 830/1670] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:39.931695 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f781842-c771-47b0-af95-d50a2bf03a4e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:39.937018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60502ad6-ec5e-4aa6-81bb-62952a0cc1b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:39.937326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60502ad6-ec5e-4aa6-81bb-62952a0cc1b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:39.937571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60502ad6-ec5e-4aa6-81bb-62952a0cc1b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:39.937870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60502ad6-ec5e-4aa6-81bb-62952a0cc1b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:39.949620 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60502ad6-ec5e-4aa6-81bb-62952a0cc1b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:39.959950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60502ad6-ec5e-4aa6-81bb-62952a0cc1b5 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:39.966088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f452d6-b88d-4fad-9e8d-7e3c7cd65efc None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:39.967832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-13f452d6-b88d-4fad-9e8d-7e3c7cd65efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:39.981792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 841/1671] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:06:40.026156 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:40.172449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f452d6-b88d-4fad-9e8d-7e3c7cd65efc None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:40.188664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee7b8e-4a98-4df7-889d-a24027239b7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:40.189374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee7b8e-4a98-4df7-889d-a24027239b7c service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:40.189663 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee7b8e-4a98-4df7-889d-a24027239b7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:40.189938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee7b8e-4a98-4df7-889d-a24027239b7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:40.218524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee7b8e-4a98-4df7-889d-a24027239b7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:40.224588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee7b8e-4a98-4df7-889d-a24027239b7c service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:40.250359 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 831/1672] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:41.081076 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60502ad6-ec5e-4aa6-81bb-62952a0cc1b5 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:41.084575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-60502ad6-ec5e-4aa6-81bb-62952a0cc1b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:41.278703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60502ad6-ec5e-4aa6-81bb-62952a0cc1b5 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:41.290743 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2c5aa-4320-42e5-9e0a-9813208a06e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec4f437077c41039cae3d505b43b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:41.291606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2c5aa-4320-42e5-9e0a-9813208a06e6 service placement] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:41.293115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2c5aa-4320-42e5-9e0a-9813208a06e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:41.296567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2c5aa-4320-42e5-9e0a-9813208a06e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:41.314510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-65f2c5aa-4320-42e5-9e0a-9813208a06e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:41.339443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2c5aa-4320-42e5-9e0a-9813208a06e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:41.342898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2c5aa-4320-42e5-9e0a-9813208a06e6 service placement] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:41.372092 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 842/1673] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:42.097423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab7b39-655b-4981-b7cf-a3aa710f8684 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:42.097423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab7b39-655b-4981-b7cf-a3aa710f8684 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:42.097423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab7b39-655b-4981-b7cf-a3aa710f8684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:42.155137 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-aeab7b39-655b-4981-b7cf-a3aa710f8684 None None] MFA Rules not processed for user `50b3952a90ce47f48cc0a820111604f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:42.159165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-aeab7b39-655b-4981-b7cf-a3aa710f8684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:42.291179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:42.448936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2c5aa-4320-42e5-9e0a-9813208a06e6 service placement] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:42.449929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 832/1674] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:42.450499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-65f2c5aa-4320-42e5-9e0a-9813208a06e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:42.627313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:42.730983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2c5aa-4320-42e5-9e0a-9813208a06e6 service placement] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:42.748398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa7eae-7c85-4880-9d7e-6dc7eec51135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:42.749475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa7eae-7c85-4880-9d7e-6dc7eec51135 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:42.749935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa7eae-7c85-4880-9d7e-6dc7eec51135 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:42.750448 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa7eae-7c85-4880-9d7e-6dc7eec51135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:42.769819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa7eae-7c85-4880-9d7e-6dc7eec51135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:42.771945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa7eae-7c85-4880-9d7e-6dc7eec51135 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:42.798797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab7b39-655b-4981-b7cf-a3aa710f8684 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:42.819248 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 843/1675] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:43.076730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab7b39-655b-4981-b7cf-a3aa710f8684 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:43.100612 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa797b47-f3e0-4248-b3c1-e1f64daf05bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:43.101723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa797b47-f3e0-4248-b3c1-e1f64daf05bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:43.105848 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa797b47-f3e0-4248-b3c1-e1f64daf05bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:43.106292 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa797b47-f3e0-4248-b3c1-e1f64daf05bb admin admin] PATH_INFO: `/v3/users/e6334e43aafd407489471af0a76037c6` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:43.112520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa797b47-f3e0-4248-b3c1-e1f64daf05bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6334e43aafd407489471af0a76037c6)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:43.113587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: WARNING py.warnings [None req-fa797b47-f3e0-4248-b3c1-e1f64daf05bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 14:06:43.113587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: warnings.warn(msg) Sep 01 14:06:43.113587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: Sep 01 14:06:43.121984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa797b47-f3e0-4248-b3c1-e1f64daf05bb admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:43.259765 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca786df0-48e9-4d2b-b6bc-5a169cc45dbc None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:43.260250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca786df0-48e9-4d2b-b6bc-5a169cc45dbc None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:43.261195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca786df0-48e9-4d2b-b6bc-5a169cc45dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:43.364871 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-ca786df0-48e9-4d2b-b6bc-5a169cc45dbc None None] MFA Rules not processed for user `9b6dee114b0b4db3ac98075847d613c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:43.366363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ca786df0-48e9-4d2b-b6bc-5a169cc45dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:43.555913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-fa797b47-f3e0-4248-b3c1-e1f64daf05bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6334e43aafd407489471af0a76037c6'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:43.559262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-fa797b47-f3e0-4248-b3c1-e1f64daf05bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6334e43aafd407489471af0a76037c6'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:43.629907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-fa797b47-f3e0-4248-b3c1-e1f64daf05bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6334e43aafd407489471af0a76037c6'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:43.635964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 844/1676] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:06:43.668800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa5276-17cc-43ef-8d77-52ffadb55f6a None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:43.669351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa5276-17cc-43ef-8d77-52ffadb55f6a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:43.669724 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa5276-17cc-43ef-8d77-52ffadb55f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:43.747239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-3afa5276-17cc-43ef-8d77-52ffadb55f6a None None] MFA Rules not processed for user `d7956f61efc44be8abbce5033cc95849`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:43.749099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3afa5276-17cc-43ef-8d77-52ffadb55f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:43.795887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-fa797b47-f3e0-4248-b3c1-e1f64daf05bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6334e43aafd407489471af0a76037c6'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:43.796868 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-fa797b47-f3e0-4248-b3c1-e1f64daf05bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6334e43aafd407489471af0a76037c6'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:43.824761 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 833/1677] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:06:42 2022] DELETE /identity/v3/users/e6334e43aafd407489471af0a76037c6 => generated 0 bytes in 1027 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:43.829536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa797b47-f3e0-4248-b3c1-e1f64daf05bb admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:43.832923 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-fa797b47-f3e0-4248-b3c1-e1f64daf05bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:43.845564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 845/1678] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:43.848403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f61570-6728-41f2-b593-5008020e37eb None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:43.848847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f61570-6728-41f2-b593-5008020e37eb None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:43.849284 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f61570-6728-41f2-b593-5008020e37eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:43.888458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-e6f61570-6728-41f2-b593-5008020e37eb None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:43.891040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e6f61570-6728-41f2-b593-5008020e37eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:43.990356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa797b47-f3e0-4248-b3c1-e1f64daf05bb admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:43.997145 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944d72a-067e-47e5-8bd1-992d576d63cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:43.998392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944d72a-067e-47e5-8bd1-992d576d63cd service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:43.998392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944d72a-067e-47e5-8bd1-992d576d63cd service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:43.998392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944d72a-067e-47e5-8bd1-992d576d63cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:44.000907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2944d72a-067e-47e5-8bd1-992d576d63cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:44.004373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 846/1679] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:44.005278 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f61570-6728-41f2-b593-5008020e37eb None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:44.008871 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e6f61570-6728-41f2-b593-5008020e37eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:44.052322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f61570-6728-41f2-b593-5008020e37eb None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:44.068520 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab557632-da30-4b06-a561-3f5b2c793f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:44.070078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab557632-da30-4b06-a561-3f5b2c793f16 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:44.070370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab557632-da30-4b06-a561-3f5b2c793f16 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:44.070724 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab557632-da30-4b06-a561-3f5b2c793f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:44.140048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944d72a-067e-47e5-8bd1-992d576d63cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:44.148215 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944d72a-067e-47e5-8bd1-992d576d63cd service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:44.187642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 834/1680] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:44.203778 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944d72a-067e-47e5-8bd1-992d576d63cd service nova] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:44.208017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2944d72a-067e-47e5-8bd1-992d576d63cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:44.243775 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab557632-da30-4b06-a561-3f5b2c793f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:44.256240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab557632-da30-4b06-a561-3f5b2c793f16 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:44.304752 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 847/1681] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:44.307200 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab557632-da30-4b06-a561-3f5b2c793f16 service nova] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:44.313015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ab557632-da30-4b06-a561-3f5b2c793f16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:44.327461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944d72a-067e-47e5-8bd1-992d576d63cd service nova] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:44.331890 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e1c88-11f6-4b6b-8ac7-4bb3656691a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:44.332684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e1c88-11f6-4b6b-8ac7-4bb3656691a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:44.333114 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e1c88-11f6-4b6b-8ac7-4bb3656691a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:44.333557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e1c88-11f6-4b6b-8ac7-4bb3656691a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:44.345429 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e1c88-11f6-4b6b-8ac7-4bb3656691a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:44.347899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e1c88-11f6-4b6b-8ac7-4bb3656691a4 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:44.361231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 835/1682] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:44.373628 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab557632-da30-4b06-a561-3f5b2c793f16 service nova] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:44.428945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd79aa-691e-4e64-a584-db037907ae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:44.428945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd79aa-691e-4e64-a584-db037907ae64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:44.428945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd79aa-691e-4e64-a584-db037907ae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:44.428945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd79aa-691e-4e64-a584-db037907ae64 admin admin] PATH_INFO: `/v3/users/f48ccec319ea4ecaba227a46dea29c80` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:44.429403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd79aa-691e-4e64-a584-db037907ae64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f48ccec319ea4ecaba227a46dea29c80)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:44.429403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd79aa-691e-4e64-a584-db037907ae64 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:45.043066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-75fd79aa-691e-4e64-a584-db037907ae64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f48ccec319ea4ecaba227a46dea29c80'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:45.072765 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-75fd79aa-691e-4e64-a584-db037907ae64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f48ccec319ea4ecaba227a46dea29c80'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:45.207474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-75fd79aa-691e-4e64-a584-db037907ae64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f48ccec319ea4ecaba227a46dea29c80'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:45.225155 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-75fd79aa-691e-4e64-a584-db037907ae64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f48ccec319ea4ecaba227a46dea29c80'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:45.225941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-75fd79aa-691e-4e64-a584-db037907ae64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f48ccec319ea4ecaba227a46dea29c80'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:45.238066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 848/1683] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:06:44 2022] DELETE /identity/v3/users/f48ccec319ea4ecaba227a46dea29c80 => generated 0 bytes in 933 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:45.246120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a074597-34ef-4d10-a702-426ac594a3a9 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:45.248922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a074597-34ef-4d10-a702-426ac594a3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:45.248922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a074597-34ef-4d10-a702-426ac594a3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:45.252742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd79aa-691e-4e64-a584-db037907ae64 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:45.254328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-75fd79aa-691e-4e64-a584-db037907ae64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:45.305124 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6a074597-34ef-4d10-a702-426ac594a3a9 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:45.311020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6a074597-34ef-4d10-a702-426ac594a3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:45.498513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 836/1684] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:45.499791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a074597-34ef-4d10-a702-426ac594a3a9 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:45.503766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6a074597-34ef-4d10-a702-426ac594a3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:45.511766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd79aa-691e-4e64-a584-db037907ae64 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:45.519292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:45.521176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:45.524277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:45.524977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] PATH_INFO: `/v3/projects/9d307548f15948e7ae69098e4f31d303` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:45.528360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d307548f15948e7ae69098e4f31d303)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:45.531008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: WARNING py.warnings [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 14:06:45.531008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: warnings.warn(msg) Sep 01 14:06:45.531008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: Sep 01 14:06:45.534133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:45.535125 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a074597-34ef-4d10-a702-426ac594a3a9 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:45.547362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c0e08-0f23-4b49-b366-08cb39eaca5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:45.550652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0e08-0f23-4b49-b366-08cb39eaca5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:45.551525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0e08-0f23-4b49-b366-08cb39eaca5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:45.552067 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0e08-0f23-4b49-b366-08cb39eaca5a admin admin] PATH_INFO: `/v3/users/dbbe63616dfb435cab0b0cdfe3c6b098` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:45.555209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c0e08-0f23-4b49-b366-08cb39eaca5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbbe63616dfb435cab0b0cdfe3c6b098)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:45.558908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c0e08-0f23-4b49-b366-08cb39eaca5a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:45.779100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:45.867944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-232c0e08-0f23-4b49-b366-08cb39eaca5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbbe63616dfb435cab0b0cdfe3c6b098'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:45.868996 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-232c0e08-0f23-4b49-b366-08cb39eaca5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbbe63616dfb435cab0b0cdfe3c6b098'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:45.874100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d307548f15948e7ae69098e4f31d303', 'request_id': 'req-45748158-d8d2-4bc7-b3bb-7747164b0a8a'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:45.898385 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-232c0e08-0f23-4b49-b366-08cb39eaca5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbbe63616dfb435cab0b0cdfe3c6b098'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:45.979307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d307548f15948e7ae69098e4f31d303', 'request_id': 'req-45748158-d8d2-4bc7-b3bb-7747164b0a8a'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:46.008324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d307548f15948e7ae69098e4f31d303', 'request_id': 'req-45748158-d8d2-4bc7-b3bb-7747164b0a8a'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:46.029026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] The token cache is being invalidate because project 9d307548f15948e7ae69098e4f31d303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:06:46.029324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:46.037213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:46.041346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 849/1685] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:06:45 2022] DELETE /identity/v3/projects/9d307548f15948e7ae69098e4f31d303 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:46.043352 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:46.048472 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:46.115559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:46.116683 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-232c0e08-0f23-4b49-b366-08cb39eaca5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbbe63616dfb435cab0b0cdfe3c6b098'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:46.117363 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-232c0e08-0f23-4b49-b366-08cb39eaca5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbbe63616dfb435cab0b0cdfe3c6b098'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:46.141678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 837/1686] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:06:45 2022] DELETE /identity/v3/users/dbbe63616dfb435cab0b0cdfe3c6b098 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:46.143129 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c0e08-0f23-4b49-b366-08cb39eaca5a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:46.145146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-232c0e08-0f23-4b49-b366-08cb39eaca5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:46.176392 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45748158-d8d2-4bc7-b3bb-7747164b0a8a admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:46.255920 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13241df1-7d2b-4770-b9c9-c79a0970fdf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:46.256620 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13241df1-7d2b-4770-b9c9-c79a0970fdf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:46.256912 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13241df1-7d2b-4770-b9c9-c79a0970fdf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:46.257189 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13241df1-7d2b-4770-b9c9-c79a0970fdf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:46.259249 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-13241df1-7d2b-4770-b9c9-c79a0970fdf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:46.273678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c0e08-0f23-4b49-b366-08cb39eaca5a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:46.280579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3bcc9-f144-4cc4-871d-9a8e37902193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:46.281574 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3bcc9-f144-4cc4-871d-9a8e37902193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:46.282214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3bcc9-f144-4cc4-871d-9a8e37902193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:46.282650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3bcc9-f144-4cc4-871d-9a8e37902193 admin admin] PATH_INFO: `/v3/users/f6f9657d260c46928837ab582d95239e` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:46.283282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13241df1-7d2b-4770-b9c9-c79a0970fdf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:46.284533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3bcc9-f144-4cc4-871d-9a8e37902193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f9657d260c46928837ab582d95239e)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:46.285750 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13241df1-7d2b-4770-b9c9-c79a0970fdf8 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:46.286855 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3bcc9-f144-4cc4-871d-9a8e37902193 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:46.303680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 850/1687] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:46.306776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7a566-b398-4d15-a31a-ef0e05699db8 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:46.307231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7a566-b398-4d15-a31a-ef0e05699db8 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:46.308147 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7a566-b398-4d15-a31a-ef0e05699db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:46.342333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-67c7a566-b398-4d15-a31a-ef0e05699db8 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:46.344003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-67c7a566-b398-4d15-a31a-ef0e05699db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:46.353203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 851/1688] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:46.363044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7a566-b398-4d15-a31a-ef0e05699db8 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:46.364636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-67c7a566-b398-4d15-a31a-ef0e05699db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:46.397276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7a566-b398-4d15-a31a-ef0e05699db8 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:46.407089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf80453-82ca-48a1-a391-921109aaf4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:46.408497 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf80453-82ca-48a1-a391-921109aaf4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:46.409419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf80453-82ca-48a1-a391-921109aaf4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:46.409700 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf80453-82ca-48a1-a391-921109aaf4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:46.452460 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf80453-82ca-48a1-a391-921109aaf4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:46.478389 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf80453-82ca-48a1-a391-921109aaf4a7 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:46.542653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 852/1689] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:06:46.704025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-fcc3bcc9-f144-4cc4-871d-9a8e37902193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f9657d260c46928837ab582d95239e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:46.704732 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-fcc3bcc9-f144-4cc4-871d-9a8e37902193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f9657d260c46928837ab582d95239e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:46.730134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-fcc3bcc9-f144-4cc4-871d-9a8e37902193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f9657d260c46928837ab582d95239e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:46.830526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-fcc3bcc9-f144-4cc4-871d-9a8e37902193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f9657d260c46928837ab582d95239e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:46.832030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-fcc3bcc9-f144-4cc4-871d-9a8e37902193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f9657d260c46928837ab582d95239e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:46.878847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 838/1690] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:06:46 2022] DELETE /identity/v3/users/f6f9657d260c46928837ab582d95239e => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:47.467894 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf80453-82ca-48a1-a391-921109aaf4a7 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:47.469460 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ecf80453-82ca-48a1-a391-921109aaf4a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:47.501457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf80453-82ca-48a1-a391-921109aaf4a7 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:47.648713 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:47.686754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e3835-3c07-48a4-88e1-2245b14055c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:47.687758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3835-3c07-48a4-88e1-2245b14055c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:47.688346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3835-3c07-48a4-88e1-2245b14055c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:47.688832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3835-3c07-48a4-88e1-2245b14055c7 admin admin] PATH_INFO: `/v3/projects/8ff53148106a45bfbdab940059811d17` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:47.690278 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e3835-3c07-48a4-88e1-2245b14055c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff53148106a45bfbdab940059811d17)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:47.692514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e3835-3c07-48a4-88e1-2245b14055c7 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:47.950142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-347e3835-3c07-48a4-88e1-2245b14055c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff53148106a45bfbdab940059811d17', 'request_id': 'req-347e3835-3c07-48a4-88e1-2245b14055c7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:48.002306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3bcc9-f144-4cc4-871d-9a8e37902193 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:48.003999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-fcc3bcc9-f144-4cc4-871d-9a8e37902193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:48.032139 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3bcc9-f144-4cc4-871d-9a8e37902193 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:48.126749 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-347e3835-3c07-48a4-88e1-2245b14055c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff53148106a45bfbdab940059811d17', 'request_id': 'req-347e3835-3c07-48a4-88e1-2245b14055c7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:48.135119 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-347e3835-3c07-48a4-88e1-2245b14055c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff53148106a45bfbdab940059811d17', 'request_id': 'req-347e3835-3c07-48a4-88e1-2245b14055c7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:48.146915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc4e9b-4938-4a17-a0ae-d9f794265726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:48.149600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc4e9b-4938-4a17-a0ae-d9f794265726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:48.149974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc4e9b-4938-4a17-a0ae-d9f794265726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:48.150261 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc4e9b-4938-4a17-a0ae-d9f794265726 admin admin] PATH_INFO: `/v3/projects/742adedaed5249168c4254a24554762c` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:48.156657 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc4e9b-4938-4a17-a0ae-d9f794265726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=742adedaed5249168c4254a24554762c)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:48.169391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc4e9b-4938-4a17-a0ae-d9f794265726 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:48.174981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-347e3835-3c07-48a4-88e1-2245b14055c7 admin admin] The token cache is being invalidate because project 8ff53148106a45bfbdab940059811d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:06:48.174981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-347e3835-3c07-48a4-88e1-2245b14055c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:48.177548 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-347e3835-3c07-48a4-88e1-2245b14055c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:48.184313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 853/1691] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:06:47 2022] DELETE /identity/v3/projects/8ff53148106a45bfbdab940059811d17 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:48.189790 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e3835-3c07-48a4-88e1-2245b14055c7 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:48.191931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-347e3835-3c07-48a4-88e1-2245b14055c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:48.252688 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e3835-3c07-48a4-88e1-2245b14055c7 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:48.272761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ddcf9-0281-475d-bfb4-d5453ca27644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:48.277942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ddcf9-0281-475d-bfb4-d5453ca27644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:48.278237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ddcf9-0281-475d-bfb4-d5453ca27644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:48.278519 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ddcf9-0281-475d-bfb4-d5453ca27644 admin admin] PATH_INFO: `/v3/projects/732f1178c62346baad4d9515bcfd1b9d` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:48.281970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ddcf9-0281-475d-bfb4-d5453ca27644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=732f1178c62346baad4d9515bcfd1b9d)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:48.284434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ddcf9-0281-475d-bfb4-d5453ca27644 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:48.403306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-68cc4e9b-4938-4a17-a0ae-d9f794265726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '742adedaed5249168c4254a24554762c', 'request_id': 'req-68cc4e9b-4938-4a17-a0ae-d9f794265726'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:48.419377 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-68cc4e9b-4938-4a17-a0ae-d9f794265726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '742adedaed5249168c4254a24554762c', 'request_id': 'req-68cc4e9b-4938-4a17-a0ae-d9f794265726'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:48.599740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3b7ddcf9-0281-475d-bfb4-d5453ca27644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732f1178c62346baad4d9515bcfd1b9d', 'request_id': 'req-3b7ddcf9-0281-475d-bfb4-d5453ca27644'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:48.670514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-68cc4e9b-4938-4a17-a0ae-d9f794265726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '742adedaed5249168c4254a24554762c', 'request_id': 'req-68cc4e9b-4938-4a17-a0ae-d9f794265726'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:48.689501 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-68cc4e9b-4938-4a17-a0ae-d9f794265726 admin admin] The token cache is being invalidate because project 742adedaed5249168c4254a24554762c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:06:48.690054 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-68cc4e9b-4938-4a17-a0ae-d9f794265726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:48.690840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-68cc4e9b-4938-4a17-a0ae-d9f794265726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:48.693075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 839/1692] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:06:48 2022] DELETE /identity/v3/projects/742adedaed5249168c4254a24554762c => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:06:48.694192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc4e9b-4938-4a17-a0ae-d9f794265726 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:48.696290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-68cc4e9b-4938-4a17-a0ae-d9f794265726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:48.846456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3b7ddcf9-0281-475d-bfb4-d5453ca27644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732f1178c62346baad4d9515bcfd1b9d', 'request_id': 'req-3b7ddcf9-0281-475d-bfb4-d5453ca27644'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:48.854767 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3b7ddcf9-0281-475d-bfb4-d5453ca27644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732f1178c62346baad4d9515bcfd1b9d', 'request_id': 'req-3b7ddcf9-0281-475d-bfb4-d5453ca27644'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:48.870677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc4e9b-4938-4a17-a0ae-d9f794265726 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:48.895423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3b7ddcf9-0281-475d-bfb4-d5453ca27644 admin admin] The token cache is being invalidate because project 732f1178c62346baad4d9515bcfd1b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:06:48.895644 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3b7ddcf9-0281-475d-bfb4-d5453ca27644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:48.901285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3b7ddcf9-0281-475d-bfb4-d5453ca27644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:48.911544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 854/1693] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:06:48 2022] DELETE /identity/v3/projects/732f1178c62346baad4d9515bcfd1b9d => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:48.913062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace59a1-13f1-45af-9cfc-728690ca10e0 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:48.913450 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace59a1-13f1-45af-9cfc-728690ca10e0 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:48.913615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace59a1-13f1-45af-9cfc-728690ca10e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:48.966873 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-5ace59a1-13f1-45af-9cfc-728690ca10e0 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:48.970957 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-5ace59a1-13f1-45af-9cfc-728690ca10e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:49.033242 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4511c2c-bac6-4e3c-9d34-1116379e49d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:49.033904 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4511c2c-bac6-4e3c-9d34-1116379e49d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:49.034355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4511c2c-bac6-4e3c-9d34-1116379e49d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:49.035367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4511c2c-bac6-4e3c-9d34-1116379e49d3 admin admin] PATH_INFO: `/v3/users/ba7f41273885414dbb7556856593860a` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:49.036905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4511c2c-bac6-4e3c-9d34-1116379e49d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba7f41273885414dbb7556856593860a)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:49.041984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4511c2c-bac6-4e3c-9d34-1116379e49d3 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:49.107600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 855/1694] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:49.107600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce61a7-4385-4f58-83cb-4deca548dc80 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:49.107600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce61a7-4385-4f58-83cb-4deca548dc80 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:49.107600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce61a7-4385-4f58-83cb-4deca548dc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:49.170139 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-b9ce61a7-4385-4f58-83cb-4deca548dc80 None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:49.171405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b9ce61a7-4385-4f58-83cb-4deca548dc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:49.267254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 856/1695] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 14:06:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:49.269296 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090698a-207c-406e-b909-b7c105c7e24b None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:49.269801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090698a-207c-406e-b909-b7c105c7e24b None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:49.270377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090698a-207c-406e-b909-b7c105c7e24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:49.296779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-3090698a-207c-406e-b909-b7c105c7e24b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:49.298042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3090698a-207c-406e-b909-b7c105c7e24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:49.312773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 857/1696] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:49.314164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474a20a-f23e-4038-9170-328dc26a5c29 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:49.314450 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474a20a-f23e-4038-9170-328dc26a5c29 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:49.314722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474a20a-f23e-4038-9170-328dc26a5c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:49.374066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1474a20a-f23e-4038-9170-328dc26a5c29 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:49.379797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1474a20a-f23e-4038-9170-328dc26a5c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:49.386767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f4511c2c-bac6-4e3c-9d34-1116379e49d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba7f41273885414dbb7556856593860a'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:49.387750 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f4511c2c-bac6-4e3c-9d34-1116379e49d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba7f41273885414dbb7556856593860a'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:49.411814 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 858/1697] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:49.414355 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f41f4-3495-4c0f-b326-49064a2c509f None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:49.414646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f41f4-3495-4c0f-b326-49064a2c509f None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:49.414922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f41f4-3495-4c0f-b326-49064a2c509f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:49.433033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f4511c2c-bac6-4e3c-9d34-1116379e49d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba7f41273885414dbb7556856593860a'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:49.459776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-831f41f4-3495-4c0f-b326-49064a2c509f None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:49.462360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-831f41f4-3495-4c0f-b326-49064a2c509f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:49.480015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 859/1698] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:49.481065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f41f4-3495-4c0f-b326-49064a2c509f None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:49.497115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f41f4-3495-4c0f-b326-49064a2c509f None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:49.504186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4183eb7-203f-4ce8-a501-ab9485d26274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:49.504962 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4183eb7-203f-4ce8-a501-ab9485d26274 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:49.505309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4183eb7-203f-4ce8-a501-ab9485d26274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:49.505647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4183eb7-203f-4ce8-a501-ab9485d26274 admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:49.506382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4183eb7-203f-4ce8-a501-ab9485d26274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:06:49.506954 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4183eb7-203f-4ce8-a501-ab9485d26274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:49.509162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4183eb7-203f-4ce8-a501-ab9485d26274 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:49.533432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 860/1699] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:06:49.537228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4183eb7-203f-4ce8-a501-ab9485d26274 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:49.569722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4183eb7-203f-4ce8-a501-ab9485d26274 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:49.591341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31f2ca-5953-488f-91c2-4896311e828c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:49.592013 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31f2ca-5953-488f-91c2-4896311e828c admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:49.592300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31f2ca-5953-488f-91c2-4896311e828c admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:49.592575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31f2ca-5953-488f-91c2-4896311e828c admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:49.593236 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31f2ca-5953-488f-91c2-4896311e828c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:06:49.593545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31f2ca-5953-488f-91c2-4896311e828c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:49.595196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31f2ca-5953-488f-91c2-4896311e828c admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:49.609152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 861/1700] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:06:49.610024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31f2ca-5953-488f-91c2-4896311e828c admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:49.614098 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f4511c2c-bac6-4e3c-9d34-1116379e49d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba7f41273885414dbb7556856593860a'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:49.614781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f4511c2c-bac6-4e3c-9d34-1116379e49d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba7f41273885414dbb7556856593860a'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:49.630581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31f2ca-5953-488f-91c2-4896311e828c admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:49.641932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 840/1701] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:06:48 2022] DELETE /identity/v3/users/ba7f41273885414dbb7556856593860a => generated 0 bytes in 945 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:49.642842 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4511c2c-bac6-4e3c-9d34-1116379e49d3 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:49.645199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f4511c2c-bac6-4e3c-9d34-1116379e49d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:49.649436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a616c-953c-43ab-98b5-e2bef7e8c2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:49.652175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a616c-953c-43ab-98b5-e2bef7e8c2cb admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:49.652175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a616c-953c-43ab-98b5-e2bef7e8c2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:49.652175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a616c-953c-43ab-98b5-e2bef7e8c2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:49.652175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a616c-953c-43ab-98b5-e2bef7e8c2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:49.654386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a616c-953c-43ab-98b5-e2bef7e8c2cb admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:49.754551 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4511c2c-bac6-4e3c-9d34-1116379e49d3 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:49.760947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44741da9-fdcc-412d-9d09-8836476e8525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:49.762064 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44741da9-fdcc-412d-9d09-8836476e8525 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:49.762452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44741da9-fdcc-412d-9d09-8836476e8525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:49.762732 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44741da9-fdcc-412d-9d09-8836476e8525 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:49.764075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44741da9-fdcc-412d-9d09-8836476e8525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:49.766240 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44741da9-fdcc-412d-9d09-8836476e8525 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:49.798227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 862/1702] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:49 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:49.800538 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a616c-953c-43ab-98b5-e2bef7e8c2cb admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:49.804256 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-016a616c-953c-43ab-98b5-e2bef7e8c2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:49.921484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a616c-953c-43ab-98b5-e2bef7e8c2cb admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:49.929298 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed491b-6c59-4f1d-9caf-5b1de0476fed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:49.936334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed491b-6c59-4f1d-9caf-5b1de0476fed service swift] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:49.936334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed491b-6c59-4f1d-9caf-5b1de0476fed service swift] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:49.936334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed491b-6c59-4f1d-9caf-5b1de0476fed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:49.938707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-7aed491b-6c59-4f1d-9caf-5b1de0476fed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:50.035074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed491b-6c59-4f1d-9caf-5b1de0476fed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:50.037285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed491b-6c59-4f1d-9caf-5b1de0476fed service swift] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:50.037726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 841/1703] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:49 2022] POST /identity/v3/projects => generated 365 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:50.041000 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44741da9-fdcc-412d-9d09-8836476e8525 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:50.043609 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-44741da9-fdcc-412d-9d09-8836476e8525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:50.059666 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 863/1704] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:06:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:06:50.064109 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc697029-07b2-40fe-8144-a406abfe5bc6 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:50.064470 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc697029-07b2-40fe-8144-a406abfe5bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:50.069003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc697029-07b2-40fe-8144-a406abfe5bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:50.111317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-bc697029-07b2-40fe-8144-a406abfe5bc6 None None] MFA Rules not processed for user `50b3952a90ce47f48cc0a820111604f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:50.111948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:50.114095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-bc697029-07b2-40fe-8144-a406abfe5bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:50.278582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44741da9-fdcc-412d-9d09-8836476e8525 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:50.294111 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e44e3-b58c-46ba-8f8a-436fd3a1096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:50.295283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e44e3-b58c-46ba-8f8a-436fd3a1096c admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:50.295821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e44e3-b58c-46ba-8f8a-436fd3a1096c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:50.297255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e44e3-b58c-46ba-8f8a-436fd3a1096c admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:50.298682 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e44e3-b58c-46ba-8f8a-436fd3a1096c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:50.301854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e44e3-b58c-46ba-8f8a-436fd3a1096c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:50.320513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 864/1705] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:50.322887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf1bca-deaa-4478-b9ce-1d1d4c73877e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:50.325173 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf1bca-deaa-4478-b9ce-1d1d4c73877e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:50.325665 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf1bca-deaa-4478-b9ce-1d1d4c73877e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:50.359356 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-15cf1bca-deaa-4478-b9ce-1d1d4c73877e None None] MFA Rules not processed for user `d7956f61efc44be8abbce5033cc95849`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:50.361690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-15cf1bca-deaa-4478-b9ce-1d1d4c73877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:50.466652 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 865/1706] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:50.466652 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf1bca-deaa-4478-b9ce-1d1d4c73877e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:50.498769 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 842/1707] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:50 2022] POST /identity/v3/users => generated 288 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:50.511220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e44e3-b58c-46ba-8f8a-436fd3a1096c admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:50.532290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e44e3-b58c-46ba-8f8a-436fd3a1096c admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:50.534601 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf1bca-deaa-4478-b9ce-1d1d4c73877e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:50.543878 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d70e-2d40-4477-916e-71eb68cd16b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:50.545269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d70e-2d40-4477-916e-71eb68cd16b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:50.546053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5aba5b-55e5-4ad5-ae84-ef341511247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:50.546970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aba5b-55e5-4ad5-ae84-ef341511247f admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:50.547492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d70e-2d40-4477-916e-71eb68cd16b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:50.548350 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aba5b-55e5-4ad5-ae84-ef341511247f admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:50.548703 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d70e-2d40-4477-916e-71eb68cd16b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:50.549728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706d70e-2d40-4477-916e-71eb68cd16b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:50.550239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aba5b-55e5-4ad5-ae84-ef341511247f admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:50.551115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5aba5b-55e5-4ad5-ae84-ef341511247f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:50.554826 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5aba5b-55e5-4ad5-ae84-ef341511247f admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:50.555633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e706d70e-2d40-4477-916e-71eb68cd16b1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:50.584639 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 843/1708] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:50.589164 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d70e-2d40-4477-916e-71eb68cd16b1 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:50.609631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d70e-2d40-4477-916e-71eb68cd16b1 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:50.616021 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611549f-6cd9-4eee-b71a-e6f0dd7989b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:50.617305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611549f-6cd9-4eee-b71a-e6f0dd7989b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:50.617944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611549f-6cd9-4eee-b71a-e6f0dd7989b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:50.618513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611549f-6cd9-4eee-b71a-e6f0dd7989b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:50.619371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611549f-6cd9-4eee-b71a-e6f0dd7989b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:50.622199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611549f-6cd9-4eee-b71a-e6f0dd7989b6 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:50.646912 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 844/1709] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:50.656753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611549f-6cd9-4eee-b71a-e6f0dd7989b6 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:50.686859 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611549f-6cd9-4eee-b71a-e6f0dd7989b6 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:50.700374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165516c-4dc9-4a7b-a3db-b706d8b207fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:50.701224 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165516c-4dc9-4a7b-a3db-b706d8b207fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:50.702709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165516c-4dc9-4a7b-a3db-b706d8b207fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:50.703326 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165516c-4dc9-4a7b-a3db-b706d8b207fe admin admin] PATH_INFO: `/v3/projects/25a7792b8dfa41e49e1745afde90902c/users/11c33e6e5c984c1ba306a2324d69f26a/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:50.754021 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165516c-4dc9-4a7b-a3db-b706d8b207fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a7792b8dfa41e49e1745afde90902c, user_id=11c33e6e5c984c1ba306a2324d69f26a, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:50.760156 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165516c-4dc9-4a7b-a3db-b706d8b207fe admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:50.899891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 866/1710] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:50 2022] POST /identity/v3/users => generated 283 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:50.904105 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5aba5b-55e5-4ad5-ae84-ef341511247f admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:50.928939 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5aba5b-55e5-4ad5-ae84-ef341511247f admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:50.966579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 845/1711] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:50 2022] PUT /identity/v3/projects/25a7792b8dfa41e49e1745afde90902c/users/11c33e6e5c984c1ba306a2324d69f26a/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:06:50.978772 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef945-85ff-4bd8-b0de-81a3320bfce0 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:50.980034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef945-85ff-4bd8-b0de-81a3320bfce0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:50.980621 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ad544-50e1-4306-b59f-5d8009bed716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:50.980982 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef945-85ff-4bd8-b0de-81a3320bfce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:50.982758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ad544-50e1-4306-b59f-5d8009bed716 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:50.983070 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ad544-50e1-4306-b59f-5d8009bed716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:50.983354 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ad544-50e1-4306-b59f-5d8009bed716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:50.985309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ad544-50e1-4306-b59f-5d8009bed716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:50.993542 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ad544-50e1-4306-b59f-5d8009bed716 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:51.045180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 867/1712] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:06:51.048874 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ad544-50e1-4306-b59f-5d8009bed716 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:51.051282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-640ef945-85ff-4bd8-b0de-81a3320bfce0 None None] MFA Rules not processed for user `11c33e6e5c984c1ba306a2324d69f26a`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:51.055056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-640ef945-85ff-4bd8-b0de-81a3320bfce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:51.115305 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ad544-50e1-4306-b59f-5d8009bed716 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:51.197666 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 846/1713] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:51.202173 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ef945-85ff-4bd8-b0de-81a3320bfce0 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:51.202173 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-640ef945-85ff-4bd8-b0de-81a3320bfce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:51.298277 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ef945-85ff-4bd8-b0de-81a3320bfce0 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:51.304106 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc027f-5718-444b-9edf-ba1da1be900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:51.304982 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc027f-5718-444b-9edf-ba1da1be900d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:51.305378 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc027f-5718-444b-9edf-ba1da1be900d admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:51.305770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc027f-5718-444b-9edf-ba1da1be900d admin admin] PATH_INFO: `/v3/projects/f9411aeaf36c4707a0f46f8d1fc3dc96` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:51.319983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc027f-5718-444b-9edf-ba1da1be900d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9411aeaf36c4707a0f46f8d1fc3dc96)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:51.325845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc027f-5718-444b-9edf-ba1da1be900d admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:51.342974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b169c3-a42e-4bf3-8382-db194f96dff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:51.344015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b169c3-a42e-4bf3-8382-db194f96dff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:51.344015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b169c3-a42e-4bf3-8382-db194f96dff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:51.344286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b169c3-a42e-4bf3-8382-db194f96dff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:51.346686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b169c3-a42e-4bf3-8382-db194f96dff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:51.350900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b169c3-a42e-4bf3-8382-db194f96dff6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:51.381466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 868/1714] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:51.385750 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b169c3-a42e-4bf3-8382-db194f96dff6 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:51.387309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:51.429142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b169c3-a42e-4bf3-8382-db194f96dff6 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:51.446334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d678661-8417-415d-9139-a69978e8c4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:51.451039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d678661-8417-415d-9139-a69978e8c4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:51.451039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d678661-8417-415d-9139-a69978e8c4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:51.451039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d678661-8417-415d-9139-a69978e8c4f4 admin admin] PATH_INFO: `/v3/projects/5856d2bb12324e83b2fdc9e08c49dcb1/users/4077db65ac97477797432d59f82cb9b3/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:51.474308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d678661-8417-415d-9139-a69978e8c4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5856d2bb12324e83b2fdc9e08c49dcb1, user_id=4077db65ac97477797432d59f82cb9b3, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:51.477615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d678661-8417-415d-9139-a69978e8c4f4 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:51.584301 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 869/1715] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:51 2022] PUT /identity/v3/projects/5856d2bb12324e83b2fdc9e08c49dcb1/users/4077db65ac97477797432d59f82cb9b3/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:51.597241 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b666396-1b61-4986-ab01-53548e48df28 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:51.597738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b666396-1b61-4986-ab01-53548e48df28 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:51.598191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b666396-1b61-4986-ab01-53548e48df28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:51.604156 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-00bc027f-5718-444b-9edf-ba1da1be900d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9411aeaf36c4707a0f46f8d1fc3dc96', 'request_id': 'req-00bc027f-5718-444b-9edf-ba1da1be900d'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:51.621482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-00bc027f-5718-444b-9edf-ba1da1be900d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9411aeaf36c4707a0f46f8d1fc3dc96', 'request_id': 'req-00bc027f-5718-444b-9edf-ba1da1be900d'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:51.694644 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1b666396-1b61-4986-ab01-53548e48df28 None None] MFA Rules not processed for user `4077db65ac97477797432d59f82cb9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:51.696792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1b666396-1b61-4986-ab01-53548e48df28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:51.732612 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-00bc027f-5718-444b-9edf-ba1da1be900d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9411aeaf36c4707a0f46f8d1fc3dc96', 'request_id': 'req-00bc027f-5718-444b-9edf-ba1da1be900d'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:51.752766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-00bc027f-5718-444b-9edf-ba1da1be900d admin admin] The token cache is being invalidate because project f9411aeaf36c4707a0f46f8d1fc3dc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:06:51.753209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-00bc027f-5718-444b-9edf-ba1da1be900d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:51.756680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-00bc027f-5718-444b-9edf-ba1da1be900d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:51.772312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 847/1716] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:06:51 2022] DELETE /identity/v3/projects/f9411aeaf36c4707a0f46f8d1fc3dc96 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:51.772312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e0cfd-5039-421a-a7f9-81a15b674ab4 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:51.772312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e0cfd-5039-421a-a7f9-81a15b674ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:51.772312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e0cfd-5039-421a-a7f9-81a15b674ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:51.814680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6b5e0cfd-5039-421a-a7f9-81a15b674ab4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:51.816026 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6b5e0cfd-5039-421a-a7f9-81a15b674ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:51.847216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 870/1717] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:51.849303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b666396-1b61-4986-ab01-53548e48df28 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:51.852758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1b666396-1b61-4986-ab01-53548e48df28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:51.919675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:52.039495 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 848/1718] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:52.039495 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983e26e-66fe-4465-a4da-8df01bdca3df None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:52.039495 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983e26e-66fe-4465-a4da-8df01bdca3df None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:52.039495 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983e26e-66fe-4465-a4da-8df01bdca3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:52.040361 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b666396-1b61-4986-ab01-53548e48df28 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:52.040511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6983e26e-66fe-4465-a4da-8df01bdca3df None None] MFA Rules not processed for user `4a9703db64624bbeb392d693ca60c6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:52.040511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6983e26e-66fe-4465-a4da-8df01bdca3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:52.040899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6e480-34e4-412a-9957-ef01d7411412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:52.040899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6e480-34e4-412a-9957-ef01d7411412 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:52.040899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6e480-34e4-412a-9957-ef01d7411412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:52.040899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6e480-34e4-412a-9957-ef01d7411412 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:52.041357 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6e480-34e4-412a-9957-ef01d7411412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:52.041357 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6e480-34e4-412a-9957-ef01d7411412 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:52.097376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 849/1719] 10.222.0.69 () {58 vars in 1015 bytes} [Thu Sep 1 14:06:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:52.141410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38cfb9-8577-4ca7-a400-d9027f2a1eff None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:52.141410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38cfb9-8577-4ca7-a400-d9027f2a1eff None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:52.141410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38cfb9-8577-4ca7-a400-d9027f2a1eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:52.141410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-2b38cfb9-8577-4ca7-a400-d9027f2a1eff None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:52.141410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2b38cfb9-8577-4ca7-a400-d9027f2a1eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:52.141410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 850/1720] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:52.144539 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38cfb9-8577-4ca7-a400-d9027f2a1eff None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:52.156541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38cfb9-8577-4ca7-a400-d9027f2a1eff None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:52.163042 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287dc56-836b-4526-8a09-fa8f2a0d944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:52.164358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287dc56-836b-4526-8a09-fa8f2a0d944b admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:52.164607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287dc56-836b-4526-8a09-fa8f2a0d944b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:52.164889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8287dc56-836b-4526-8a09-fa8f2a0d944b admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:52.165544 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287dc56-836b-4526-8a09-fa8f2a0d944b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:06:52.165851 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287dc56-836b-4526-8a09-fa8f2a0d944b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:52.167962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8287dc56-836b-4526-8a09-fa8f2a0d944b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:52.189210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 851/1721] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:06:52.189210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287dc56-836b-4526-8a09-fa8f2a0d944b admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:52.241099 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-8287dc56-836b-4526-8a09-fa8f2a0d944b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:52.241099 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8287dc56-836b-4526-8a09-fa8f2a0d944b admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:52.241099 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8b178-ec49-4d2d-b6ce-d6fe10229ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:52.241376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8b178-ec49-4d2d-b6ce-d6fe10229ccb service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:52.241376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8b178-ec49-4d2d-b6ce-d6fe10229ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:52.241376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8b178-ec49-4d2d-b6ce-d6fe10229ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:52.241376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8b178-ec49-4d2d-b6ce-d6fe10229ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:52.241376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8b178-ec49-4d2d-b6ce-d6fe10229ccb service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:52.241376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 852/1722] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:52.241767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ae396-8800-4fea-a6ac-8e429bc55fe2 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:52.241767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ae396-8800-4fea-a6ac-8e429bc55fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:52.241767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ae396-8800-4fea-a6ac-8e429bc55fe2 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:52.241767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 853/1723] 10.222.0.64 () {54 vars in 912 bytes} [Thu Sep 1 14:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:06:52.241767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9eaa7-e917-4cfd-8ec5-8dff924cf7a4 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:52.241767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9eaa7-e917-4cfd-8ec5-8dff924cf7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:52.242183 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9eaa7-e917-4cfd-8ec5-8dff924cf7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:52.274711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-abe9eaa7-e917-4cfd-8ec5-8dff924cf7a4 None None] MFA Rules not processed for user `4a9703db64624bbeb392d693ca60c6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:52.280525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-abe9eaa7-e917-4cfd-8ec5-8dff924cf7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:52.286309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 871/1724] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:51 2022] POST /identity/v3/projects => generated 365 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:52.294813 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6e480-34e4-412a-9957-ef01d7411412 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:52.366630 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 854/1725] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 14:06:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:06:52.367900 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9eaa7-e917-4cfd-8ec5-8dff924cf7a4 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:52.382279 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6e480-34e4-412a-9957-ef01d7411412 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:52.390709 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d24bb-49d5-43cb-b211-dd208032ede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:52.391363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d24bb-49d5-43cb-b211-dd208032ede7 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:52.391630 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d24bb-49d5-43cb-b211-dd208032ede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:52.391934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d24bb-49d5-43cb-b211-dd208032ede7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:52.392599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d24bb-49d5-43cb-b211-dd208032ede7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:52.394560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d24bb-49d5-43cb-b211-dd208032ede7 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:52.504795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9eaa7-e917-4cfd-8ec5-8dff924cf7a4 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:52.517026 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c675764-4198-4969-9c22-ea6ac1703a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:52.517669 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c675764-4198-4969-9c22-ea6ac1703a66 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:52.519584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c675764-4198-4969-9c22-ea6ac1703a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:52.519888 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c675764-4198-4969-9c22-ea6ac1703a66 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:52.520532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c675764-4198-4969-9c22-ea6ac1703a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:52.544905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c675764-4198-4969-9c22-ea6ac1703a66 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:52.686579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 855/1726] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:52 2022] POST /identity/v3/users => generated 289 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:52.686579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c675764-4198-4969-9c22-ea6ac1703a66 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:52.704113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c675764-4198-4969-9c22-ea6ac1703a66 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:52.706030 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 872/1727] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:52 2022] POST /identity/v3/projects => generated 369 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:52.713298 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ef9ba-28a7-4b87-89db-d0e9f897dea2 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:52.714370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ef9ba-28a7-4b87-89db-d0e9f897dea2 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:52.714794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ef9ba-28a7-4b87-89db-d0e9f897dea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:52.789863 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-ab4ef9ba-28a7-4b87-89db-d0e9f897dea2 None None] MFA Rules not processed for user `9b6dee114b0b4db3ac98075847d613c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:52.797699 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ab4ef9ba-28a7-4b87-89db-d0e9f897dea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:52.922901 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71348b3c-a65b-4c00-b9c9-4a8b0d242fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:52.922901 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71348b3c-a65b-4c00-b9c9-4a8b0d242fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:52.923068 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 873/1728] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:52.923521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71348b3c-a65b-4c00-b9c9-4a8b0d242fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:52.923521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71348b3c-a65b-4c00-b9c9-4a8b0d242fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:52.923695 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ef9ba-28a7-4b87-89db-d0e9f897dea2 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:52.943538 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71348b3c-a65b-4c00-b9c9-4a8b0d242fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:52.945344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71348b3c-a65b-4c00-b9c9-4a8b0d242fb2 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:52.964207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 856/1729] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:52.968743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71348b3c-a65b-4c00-b9c9-4a8b0d242fb2 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:53.090136 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ef9ba-28a7-4b87-89db-d0e9f897dea2 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:53.103069 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1639666-6874-4dc1-9bee-8993ce0cd1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:53.103710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1639666-6874-4dc1-9bee-8993ce0cd1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:53.104059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1639666-6874-4dc1-9bee-8993ce0cd1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:53.104868 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1639666-6874-4dc1-9bee-8993ce0cd1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:53.105522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1639666-6874-4dc1-9bee-8993ce0cd1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:53.107149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1639666-6874-4dc1-9bee-8993ce0cd1e3 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:53.115374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71348b3c-a65b-4c00-b9c9-4a8b0d242fb2 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:53.127422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 874/1730] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:53.130443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1639666-6874-4dc1-9bee-8993ce0cd1e3 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:53.130777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055cd88-6bb5-49b0-8208-485f0e0a2adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:53.131719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055cd88-6bb5-49b0-8208-485f0e0a2adb admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:53.133025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055cd88-6bb5-49b0-8208-485f0e0a2adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:53.133521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055cd88-6bb5-49b0-8208-485f0e0a2adb admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:53.135216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055cd88-6bb5-49b0-8208-485f0e0a2adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:53.138752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055cd88-6bb5-49b0-8208-485f0e0a2adb admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:53.146187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1639666-6874-4dc1-9bee-8993ce0cd1e3 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:53.171274 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342567c-0a84-4f1d-b162-b51f5db7fb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:53.174395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342567c-0a84-4f1d-b162-b51f5db7fb4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:53.174497 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342567c-0a84-4f1d-b162-b51f5db7fb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:53.174770 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342567c-0a84-4f1d-b162-b51f5db7fb4b admin admin] PATH_INFO: `/v3/projects/a3c59685ba8a49dc87644feb25d7c72e/users/200aad829d2447a6bda94526760afd0f/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:53.205887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342567c-0a84-4f1d-b162-b51f5db7fb4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c59685ba8a49dc87644feb25d7c72e, user_id=200aad829d2447a6bda94526760afd0f, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:53.209004 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342567c-0a84-4f1d-b162-b51f5db7fb4b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:53.318042 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 857/1731] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:52 2022] POST /identity/v3/users => generated 285 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:53.322324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055cd88-6bb5-49b0-8208-485f0e0a2adb admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:53.355316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 875/1732] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:53 2022] PUT /identity/v3/projects/a3c59685ba8a49dc87644feb25d7c72e/users/200aad829d2447a6bda94526760afd0f/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:53.359228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342567c-0a84-4f1d-b162-b51f5db7fb4b admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:53.362944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055cd88-6bb5-49b0-8208-485f0e0a2adb admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:53.504588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b6ce8-882a-463d-b217-c5e23d4dc7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:53.506214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b6ce8-882a-463d-b217-c5e23d4dc7db admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:53.506840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b6ce8-882a-463d-b217-c5e23d4dc7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:53.507494 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b6ce8-882a-463d-b217-c5e23d4dc7db admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:53.514146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b6ce8-882a-463d-b217-c5e23d4dc7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:53.517849 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b6ce8-882a-463d-b217-c5e23d4dc7db admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:53.554925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 858/1733] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:53.560065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b6ce8-882a-463d-b217-c5e23d4dc7db admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:53.561807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342567c-0a84-4f1d-b162-b51f5db7fb4b admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:53.569267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d7c2b-0092-4275-9a43-a325be6fb6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:53.570139 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d7c2b-0092-4275-9a43-a325be6fb6be admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:53.570439 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d7c2b-0092-4275-9a43-a325be6fb6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:53.570720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d7c2b-0092-4275-9a43-a325be6fb6be admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:53.571884 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d7c2b-0092-4275-9a43-a325be6fb6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:53.574037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d7c2b-0092-4275-9a43-a325be6fb6be admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:53.604179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b6ce8-882a-463d-b217-c5e23d4dc7db admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:53.618656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a8f47-58f8-44e7-9400-89ee80239f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:53.618656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a8f47-58f8-44e7-9400-89ee80239f0f admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:53.618656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a8f47-58f8-44e7-9400-89ee80239f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:53.618656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a8f47-58f8-44e7-9400-89ee80239f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:53.619184 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a8f47-58f8-44e7-9400-89ee80239f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:53.619287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 876/1734] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:53.619287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d7c2b-0092-4275-9a43-a325be6fb6be admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:53.619455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a8f47-58f8-44e7-9400-89ee80239f0f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:53.619536 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-aa6d7c2b-0092-4275-9a43-a325be6fb6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:53.654318 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 859/1735] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:53.670462 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a8f47-58f8-44e7-9400-89ee80239f0f admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:53.670462 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a8f47-58f8-44e7-9400-89ee80239f0f admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:53.676072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206095e-3746-440b-a919-62f2af7fb4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:53.677196 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206095e-3746-440b-a919-62f2af7fb4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:53.677710 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206095e-3746-440b-a919-62f2af7fb4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:53.678468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206095e-3746-440b-a919-62f2af7fb4d8 admin admin] PATH_INFO: `/v3/projects/a3c59685ba8a49dc87644feb25d7c72e/users/200aad829d2447a6bda94526760afd0f/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:53.697587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206095e-3746-440b-a919-62f2af7fb4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3c59685ba8a49dc87644feb25d7c72e, user_id=200aad829d2447a6bda94526760afd0f, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:53.716404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206095e-3746-440b-a919-62f2af7fb4d8 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:53.744354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 860/1736] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:53 2022] PUT /identity/v3/projects/a3c59685ba8a49dc87644feb25d7c72e/users/200aad829d2447a6bda94526760afd0f/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:53.754136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206095e-3746-440b-a919-62f2af7fb4d8 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:53.789800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d7c2b-0092-4275-9a43-a325be6fb6be admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:53.898279 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206095e-3746-440b-a919-62f2af7fb4d8 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:53.925919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4701aa7-c511-4649-9738-11fc2f4237f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:53.926508 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4701aa7-c511-4649-9738-11fc2f4237f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:53.926860 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4701aa7-c511-4649-9738-11fc2f4237f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:53.927172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4701aa7-c511-4649-9738-11fc2f4237f1 admin admin] PATH_INFO: `/v3/projects/0939945e83454b0585abaa4108ad7d79/users/6629d833269049778d80689c7dd4f715/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:53.959611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f67df-716b-4fc6-b95a-c334d19ba7b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:53.960484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f67df-716b-4fc6-b95a-c334d19ba7b3 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:53.961067 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f67df-716b-4fc6-b95a-c334d19ba7b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:53.961462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f67df-716b-4fc6-b95a-c334d19ba7b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:53.963712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e96f67df-716b-4fc6-b95a-c334d19ba7b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:53.979996 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4701aa7-c511-4649-9738-11fc2f4237f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0939945e83454b0585abaa4108ad7d79, user_id=6629d833269049778d80689c7dd4f715, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:54.011649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4701aa7-c511-4649-9738-11fc2f4237f1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:54.135122 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f67df-716b-4fc6-b95a-c334d19ba7b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:54.159918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 861/1737] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:53 2022] PUT /identity/v3/projects/0939945e83454b0585abaa4108ad7d79/users/6629d833269049778d80689c7dd4f715/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:54.184629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423c785-8062-4b6f-be03-f6587c08781c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:54.184629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423c785-8062-4b6f-be03-f6587c08781c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:54.184941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423c785-8062-4b6f-be03-f6587c08781c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:54.187522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f67df-716b-4fc6-b95a-c334d19ba7b3 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:54.220760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 877/1738] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:54.222538 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d9cc8-3d44-4bf9-8c83-c7b8b32a089f None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:54.222883 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d9cc8-3d44-4bf9-8c83-c7b8b32a089f None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:54.225244 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d9cc8-3d44-4bf9-8c83-c7b8b32a089f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:54.319129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-081d9cc8-3d44-4bf9-8c83-c7b8b32a089f None None] MFA Rules not processed for user `6629d833269049778d80689c7dd4f715`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:54.320522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-081d9cc8-3d44-4bf9-8c83-c7b8b32a089f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:54.322491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-9423c785-8062-4b6f-be03-f6587c08781c None None] MFA Rules not processed for user `200aad829d2447a6bda94526760afd0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:54.345596 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-9423c785-8062-4b6f-be03-f6587c08781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:54.561688 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 862/1739] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:54.575303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423c785-8062-4b6f-be03-f6587c08781c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:54.578309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-9423c785-8062-4b6f-be03-f6587c08781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:54.583037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 878/1740] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:54.587422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d9cc8-3d44-4bf9-8c83-c7b8b32a089f None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:54.761820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d9cc8-3d44-4bf9-8c83-c7b8b32a089f None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:54.781608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423c785-8062-4b6f-be03-f6587c08781c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:54.785794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459df2d-bc42-43f2-968e-d99592121996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:54.790263 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459df2d-bc42-43f2-968e-d99592121996 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:54.790799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459df2d-bc42-43f2-968e-d99592121996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:54.791426 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459df2d-bc42-43f2-968e-d99592121996 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:54.792878 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459df2d-bc42-43f2-968e-d99592121996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:54.796877 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8619dbd-674a-4bf7-9bd3-edd077d20215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:54.797920 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619dbd-674a-4bf7-9bd3-edd077d20215 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:54.798310 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619dbd-674a-4bf7-9bd3-edd077d20215 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:54.799884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619dbd-674a-4bf7-9bd3-edd077d20215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:54.802101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459df2d-bc42-43f2-968e-d99592121996 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:54.827390 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8619dbd-674a-4bf7-9bd3-edd077d20215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:54.833381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8619dbd-674a-4bf7-9bd3-edd077d20215 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:54.877419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 863/1741] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:54.898063 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5987609-60eb-4e7b-8517-7443fbb99920 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:54.898491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5987609-60eb-4e7b-8517-7443fbb99920 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:54.898807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5987609-60eb-4e7b-8517-7443fbb99920 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:54.901788 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 864/1742] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 14:06:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 14:06:54.958060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2eacf-4f96-4c96-a18e-d98a97311967 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:54.958060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2eacf-4f96-4c96-a18e-d98a97311967 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:54.958060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2eacf-4f96-4c96-a18e-d98a97311967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:55.003298 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 879/1743] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:54 2022] POST /identity/v3/projects => generated 367 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:55.004499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-19c2eacf-4f96-4c96-a18e-d98a97311967 None None] MFA Rules not processed for user `4b3c8a90b97246a98612b627b5f8da80`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:55.005467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459df2d-bc42-43f2-968e-d99592121996 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:55.006346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-19c2eacf-4f96-4c96-a18e-d98a97311967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:55.152504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459df2d-bc42-43f2-968e-d99592121996 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:55.162219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf6a90-fdeb-48ec-b20b-03c0251f147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:55.163562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf6a90-fdeb-48ec-b20b-03c0251f147d admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:55.170804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf6a90-fdeb-48ec-b20b-03c0251f147d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:55.170804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf6a90-fdeb-48ec-b20b-03c0251f147d admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:55.170804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf6a90-fdeb-48ec-b20b-03c0251f147d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:55.170804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf6a90-fdeb-48ec-b20b-03c0251f147d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:55.184063 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 865/1744] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 14:06:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:55.320187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 880/1745] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:06:55 2022] POST /identity/v3/users => generated 290 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:06:55.320291 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2eacf-4f96-4c96-a18e-d98a97311967 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:55.332230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf6a90-fdeb-48ec-b20b-03c0251f147d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:55.336342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2eacf-4f96-4c96-a18e-d98a97311967 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:55.367597 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6122d-7bb5-435a-8555-e65d432c37d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:55.368381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6122d-7bb5-435a-8555-e65d432c37d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:55.369032 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6122d-7bb5-435a-8555-e65d432c37d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:55.369032 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6122d-7bb5-435a-8555-e65d432c37d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:55.370537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6122d-7bb5-435a-8555-e65d432c37d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:55.376006 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6122d-7bb5-435a-8555-e65d432c37d7 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:55.396562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:55.414621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 866/1746] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:55.415748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6122d-7bb5-435a-8555-e65d432c37d7 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:55.435101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf6a90-fdeb-48ec-b20b-03c0251f147d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:55.438300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6122d-7bb5-435a-8555-e65d432c37d7 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:55.439385 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b54d-8e23-4da4-8d42-d7722324b084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:55.440111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b54d-8e23-4da4-8d42-d7722324b084 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:55.440466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b54d-8e23-4da4-8d42-d7722324b084 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:55.440809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b54d-8e23-4da4-8d42-d7722324b084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:55.443634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbcfda-0bc2-4539-a43b-a982e77b3668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:55.444431 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbcfda-0bc2-4539-a43b-a982e77b3668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:55.444773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbcfda-0bc2-4539-a43b-a982e77b3668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:55.445119 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbcfda-0bc2-4539-a43b-a982e77b3668 admin admin] PATH_INFO: `/v3/projects/2a2cbe161b16413bbf909dca99d551d1/users/ae9c0835fec3404cbbec97084da6d274/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:55.496674 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbcfda-0bc2-4539-a43b-a982e77b3668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2cbe161b16413bbf909dca99d551d1, user_id=ae9c0835fec3404cbbec97084da6d274, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:55.499774 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbcfda-0bc2-4539-a43b-a982e77b3668 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:55.535308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4b54d-8e23-4da4-8d42-d7722324b084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:55.540222 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4b54d-8e23-4da4-8d42-d7722324b084 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:55.571642 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 881/1747] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:06:55.640493 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 867/1748] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:55 2022] PUT /identity/v3/projects/2a2cbe161b16413bbf909dca99d551d1/users/ae9c0835fec3404cbbec97084da6d274/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:55.644941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b54d-8e23-4da4-8d42-d7722324b084 service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:55.661123 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b54d-8e23-4da4-8d42-d7722324b084 service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:55.778006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfbf94-05be-49aa-82ae-eda162896144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:55.778712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfbf94-05be-49aa-82ae-eda162896144 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:55.779065 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfbf94-05be-49aa-82ae-eda162896144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:55.779401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfbf94-05be-49aa-82ae-eda162896144 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:55.780681 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfbf94-05be-49aa-82ae-eda162896144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:55.783129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfbf94-05be-49aa-82ae-eda162896144 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:55.798841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 882/1749] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:06:55.802932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbcfda-0bc2-4539-a43b-a982e77b3668 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:55.831579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbcfda-0bc2-4539-a43b-a982e77b3668 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:55.846569 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae091c78-fe5b-441f-8b08-7ba5656760d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:55.850751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae091c78-fe5b-441f-8b08-7ba5656760d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:55.850908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae091c78-fe5b-441f-8b08-7ba5656760d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:55.851190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae091c78-fe5b-441f-8b08-7ba5656760d5 admin admin] PATH_INFO: `/v3/projects/2a2cbe161b16413bbf909dca99d551d1/users/ae9c0835fec3404cbbec97084da6d274/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:55.856673 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae091c78-fe5b-441f-8b08-7ba5656760d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2cbe161b16413bbf909dca99d551d1, user_id=ae9c0835fec3404cbbec97084da6d274, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:55.890491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae091c78-fe5b-441f-8b08-7ba5656760d5 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:55.901763 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfbf94-05be-49aa-82ae-eda162896144 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:55.907242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-29cfbf94-05be-49aa-82ae-eda162896144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:55.911459 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:55.954791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 868/1750] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:06:55 2022] PUT /identity/v3/projects/2a2cbe161b16413bbf909dca99d551d1/users/ae9c0835fec3404cbbec97084da6d274/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:55.958733 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4076e39-582a-48ac-8bb1-3beb9c0d9661 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:55.959003 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4076e39-582a-48ac-8bb1-3beb9c0d9661 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:55.959377 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4076e39-582a-48ac-8bb1-3beb9c0d9661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:56.028211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b4076e39-582a-48ac-8bb1-3beb9c0d9661 None None] MFA Rules not processed for user `ae9c0835fec3404cbbec97084da6d274`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:56.034195 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b4076e39-582a-48ac-8bb1-3beb9c0d9661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:56.180918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfbf94-05be-49aa-82ae-eda162896144 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:56.190779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 869/1751] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:06:56.299859 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4076e39-582a-48ac-8bb1-3beb9c0d9661 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:56.371420 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0413fb5-5e96-4964-a864-974e2d193b65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:56.372437 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0413fb5-5e96-4964-a864-974e2d193b65 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:56.372937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0413fb5-5e96-4964-a864-974e2d193b65 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:56.379130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0413fb5-5e96-4964-a864-974e2d193b65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:56.384995 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0413fb5-5e96-4964-a864-974e2d193b65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:56.389470 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0413fb5-5e96-4964-a864-974e2d193b65 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:56.416955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 883/1752] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:06:56.436346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4076e39-582a-48ac-8bb1-3beb9c0d9661 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:56.458001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58223a3c-c921-4b5c-a5bd-4b7acc24ca27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:56.459960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58223a3c-c921-4b5c-a5bd-4b7acc24ca27 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:56.460386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58223a3c-c921-4b5c-a5bd-4b7acc24ca27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:56.462394 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58223a3c-c921-4b5c-a5bd-4b7acc24ca27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:56.490961 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58223a3c-c921-4b5c-a5bd-4b7acc24ca27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:56.492434 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58223a3c-c921-4b5c-a5bd-4b7acc24ca27 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:56.519458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 870/1753] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:56.751977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0413fb5-5e96-4964-a864-974e2d193b65 service nova] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:56.753533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a0413fb5-5e96-4964-a864-974e2d193b65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:56.780342 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0413fb5-5e96-4964-a864-974e2d193b65 service nova] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:56.787463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc8a36-1d10-4f51-be93-2d3695f8f47c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:56.788216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc8a36-1d10-4f51-be93-2d3695f8f47c service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:56.788507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc8a36-1d10-4f51-be93-2d3695f8f47c service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:56.788898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc8a36-1d10-4f51-be93-2d3695f8f47c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:56.955413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc8a36-1d10-4f51-be93-2d3695f8f47c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:56.970540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc8a36-1d10-4f51-be93-2d3695f8f47c service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:56.984710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 884/1754] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:57.241431 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58223a3c-c921-4b5c-a5bd-4b7acc24ca27 service cinder] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:57.243818 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-58223a3c-c921-4b5c-a5bd-4b7acc24ca27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:57.352688 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58223a3c-c921-4b5c-a5bd-4b7acc24ca27 service cinder] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:57.357796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7727e-2c6f-4c28-b435-74a5d5acc92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:57.358593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7727e-2c6f-4c28-b435-74a5d5acc92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:57.359359 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7727e-2c6f-4c28-b435-74a5d5acc92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:57.360857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7727e-2c6f-4c28-b435-74a5d5acc92c admin admin] PATH_INFO: `/v3/users/11c33e6e5c984c1ba306a2324d69f26a` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:57.362225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7727e-2c6f-4c28-b435-74a5d5acc92c admin admin] RBAC: Authorizing `identity:delete_user(user_id=11c33e6e5c984c1ba306a2324d69f26a)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:57.364549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7727e-2c6f-4c28-b435-74a5d5acc92c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:57.751031 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-64e7727e-2c6f-4c28-b435-74a5d5acc92c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11c33e6e5c984c1ba306a2324d69f26a'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:57.757087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-64e7727e-2c6f-4c28-b435-74a5d5acc92c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11c33e6e5c984c1ba306a2324d69f26a'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:57.785443 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-64e7727e-2c6f-4c28-b435-74a5d5acc92c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11c33e6e5c984c1ba306a2324d69f26a'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:57.891413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-64e7727e-2c6f-4c28-b435-74a5d5acc92c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11c33e6e5c984c1ba306a2324d69f26a'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:57.895066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-64e7727e-2c6f-4c28-b435-74a5d5acc92c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11c33e6e5c984c1ba306a2324d69f26a'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:57.915239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 871/1755] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:06:57 2022] DELETE /identity/v3/users/11c33e6e5c984c1ba306a2324d69f26a => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:06:57.920632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0983c26-521c-4531-b007-369b32224764 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:57.923576 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0983c26-521c-4531-b007-369b32224764 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:57.924216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0983c26-521c-4531-b007-369b32224764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:58.011832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-c0983c26-521c-4531-b007-369b32224764 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:58.016388 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c0983c26-521c-4531-b007-369b32224764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:58.177827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 885/1756] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:58.208089 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7727e-2c6f-4c28-b435-74a5d5acc92c admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:58.210349 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-64e7727e-2c6f-4c28-b435-74a5d5acc92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:58.410692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7727e-2c6f-4c28-b435-74a5d5acc92c admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:58.440710 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134791d3-7b8a-40ba-8ca7-ab05e3a46e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:58.441363 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134791d3-7b8a-40ba-8ca7-ab05e3a46e68 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:58.441814 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134791d3-7b8a-40ba-8ca7-ab05e3a46e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:58.442523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134791d3-7b8a-40ba-8ca7-ab05e3a46e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:58.476814 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134791d3-7b8a-40ba-8ca7-ab05e3a46e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:58.478300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134791d3-7b8a-40ba-8ca7-ab05e3a46e68 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:58.502132 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 872/1757] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:06:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:06:59.174955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0983c26-521c-4531-b007-369b32224764 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:59.177243 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c0983c26-521c-4531-b007-369b32224764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:59.191070 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0983c26-521c-4531-b007-369b32224764 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:59.199095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43211609-cc8f-4bdb-a63c-056352e3ee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:59.201123 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43211609-cc8f-4bdb-a63c-056352e3ee65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:59.201494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43211609-cc8f-4bdb-a63c-056352e3ee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:59.201847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43211609-cc8f-4bdb-a63c-056352e3ee65 admin admin] PATH_INFO: `/v3/projects/25a7792b8dfa41e49e1745afde90902c` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:59.203391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43211609-cc8f-4bdb-a63c-056352e3ee65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a7792b8dfa41e49e1745afde90902c)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:59.207164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43211609-cc8f-4bdb-a63c-056352e3ee65 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:59.434941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-43211609-cc8f-4bdb-a63c-056352e3ee65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a7792b8dfa41e49e1745afde90902c', 'request_id': 'req-43211609-cc8f-4bdb-a63c-056352e3ee65'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:59.618377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-43211609-cc8f-4bdb-a63c-056352e3ee65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a7792b8dfa41e49e1745afde90902c', 'request_id': 'req-43211609-cc8f-4bdb-a63c-056352e3ee65'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:59.627028 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-43211609-cc8f-4bdb-a63c-056352e3ee65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a7792b8dfa41e49e1745afde90902c', 'request_id': 'req-43211609-cc8f-4bdb-a63c-056352e3ee65'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:59.640079 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-43211609-cc8f-4bdb-a63c-056352e3ee65 admin admin] The token cache is being invalidate because project 25a7792b8dfa41e49e1745afde90902c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:06:59.640367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-43211609-cc8f-4bdb-a63c-056352e3ee65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:59.641247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-43211609-cc8f-4bdb-a63c-056352e3ee65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:06:59.644340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 886/1758] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:06:59 2022] DELETE /identity/v3/projects/25a7792b8dfa41e49e1745afde90902c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:06:59.647656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105094c-ccc9-497d-a3f5-6306e353de41 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:59.648968 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105094c-ccc9-497d-a3f5-6306e353de41 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:59.649430 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105094c-ccc9-497d-a3f5-6306e353de41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:59.672588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-2105094c-ccc9-497d-a3f5-6306e353de41 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:59.674373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2105094c-ccc9-497d-a3f5-6306e353de41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:59.835790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 873/1759] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:59.837696 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd8944-35e6-4cd0-8113-badc91dc4ba9 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:59.838297 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd8944-35e6-4cd0-8113-badc91dc4ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:59.839244 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd8944-35e6-4cd0-8113-badc91dc4ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:59.867144 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-f3fd8944-35e6-4cd0-8113-badc91dc4ba9 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:06:59.869439 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f3fd8944-35e6-4cd0-8113-badc91dc4ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:06:59.889178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 887/1760] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:06:59.890334 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105094c-ccc9-497d-a3f5-6306e353de41 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:59.901055 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105094c-ccc9-497d-a3f5-6306e353de41 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:59.908426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f4984-23cb-4803-a9b5-a9c3b88e83c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:59.909088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f4984-23cb-4803-a9b5-a9c3b88e83c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:59.909548 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f4984-23cb-4803-a9b5-a9c3b88e83c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:59.909965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f4984-23cb-4803-a9b5-a9c3b88e83c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:59.910877 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f4984-23cb-4803-a9b5-a9c3b88e83c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:06:59.911367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f4984-23cb-4803-a9b5-a9c3b88e83c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:59.913862 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f4984-23cb-4803-a9b5-a9c3b88e83c5 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:06:59.929819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 874/1761] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:06:59.939171 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd8944-35e6-4cd0-8113-badc91dc4ba9 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:06:59.953856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd8944-35e6-4cd0-8113-badc91dc4ba9 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:06:59.959083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb88e3c-70a4-4e06-abbb-8f46dac9f835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:06:59.960244 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb88e3c-70a4-4e06-abbb-8f46dac9f835 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:06:59.961042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb88e3c-70a4-4e06-abbb-8f46dac9f835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:06:59.961819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb88e3c-70a4-4e06-abbb-8f46dac9f835 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:06:59.964788 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb88e3c-70a4-4e06-abbb-8f46dac9f835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:06:59.967314 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb88e3c-70a4-4e06-abbb-8f46dac9f835 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:00.118849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 888/1762] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:06:59 2022] POST /identity/v3/projects => generated 405 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:07:00.123013 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f4984-23cb-4803-a9b5-a9c3b88e83c5 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:00.136900 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f4984-23cb-4803-a9b5-a9c3b88e83c5 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:00.215686 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba2a4a-dbca-440f-8dc0-69f61af01c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:00.216475 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba2a4a-dbca-440f-8dc0-69f61af01c17 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:00.216757 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba2a4a-dbca-440f-8dc0-69f61af01c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:00.220887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba2a4a-dbca-440f-8dc0-69f61af01c17 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:00.220887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba2a4a-dbca-440f-8dc0-69f61af01c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:00.220887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba2a4a-dbca-440f-8dc0-69f61af01c17 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:00.327676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 875/1763] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:00 2022] POST /identity/v3/users => generated 303 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:07:00.332225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb88e3c-70a4-4e06-abbb-8f46dac9f835 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:00.344423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb88e3c-70a4-4e06-abbb-8f46dac9f835 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:00.358586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c287a21-12e3-46f4-aea5-b5b5fb0eab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:00.362347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:00.380456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c287a21-12e3-46f4-aea5-b5b5fb0eab59 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:00.380802 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c287a21-12e3-46f4-aea5-b5b5fb0eab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:00.384746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c287a21-12e3-46f4-aea5-b5b5fb0eab59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:00.385686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c287a21-12e3-46f4-aea5-b5b5fb0eab59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:00.387688 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c287a21-12e3-46f4-aea5-b5b5fb0eab59 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:00.421892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 889/1764] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:00.426070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba2a4a-dbca-440f-8dc0-69f61af01c17 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:00.440713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba2a4a-dbca-440f-8dc0-69f61af01c17 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:00.451094 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7648a3-eac6-4694-a78e-4cb2506bfb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:00.451731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7648a3-eac6-4694-a78e-4cb2506bfb0c admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:00.452037 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7648a3-eac6-4694-a78e-4cb2506bfb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:00.452316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7648a3-eac6-4694-a78e-4cb2506bfb0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:00.453019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7648a3-eac6-4694-a78e-4cb2506bfb0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:00.454558 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7648a3-eac6-4694-a78e-4cb2506bfb0c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:00.486031 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 876/1765] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:00.493900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c287a21-12e3-46f4-aea5-b5b5fb0eab59 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:00.535836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c287a21-12e3-46f4-aea5-b5b5fb0eab59 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:00.545118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b103a-e324-4bc0-b85d-6785778eb0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:00.547247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b103a-e324-4bc0-b85d-6785778eb0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:00.548106 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b103a-e324-4bc0-b85d-6785778eb0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:00.548816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b103a-e324-4bc0-b85d-6785778eb0bc admin admin] PATH_INFO: `/v3/projects/65abe7e5119c40d382f9d9b67293dde1/users/651f5b55ce8144369fe2e19e7150c29e/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:00.568191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b103a-e324-4bc0-b85d-6785778eb0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=65abe7e5119c40d382f9d9b67293dde1, user_id=651f5b55ce8144369fe2e19e7150c29e, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:00.575779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b103a-e324-4bc0-b85d-6785778eb0bc admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:00.725907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 890/1766] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:00 2022] PUT /identity/v3/projects/65abe7e5119c40d382f9d9b67293dde1/users/651f5b55ce8144369fe2e19e7150c29e/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:07:00.738512 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf113a7-e797-48a9-b04e-61fe47743ad6 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:00.739105 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf113a7-e797-48a9-b04e-61fe47743ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:00.739105 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf113a7-e797-48a9-b04e-61fe47743ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:00.766973 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:00.797283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-bdf113a7-e797-48a9-b04e-61fe47743ad6 None None] MFA Rules not processed for user `651f5b55ce8144369fe2e19e7150c29e`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:00.799127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bdf113a7-e797-48a9-b04e-61fe47743ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:00.893248 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 877/1767] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:00 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:00.897185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b103a-e324-4bc0-b85d-6785778eb0bc admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:00.897767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf113a7-e797-48a9-b04e-61fe47743ad6 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:00.899963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-724b103a-e324-4bc0-b85d-6785778eb0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:00.987183 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf113a7-e797-48a9-b04e-61fe47743ad6 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:00.992115 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95065c0-8fe0-4087-bff4-26bcd55d73da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:00.993047 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95065c0-8fe0-4087-bff4-26bcd55d73da admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:00.996547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95065c0-8fe0-4087-bff4-26bcd55d73da admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:00.997969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95065c0-8fe0-4087-bff4-26bcd55d73da admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:00.999578 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95065c0-8fe0-4087-bff4-26bcd55d73da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:01.002502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95065c0-8fe0-4087-bff4-26bcd55d73da admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:01.005327 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b103a-e324-4bc0-b85d-6785778eb0bc admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:01.011366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76cc4a-02c2-4ec0-b5de-df52179e2c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:01.013037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76cc4a-02c2-4ec0-b5de-df52179e2c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:01.013532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76cc4a-02c2-4ec0-b5de-df52179e2c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:01.014015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76cc4a-02c2-4ec0-b5de-df52179e2c26 admin admin] PATH_INFO: `/v3/users/4077db65ac97477797432d59f82cb9b3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:01.015465 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76cc4a-02c2-4ec0-b5de-df52179e2c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4077db65ac97477797432d59f82cb9b3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:01.017827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76cc4a-02c2-4ec0-b5de-df52179e2c26 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:01.224552 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 878/1768] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:00 2022] POST /identity/v3/projects => generated 403 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:01.225334 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95065c0-8fe0-4087-bff4-26bcd55d73da admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:01.324265 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95065c0-8fe0-4087-bff4-26bcd55d73da admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:01.330956 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59fbe7-3aa7-4b37-b6e8-660f298eccd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:01.331725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59fbe7-3aa7-4b37-b6e8-660f298eccd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:01.332122 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59fbe7-3aa7-4b37-b6e8-660f298eccd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:01.332509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59fbe7-3aa7-4b37-b6e8-660f298eccd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:01.333346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59fbe7-3aa7-4b37-b6e8-660f298eccd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:01.335478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59fbe7-3aa7-4b37-b6e8-660f298eccd5 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:01.437986 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-5e76cc4a-02c2-4ec0-b5de-df52179e2c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4077db65ac97477797432d59f82cb9b3'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:01.450716 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-5e76cc4a-02c2-4ec0-b5de-df52179e2c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4077db65ac97477797432d59f82cb9b3'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:01.676168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-5e76cc4a-02c2-4ec0-b5de-df52179e2c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4077db65ac97477797432d59f82cb9b3'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:01.684889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 879/1769] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:01 2022] POST /identity/v3/users => generated 308 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:01.686826 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-5e76cc4a-02c2-4ec0-b5de-df52179e2c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4077db65ac97477797432d59f82cb9b3'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:01.687745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-5e76cc4a-02c2-4ec0-b5de-df52179e2c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4077db65ac97477797432d59f82cb9b3'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:01.689467 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59fbe7-3aa7-4b37-b6e8-660f298eccd5 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:01.695452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 891/1770] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:00 2022] DELETE /identity/v3/users/4077db65ac97477797432d59f82cb9b3 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:01.697028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-cd59fbe7-3aa7-4b37-b6e8-660f298eccd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:01.701276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340f4b4-b59e-4233-ac24-d673084b0194 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:01.701586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340f4b4-b59e-4233-ac24-d673084b0194 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:01.701867 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340f4b4-b59e-4233-ac24-d673084b0194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:01.712118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59fbe7-3aa7-4b37-b6e8-660f298eccd5 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:01.748059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-f340f4b4-b59e-4233-ac24-d673084b0194 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:01.749745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f340f4b4-b59e-4233-ac24-d673084b0194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:01.780572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8c1c7-1679-4ea9-9dbf-52d5c918779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:01.782023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8c1c7-1679-4ea9-9dbf-52d5c918779a admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:01.782518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8c1c7-1679-4ea9-9dbf-52d5c918779a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:01.782983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8c1c7-1679-4ea9-9dbf-52d5c918779a admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:01.783820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8c1c7-1679-4ea9-9dbf-52d5c918779a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:01.785642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8c1c7-1679-4ea9-9dbf-52d5c918779a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:01.796875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 880/1771] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:01.801329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8c1c7-1679-4ea9-9dbf-52d5c918779a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:01.812694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8c1c7-1679-4ea9-9dbf-52d5c918779a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:01.817481 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6264d-d1cb-4cf1-acec-5c6ee969d135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:01.818162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6264d-d1cb-4cf1-acec-5c6ee969d135 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:01.818317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 892/1772] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:01.818458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6264d-d1cb-4cf1-acec-5c6ee969d135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:01.818700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6264d-d1cb-4cf1-acec-5c6ee969d135 admin admin] PATH_INFO: `/v3/projects/eb0ca883569f460a8df2863d7a27cf7d/users/ded3d4f059bc48b780df14b39a6e88c6/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:01.827702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340f4b4-b59e-4233-ac24-d673084b0194 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:01.829213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f340f4b4-b59e-4233-ac24-d673084b0194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:01.837427 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6264d-d1cb-4cf1-acec-5c6ee969d135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0ca883569f460a8df2863d7a27cf7d, user_id=ded3d4f059bc48b780df14b39a6e88c6, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:01.841045 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6264d-d1cb-4cf1-acec-5c6ee969d135 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:01.890247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340f4b4-b59e-4233-ac24-d673084b0194 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:01.893807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd385f-1097-4b4f-95d1-3f5c67c1de51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:01.894417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd385f-1097-4b4f-95d1-3f5c67c1de51 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:01.894702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd385f-1097-4b4f-95d1-3f5c67c1de51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:01.894987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd385f-1097-4b4f-95d1-3f5c67c1de51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:01.905237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd385f-1097-4b4f-95d1-3f5c67c1de51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:01.906696 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd385f-1097-4b4f-95d1-3f5c67c1de51 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:01.916770 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 893/1773] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:07:01.975805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 881/1774] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:01 2022] PUT /identity/v3/projects/eb0ca883569f460a8df2863d7a27cf7d/users/ded3d4f059bc48b780df14b39a6e88c6/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:07:01.980583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd385f-1097-4b4f-95d1-3f5c67c1de51 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:01.995717 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd385f-1097-4b4f-95d1-3f5c67c1de51 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:02.066239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03184e0-b07b-4e1f-9d8e-b0720901c80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:02.066854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03184e0-b07b-4e1f-9d8e-b0720901c80d admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:02.067155 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03184e0-b07b-4e1f-9d8e-b0720901c80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:02.067411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03184e0-b07b-4e1f-9d8e-b0720901c80d admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:02.068149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03184e0-b07b-4e1f-9d8e-b0720901c80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:02.069742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03184e0-b07b-4e1f-9d8e-b0720901c80d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:02.079941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 894/1775] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:02.084172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6264d-d1cb-4cf1-acec-5c6ee969d135 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:02.095551 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6264d-d1cb-4cf1-acec-5c6ee969d135 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:02.100583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577198d-ee3d-4777-bfdb-202919ad6473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:02.101242 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577198d-ee3d-4777-bfdb-202919ad6473 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:02.101553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577198d-ee3d-4777-bfdb-202919ad6473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:02.101858 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577198d-ee3d-4777-bfdb-202919ad6473 admin admin] PATH_INFO: `/v3/projects/eb0ca883569f460a8df2863d7a27cf7d/users/ded3d4f059bc48b780df14b39a6e88c6/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:02.103822 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577198d-ee3d-4777-bfdb-202919ad6473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0ca883569f460a8df2863d7a27cf7d, user_id=ded3d4f059bc48b780df14b39a6e88c6, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:02.106556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577198d-ee3d-4777-bfdb-202919ad6473 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:02.116874 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 882/1776] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:02 2022] PUT /identity/v3/projects/eb0ca883569f460a8df2863d7a27cf7d/users/ded3d4f059bc48b780df14b39a6e88c6/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:02.127091 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db98ac5-e252-4065-864c-2fec71fdd8e9 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:02.127383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db98ac5-e252-4065-864c-2fec71fdd8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:02.127699 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db98ac5-e252-4065-864c-2fec71fdd8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:02.176868 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-7db98ac5-e252-4065-864c-2fec71fdd8e9 None None] MFA Rules not processed for user `ded3d4f059bc48b780df14b39a6e88c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:02.178273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-7db98ac5-e252-4065-864c-2fec71fdd8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:02.197137 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577198d-ee3d-4777-bfdb-202919ad6473 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:02.197137 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b577198d-ee3d-4777-bfdb-202919ad6473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:02.279553 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 895/1777] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:02 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:02.288243 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577198d-ee3d-4777-bfdb-202919ad6473 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:02.290741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db98ac5-e252-4065-864c-2fec71fdd8e9 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:02.292821 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-7db98ac5-e252-4065-864c-2fec71fdd8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:02.293938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa1d22-a5bf-460c-9e55-2a4795c0d6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:02.294618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa1d22-a5bf-460c-9e55-2a4795c0d6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:02.294859 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa1d22-a5bf-460c-9e55-2a4795c0d6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:02.295199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa1d22-a5bf-460c-9e55-2a4795c0d6c5 admin admin] PATH_INFO: `/v3/users/ada1059f4b50410f902be538d26a94fc` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:02.296470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa1d22-a5bf-460c-9e55-2a4795c0d6c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada1059f4b50410f902be538d26a94fc)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:02.298320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa1d22-a5bf-460c-9e55-2a4795c0d6c5 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:02.365766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db98ac5-e252-4065-864c-2fec71fdd8e9 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:02.369586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cc695-791e-49eb-b738-cb4630645e68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:02.371927 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cc695-791e-49eb-b738-cb4630645e68 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:02.371927 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cc695-791e-49eb-b738-cb4630645e68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:02.371927 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cc695-791e-49eb-b738-cb4630645e68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:02.390684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cc695-791e-49eb-b738-cb4630645e68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:02.390684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cc695-791e-49eb-b738-cb4630645e68 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:02.395145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 896/1778] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:02 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:07:02.513214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cc695-791e-49eb-b738-cb4630645e68 service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:02.514744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-145cc695-791e-49eb-b738-cb4630645e68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:02.545141 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cc695-791e-49eb-b738-cb4630645e68 service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:02.552860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea9d71-fd51-4535-8728-5dddd88c7461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:02.553658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea9d71-fd51-4535-8728-5dddd88c7461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:02.554680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea9d71-fd51-4535-8728-5dddd88c7461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:02.555211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea9d71-fd51-4535-8728-5dddd88c7461 admin admin] PATH_INFO: `/v3/projects/5856d2bb12324e83b2fdc9e08c49dcb1` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:02.556709 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea9d71-fd51-4535-8728-5dddd88c7461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5856d2bb12324e83b2fdc9e08c49dcb1)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:02.559054 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea9d71-fd51-4535-8728-5dddd88c7461 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:02.643438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d6aa1d22-a5bf-460c-9e55-2a4795c0d6c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada1059f4b50410f902be538d26a94fc'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:02.644230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d6aa1d22-a5bf-460c-9e55-2a4795c0d6c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada1059f4b50410f902be538d26a94fc'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:02.657537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d6aa1d22-a5bf-460c-9e55-2a4795c0d6c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada1059f4b50410f902be538d26a94fc'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:02.687632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d1ea9d71-fd51-4535-8728-5dddd88c7461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5856d2bb12324e83b2fdc9e08c49dcb1', 'request_id': 'req-d1ea9d71-fd51-4535-8728-5dddd88c7461'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:02.766504 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d6aa1d22-a5bf-460c-9e55-2a4795c0d6c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada1059f4b50410f902be538d26a94fc'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:02.767139 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d6aa1d22-a5bf-460c-9e55-2a4795c0d6c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada1059f4b50410f902be538d26a94fc'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:02.780711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 883/1779] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:02 2022] DELETE /identity/v3/users/ada1059f4b50410f902be538d26a94fc => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:02.781455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa1d22-a5bf-460c-9e55-2a4795c0d6c5 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:02.782762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d6aa1d22-a5bf-460c-9e55-2a4795c0d6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:02.829356 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d1ea9d71-fd51-4535-8728-5dddd88c7461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5856d2bb12324e83b2fdc9e08c49dcb1', 'request_id': 'req-d1ea9d71-fd51-4535-8728-5dddd88c7461'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:02.836551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d1ea9d71-fd51-4535-8728-5dddd88c7461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5856d2bb12324e83b2fdc9e08c49dcb1', 'request_id': 'req-d1ea9d71-fd51-4535-8728-5dddd88c7461'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:02.848181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d1ea9d71-fd51-4535-8728-5dddd88c7461 admin admin] The token cache is being invalidate because project 5856d2bb12324e83b2fdc9e08c49dcb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:02.848402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d1ea9d71-fd51-4535-8728-5dddd88c7461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:02.848740 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa1d22-a5bf-460c-9e55-2a4795c0d6c5 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:02.849061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d1ea9d71-fd51-4535-8728-5dddd88c7461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:02.850573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 897/1780] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:02 2022] DELETE /identity/v3/projects/5856d2bb12324e83b2fdc9e08c49dcb1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:02.852074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b317d-50fc-411e-8ba6-412b8ef10fe3 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:02.852360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b317d-50fc-411e-8ba6-412b8ef10fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:02.852637 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b317d-50fc-411e-8ba6-412b8ef10fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:02.856769 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1180e79-ddd4-4669-b04e-7eb597c17d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:02.857401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1180e79-ddd4-4669-b04e-7eb597c17d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:02.857684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1180e79-ddd4-4669-b04e-7eb597c17d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:02.857958 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1180e79-ddd4-4669-b04e-7eb597c17d98 admin admin] PATH_INFO: `/v3/users/651f5b55ce8144369fe2e19e7150c29e` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:02.859116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1180e79-ddd4-4669-b04e-7eb597c17d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=651f5b55ce8144369fe2e19e7150c29e)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:02.861169 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1180e79-ddd4-4669-b04e-7eb597c17d98 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:02.871962 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-aa7b317d-50fc-411e-8ba6-412b8ef10fe3 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:02.873177 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-aa7b317d-50fc-411e-8ba6-412b8ef10fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:02.880963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 898/1781] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:02.881845 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b317d-50fc-411e-8ba6-412b8ef10fe3 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:02.883094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-aa7b317d-50fc-411e-8ba6-412b8ef10fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:02.895521 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b317d-50fc-411e-8ba6-412b8ef10fe3 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:02.900107 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cff59-eec6-4c0a-bcbc-ba41d6bd5bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:02.901046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cff59-eec6-4c0a-bcbc-ba41d6bd5bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:02.901046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cff59-eec6-4c0a-bcbc-ba41d6bd5bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:02.901317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cff59-eec6-4c0a-bcbc-ba41d6bd5bc5 admin admin] PATH_INFO: `/v3/users/200aad829d2447a6bda94526760afd0f` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:02.902612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cff59-eec6-4c0a-bcbc-ba41d6bd5bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=200aad829d2447a6bda94526760afd0f)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:02.904578 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cff59-eec6-4c0a-bcbc-ba41d6bd5bc5 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:03.134972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f1180e79-ddd4-4669-b04e-7eb597c17d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651f5b55ce8144369fe2e19e7150c29e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:03.136150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f1180e79-ddd4-4669-b04e-7eb597c17d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651f5b55ce8144369fe2e19e7150c29e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:03.147859 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f1180e79-ddd4-4669-b04e-7eb597c17d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651f5b55ce8144369fe2e19e7150c29e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:03.281060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f1180e79-ddd4-4669-b04e-7eb597c17d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651f5b55ce8144369fe2e19e7150c29e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:03.281774 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f1180e79-ddd4-4669-b04e-7eb597c17d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651f5b55ce8144369fe2e19e7150c29e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:03.295274 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a74cff59-eec6-4c0a-bcbc-ba41d6bd5bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '200aad829d2447a6bda94526760afd0f'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:03.295690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 884/1782] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:02 2022] DELETE /identity/v3/users/651f5b55ce8144369fe2e19e7150c29e => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:03.296663 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1180e79-ddd4-4669-b04e-7eb597c17d98 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:03.298035 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f1180e79-ddd4-4669-b04e-7eb597c17d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:03.307694 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a74cff59-eec6-4c0a-bcbc-ba41d6bd5bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '200aad829d2447a6bda94526760afd0f'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:03.357678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1180e79-ddd4-4669-b04e-7eb597c17d98 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:03.361330 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6679f5-5e53-4db6-b51f-cc367c7710ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:03.361945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6679f5-5e53-4db6-b51f-cc367c7710ae service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:03.362230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6679f5-5e53-4db6-b51f-cc367c7710ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:03.362506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6679f5-5e53-4db6-b51f-cc367c7710ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:03.364280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ea6679f5-5e53-4db6-b51f-cc367c7710ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:03.427946 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6679f5-5e53-4db6-b51f-cc367c7710ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:03.429309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6679f5-5e53-4db6-b51f-cc367c7710ae service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:03.438584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 885/1783] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:03.440030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e41fb-02fe-486f-a22e-f27f0f62d6d4 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:03.440275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e41fb-02fe-486f-a22e-f27f0f62d6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:03.440626 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e41fb-02fe-486f-a22e-f27f0f62d6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:03.453019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a74cff59-eec6-4c0a-bcbc-ba41d6bd5bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '200aad829d2447a6bda94526760afd0f'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:03.460475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a74cff59-eec6-4c0a-bcbc-ba41d6bd5bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '200aad829d2447a6bda94526760afd0f'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:03.461179 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a74cff59-eec6-4c0a-bcbc-ba41d6bd5bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '200aad829d2447a6bda94526760afd0f'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:03.465085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-bf6e41fb-02fe-486f-a22e-f27f0f62d6d4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:03.466306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bf6e41fb-02fe-486f-a22e-f27f0f62d6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:03.468216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 899/1784] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:02 2022] DELETE /identity/v3/users/200aad829d2447a6bda94526760afd0f => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:03.557209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 886/1785] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:03.567605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cff59-eec6-4c0a-bcbc-ba41d6bd5bc5 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:03.570132 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a74cff59-eec6-4c0a-bcbc-ba41d6bd5bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:03.635103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cff59-eec6-4c0a-bcbc-ba41d6bd5bc5 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:03.639706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc42159-fd25-4102-bb63-29021a8d4aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:03.640373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc42159-fd25-4102-bb63-29021a8d4aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:03.640654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc42159-fd25-4102-bb63-29021a8d4aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:03.640927 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc42159-fd25-4102-bb63-29021a8d4aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:03.651739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc42159-fd25-4102-bb63-29021a8d4aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:03.653280 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc42159-fd25-4102-bb63-29021a8d4aa9 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:03.664747 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 900/1786] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:03.746215 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e41fb-02fe-486f-a22e-f27f0f62d6d4 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:03.752146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bf6e41fb-02fe-486f-a22e-f27f0f62d6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:03.771069 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e41fb-02fe-486f-a22e-f27f0f62d6d4 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:03.780458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279398df-e326-43e6-8e5f-b9b5c34bb7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:03.781951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279398df-e326-43e6-8e5f-b9b5c34bb7c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:03.783036 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279398df-e326-43e6-8e5f-b9b5c34bb7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:03.783509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279398df-e326-43e6-8e5f-b9b5c34bb7c7 admin admin] PATH_INFO: `/v3/users/6629d833269049778d80689c7dd4f715` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:03.787361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279398df-e326-43e6-8e5f-b9b5c34bb7c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6629d833269049778d80689c7dd4f715)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:03.790822 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279398df-e326-43e6-8e5f-b9b5c34bb7c7 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:03.965843 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:04.007655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-279398df-e326-43e6-8e5f-b9b5c34bb7c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6629d833269049778d80689c7dd4f715'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.009200 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-279398df-e326-43e6-8e5f-b9b5c34bb7c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6629d833269049778d80689c7dd4f715'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.023853 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-279398df-e326-43e6-8e5f-b9b5c34bb7c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6629d833269049778d80689c7dd4f715'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.143579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-279398df-e326-43e6-8e5f-b9b5c34bb7c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6629d833269049778d80689c7dd4f715'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.144239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-279398df-e326-43e6-8e5f-b9b5c34bb7c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6629d833269049778d80689c7dd4f715'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.158768 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 887/1787] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:03 2022] DELETE /identity/v3/users/6629d833269049778d80689c7dd4f715 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:04.163285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da0bf4-e919-4b1b-9088-9cd4b8745e1b None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:04.163810 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da0bf4-e919-4b1b-9088-9cd4b8745e1b None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:04.164150 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da0bf4-e919-4b1b-9088-9cd4b8745e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:04.184301 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-20da0bf4-e919-4b1b-9088-9cd4b8745e1b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:04.186968 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-20da0bf4-e919-4b1b-9088-9cd4b8745e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:04.245500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279398df-e326-43e6-8e5f-b9b5c34bb7c7 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:04.247112 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-279398df-e326-43e6-8e5f-b9b5c34bb7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:04.255989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 901/1788] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:04.263697 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279398df-e326-43e6-8e5f-b9b5c34bb7c7 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:04.268674 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38255ae0-f349-4312-ae23-f561d28e6a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:04.271281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38255ae0-f349-4312-ae23-f561d28e6a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:04.271281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38255ae0-f349-4312-ae23-f561d28e6a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:04.271281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38255ae0-f349-4312-ae23-f561d28e6a62 admin admin] PATH_INFO: `/v3/projects/947f0d0fbc694b1fb9699f42c6bda2f8` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:04.271281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38255ae0-f349-4312-ae23-f561d28e6a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=947f0d0fbc694b1fb9699f42c6bda2f8)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:04.273507 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38255ae0-f349-4312-ae23-f561d28e6a62 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:04.278714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da0bf4-e919-4b1b-9088-9cd4b8745e1b None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:04.280214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-20da0bf4-e919-4b1b-9088-9cd4b8745e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:04.373498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da0bf4-e919-4b1b-9088-9cd4b8745e1b None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:04.377424 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d264e3-410f-4d6e-aad6-30a4cdff99f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:04.378164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d264e3-410f-4d6e-aad6-30a4cdff99f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:04.378510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d264e3-410f-4d6e-aad6-30a4cdff99f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:04.378848 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d264e3-410f-4d6e-aad6-30a4cdff99f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:04.388878 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d264e3-410f-4d6e-aad6-30a4cdff99f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:04.390437 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d264e3-410f-4d6e-aad6-30a4cdff99f9 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:04.401703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 902/1789] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:07:04.402737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d264e3-410f-4d6e-aad6-30a4cdff99f9 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:04.404598 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c2d264e3-410f-4d6e-aad6-30a4cdff99f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:04.424941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d264e3-410f-4d6e-aad6-30a4cdff99f9 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:04.436569 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea2f74-be54-4d82-96c7-52c276605734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:04.437903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea2f74-be54-4d82-96c7-52c276605734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:04.438614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea2f74-be54-4d82-96c7-52c276605734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:04.439110 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea2f74-be54-4d82-96c7-52c276605734 admin admin] PATH_INFO: `/v3/projects/a3c59685ba8a49dc87644feb25d7c72e` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:04.441385 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea2f74-be54-4d82-96c7-52c276605734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3c59685ba8a49dc87644feb25d7c72e)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:04.443859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea2f74-be54-4d82-96c7-52c276605734 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:04.452288 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-38255ae0-f349-4312-ae23-f561d28e6a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947f0d0fbc694b1fb9699f42c6bda2f8', 'request_id': 'req-38255ae0-f349-4312-ae23-f561d28e6a62'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.458184 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-38255ae0-f349-4312-ae23-f561d28e6a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947f0d0fbc694b1fb9699f42c6bda2f8', 'request_id': 'req-38255ae0-f349-4312-ae23-f561d28e6a62'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.561129 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-38255ae0-f349-4312-ae23-f561d28e6a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947f0d0fbc694b1fb9699f42c6bda2f8', 'request_id': 'req-38255ae0-f349-4312-ae23-f561d28e6a62'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.573692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-38255ae0-f349-4312-ae23-f561d28e6a62 admin admin] The token cache is being invalidate because project 947f0d0fbc694b1fb9699f42c6bda2f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:04.573978 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-38255ae0-f349-4312-ae23-f561d28e6a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.574666 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-38255ae0-f349-4312-ae23-f561d28e6a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.576270 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 888/1790] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:04 2022] DELETE /identity/v3/projects/947f0d0fbc694b1fb9699f42c6bda2f8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:07:04.577013 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38255ae0-f349-4312-ae23-f561d28e6a62 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:04.578286 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-38255ae0-f349-4312-ae23-f561d28e6a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:04.609661 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-b2ea2f74-be54-4d82-96c7-52c276605734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3c59685ba8a49dc87644feb25d7c72e', 'request_id': 'req-b2ea2f74-be54-4d82-96c7-52c276605734'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.650332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38255ae0-f349-4312-ae23-f561d28e6a62 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:04.719120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a80f0-d244-4e70-9176-ba8c9b688cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:04.719120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a80f0-d244-4e70-9176-ba8c9b688cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:04.719120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a80f0-d244-4e70-9176-ba8c9b688cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:04.719120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a80f0-d244-4e70-9176-ba8c9b688cc1 admin admin] PATH_INFO: `/v3/projects/65abe7e5119c40d382f9d9b67293dde1` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:04.720500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a80f0-d244-4e70-9176-ba8c9b688cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65abe7e5119c40d382f9d9b67293dde1)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:04.722527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a80f0-d244-4e70-9176-ba8c9b688cc1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:04.749946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-b2ea2f74-be54-4d82-96c7-52c276605734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3c59685ba8a49dc87644feb25d7c72e', 'request_id': 'req-b2ea2f74-be54-4d82-96c7-52c276605734'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.757606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-b2ea2f74-be54-4d82-96c7-52c276605734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3c59685ba8a49dc87644feb25d7c72e', 'request_id': 'req-b2ea2f74-be54-4d82-96c7-52c276605734'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.773961 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-b2ea2f74-be54-4d82-96c7-52c276605734 admin admin] The token cache is being invalidate because project a3c59685ba8a49dc87644feb25d7c72e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:04.774532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-b2ea2f74-be54-4d82-96c7-52c276605734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.775369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-b2ea2f74-be54-4d82-96c7-52c276605734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.777725 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 903/1791] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:04 2022] DELETE /identity/v3/projects/a3c59685ba8a49dc87644feb25d7c72e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:04.778667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea2f74-be54-4d82-96c7-52c276605734 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:04.780177 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b2ea2f74-be54-4d82-96c7-52c276605734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:04.795263 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea2f74-be54-4d82-96c7-52c276605734 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:04.803393 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e90c8-417a-4447-bbf6-48b2682ff577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:04.806672 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e90c8-417a-4447-bbf6-48b2682ff577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:04.806964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e90c8-417a-4447-bbf6-48b2682ff577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:04.811138 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e90c8-417a-4447-bbf6-48b2682ff577 admin admin] PATH_INFO: `/v3/users/f2638825bc40432a87c821b997cb3314` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:04.811138 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e90c8-417a-4447-bbf6-48b2682ff577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2638825bc40432a87c821b997cb3314)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:04.811138 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e90c8-417a-4447-bbf6-48b2682ff577 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:04.889164 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7f0a80f0-d244-4e70-9176-ba8c9b688cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65abe7e5119c40d382f9d9b67293dde1', 'request_id': 'req-7f0a80f0-d244-4e70-9176-ba8c9b688cc1'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:04.895005 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7f0a80f0-d244-4e70-9176-ba8c9b688cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65abe7e5119c40d382f9d9b67293dde1', 'request_id': 'req-7f0a80f0-d244-4e70-9176-ba8c9b688cc1'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.029617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7f0a80f0-d244-4e70-9176-ba8c9b688cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65abe7e5119c40d382f9d9b67293dde1', 'request_id': 'req-7f0a80f0-d244-4e70-9176-ba8c9b688cc1'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.042931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7f0a80f0-d244-4e70-9176-ba8c9b688cc1 admin admin] The token cache is being invalidate because project 65abe7e5119c40d382f9d9b67293dde1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:05.043230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7f0a80f0-d244-4e70-9176-ba8c9b688cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.043973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7f0a80f0-d244-4e70-9176-ba8c9b688cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.048622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 889/1792] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:04 2022] DELETE /identity/v3/projects/65abe7e5119c40d382f9d9b67293dde1 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:05.048622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a495e-5b10-40ca-b3ad-c294d35d391c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:05.048622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a495e-5b10-40ca-b3ad-c294d35d391c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:05.048622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a495e-5b10-40ca-b3ad-c294d35d391c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:05.072681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-984a495e-5b10-40ca-b3ad-c294d35d391c None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:05.074510 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-984a495e-5b10-40ca-b3ad-c294d35d391c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:05.112518 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4f9e90c8-417a-4447-bbf6-48b2682ff577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2638825bc40432a87c821b997cb3314'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.126207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4f9e90c8-417a-4447-bbf6-48b2682ff577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2638825bc40432a87c821b997cb3314'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.142468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 890/1793] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:05.143375 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a495e-5b10-40ca-b3ad-c294d35d391c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:05.144832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-984a495e-5b10-40ca-b3ad-c294d35d391c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:05.159568 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a495e-5b10-40ca-b3ad-c294d35d391c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:05.165703 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a5678-0ee9-4f2e-8595-a17050397827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:05.165703 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a5678-0ee9-4f2e-8595-a17050397827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:05.165703 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a5678-0ee9-4f2e-8595-a17050397827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:05.165703 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a5678-0ee9-4f2e-8595-a17050397827 admin admin] PATH_INFO: `/v3/projects/0939945e83454b0585abaa4108ad7d79` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:05.166885 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a5678-0ee9-4f2e-8595-a17050397827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0939945e83454b0585abaa4108ad7d79)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:05.169073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a5678-0ee9-4f2e-8595-a17050397827 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:05.223514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4f9e90c8-417a-4447-bbf6-48b2682ff577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2638825bc40432a87c821b997cb3314'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.224069 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:05.232499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4f9e90c8-417a-4447-bbf6-48b2682ff577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2638825bc40432a87c821b997cb3314'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.233599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4f9e90c8-417a-4447-bbf6-48b2682ff577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2638825bc40432a87c821b997cb3314'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.240419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 904/1794] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:04 2022] DELETE /identity/v3/users/f2638825bc40432a87c821b997cb3314 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:05.241571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e90c8-417a-4447-bbf6-48b2682ff577 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:05.242992 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-4f9e90c8-417a-4447-bbf6-48b2682ff577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:05.316643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e90c8-417a-4447-bbf6-48b2682ff577 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:05.334575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9e1a5678-0ee9-4f2e-8595-a17050397827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0939945e83454b0585abaa4108ad7d79', 'request_id': 'req-9e1a5678-0ee9-4f2e-8595-a17050397827'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.343376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9e1a5678-0ee9-4f2e-8595-a17050397827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0939945e83454b0585abaa4108ad7d79', 'request_id': 'req-9e1a5678-0ee9-4f2e-8595-a17050397827'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.392187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785d6a7-0670-467a-ba40-3346276caa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:05.392410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785d6a7-0670-467a-ba40-3346276caa9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:05.392870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785d6a7-0670-467a-ba40-3346276caa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:05.392870 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785d6a7-0670-467a-ba40-3346276caa9b admin admin] PATH_INFO: `/v3/users/ded3d4f059bc48b780df14b39a6e88c6` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:05.394014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785d6a7-0670-467a-ba40-3346276caa9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded3d4f059bc48b780df14b39a6e88c6)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:05.396157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785d6a7-0670-467a-ba40-3346276caa9b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:05.480906 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9e1a5678-0ee9-4f2e-8595-a17050397827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0939945e83454b0585abaa4108ad7d79', 'request_id': 'req-9e1a5678-0ee9-4f2e-8595-a17050397827'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.493025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9e1a5678-0ee9-4f2e-8595-a17050397827 admin admin] The token cache is being invalidate because project 0939945e83454b0585abaa4108ad7d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:05.493269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9e1a5678-0ee9-4f2e-8595-a17050397827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.493949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9e1a5678-0ee9-4f2e-8595-a17050397827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.496003 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 891/1795] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:05 2022] DELETE /identity/v3/projects/0939945e83454b0585abaa4108ad7d79 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:05.497222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d2304-bf47-4c10-ba43-346526229ce1 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:05.497566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d2304-bf47-4c10-ba43-346526229ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:05.497841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d2304-bf47-4c10-ba43-346526229ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:05.517565 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e04d2304-bf47-4c10-ba43-346526229ce1 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:05.518819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e04d2304-bf47-4c10-ba43-346526229ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:05.526721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 892/1796] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:05.527484 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d2304-bf47-4c10-ba43-346526229ce1 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:05.528767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e04d2304-bf47-4c10-ba43-346526229ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:05.541322 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d2304-bf47-4c10-ba43-346526229ce1 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:05.546312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e40890-ba31-419a-9792-5ed3bae87928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:05.546929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e40890-ba31-419a-9792-5ed3bae87928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:05.547211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e40890-ba31-419a-9792-5ed3bae87928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:05.547485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e40890-ba31-419a-9792-5ed3bae87928 admin admin] PATH_INFO: `/v3/users/ae9c0835fec3404cbbec97084da6d274` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:05.548675 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e40890-ba31-419a-9792-5ed3bae87928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9c0835fec3404cbbec97084da6d274)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:05.551009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e40890-ba31-419a-9792-5ed3bae87928 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:05.628874 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d785d6a7-0670-467a-ba40-3346276caa9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded3d4f059bc48b780df14b39a6e88c6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.641083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d785d6a7-0670-467a-ba40-3346276caa9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded3d4f059bc48b780df14b39a6e88c6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.732036 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d785d6a7-0670-467a-ba40-3346276caa9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded3d4f059bc48b780df14b39a6e88c6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.739605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d785d6a7-0670-467a-ba40-3346276caa9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded3d4f059bc48b780df14b39a6e88c6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.740328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d785d6a7-0670-467a-ba40-3346276caa9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded3d4f059bc48b780df14b39a6e88c6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.746908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 905/1797] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:05 2022] DELETE /identity/v3/users/ded3d4f059bc48b780df14b39a6e88c6 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:05.749812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785d6a7-0670-467a-ba40-3346276caa9b admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:05.749812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d785d6a7-0670-467a-ba40-3346276caa9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:05.807926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-95e40890-ba31-419a-9792-5ed3bae87928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9c0835fec3404cbbec97084da6d274'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.808726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-95e40890-ba31-419a-9792-5ed3bae87928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9c0835fec3404cbbec97084da6d274'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.816225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785d6a7-0670-467a-ba40-3346276caa9b admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:05.820829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-95e40890-ba31-419a-9792-5ed3bae87928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9c0835fec3404cbbec97084da6d274'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.821264 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210e617-c26e-4443-be74-0cd079a0560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:05.822025 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210e617-c26e-4443-be74-0cd079a0560d admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:05.822323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210e617-c26e-4443-be74-0cd079a0560d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:05.822598 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210e617-c26e-4443-be74-0cd079a0560d admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:05.823794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210e617-c26e-4443-be74-0cd079a0560d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:05.826635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210e617-c26e-4443-be74-0cd079a0560d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:05.826635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210e617-c26e-4443-be74-0cd079a0560d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:05.837595 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 906/1798] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:07:05.842901 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210e617-c26e-4443-be74-0cd079a0560d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:05.853580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210e617-c26e-4443-be74-0cd079a0560d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:05.858175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80186144-6365-41cc-b6dd-ceb876bc9b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:05.858810 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80186144-6365-41cc-b6dd-ceb876bc9b7e admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:05.859282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80186144-6365-41cc-b6dd-ceb876bc9b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:05.859458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80186144-6365-41cc-b6dd-ceb876bc9b7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:05.860040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80186144-6365-41cc-b6dd-ceb876bc9b7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:05.862000 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80186144-6365-41cc-b6dd-ceb876bc9b7e admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:05.920727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-95e40890-ba31-419a-9792-5ed3bae87928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9c0835fec3404cbbec97084da6d274'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.921380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-95e40890-ba31-419a-9792-5ed3bae87928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9c0835fec3404cbbec97084da6d274'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:05.934847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 893/1799] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:05 2022] DELETE /identity/v3/users/ae9c0835fec3404cbbec97084da6d274 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:05.935678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e40890-ba31-419a-9792-5ed3bae87928 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:05.937164 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-95e40890-ba31-419a-9792-5ed3bae87928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:05.953951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 907/1800] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:05 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:07:05.958331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80186144-6365-41cc-b6dd-ceb876bc9b7e admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:05.960398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-80186144-6365-41cc-b6dd-ceb876bc9b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:06.012129 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e40890-ba31-419a-9792-5ed3bae87928 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:06.035347 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80186144-6365-41cc-b6dd-ceb876bc9b7e admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:06.040732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a9410-6043-404b-8dab-153d908844b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:06.041352 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a9410-6043-404b-8dab-153d908844b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:06.042310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a9410-6043-404b-8dab-153d908844b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:06.042661 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a9410-6043-404b-8dab-153d908844b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:06.043227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a9410-6043-404b-8dab-153d908844b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:06.045325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a9410-6043-404b-8dab-153d908844b4 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:06.094929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1aec53-c838-48aa-a879-c85b462ec34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:06.095606 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1aec53-c838-48aa-a879-c85b462ec34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:06.096088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1aec53-c838-48aa-a879-c85b462ec34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:06.096371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1aec53-c838-48aa-a879-c85b462ec34a admin admin] PATH_INFO: `/v3/projects/5536561089574e7ea5532eee751ffd23` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:06.097700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1aec53-c838-48aa-a879-c85b462ec34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5536561089574e7ea5532eee751ffd23)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:06.099635 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1aec53-c838-48aa-a879-c85b462ec34a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:06.179531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 908/1801] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:05 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:07:06.183512 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a9410-6043-404b-8dab-153d908844b4 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:06.193169 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a9410-6043-404b-8dab-153d908844b4 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:06.197905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110f05e-54d3-4897-a13b-72cb91a65fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:06.198507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110f05e-54d3-4897-a13b-72cb91a65fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:06.198786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110f05e-54d3-4897-a13b-72cb91a65fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:06.199053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110f05e-54d3-4897-a13b-72cb91a65fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:06.199904 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110f05e-54d3-4897-a13b-72cb91a65fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:06.201447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110f05e-54d3-4897-a13b-72cb91a65fe7 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:06.213306 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 909/1802] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:07:06.225169 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110f05e-54d3-4897-a13b-72cb91a65fe7 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:06.239469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110f05e-54d3-4897-a13b-72cb91a65fe7 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:06.246035 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4d1aec53-c838-48aa-a879-c85b462ec34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5536561089574e7ea5532eee751ffd23', 'request_id': 'req-4d1aec53-c838-48aa-a879-c85b462ec34a'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:06.255486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4d1aec53-c838-48aa-a879-c85b462ec34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5536561089574e7ea5532eee751ffd23', 'request_id': 'req-4d1aec53-c838-48aa-a879-c85b462ec34a'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:06.315253 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b09803-d78b-41c4-80e2-b3664a276e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:06.316219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b09803-d78b-41c4-80e2-b3664a276e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:06.316759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b09803-d78b-41c4-80e2-b3664a276e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:06.317120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b09803-d78b-41c4-80e2-b3664a276e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:06.317915 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b09803-d78b-41c4-80e2-b3664a276e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:06.319686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b09803-d78b-41c4-80e2-b3664a276e93 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:06.339063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 910/1803] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:06.340269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b09803-d78b-41c4-80e2-b3664a276e93 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:06.352324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b09803-d78b-41c4-80e2-b3664a276e93 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:06.356179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4d1aec53-c838-48aa-a879-c85b462ec34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5536561089574e7ea5532eee751ffd23', 'request_id': 'req-4d1aec53-c838-48aa-a879-c85b462ec34a'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:06.358189 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f49ab-69e3-4c5a-a440-728f08e1852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:06.359443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f49ab-69e3-4c5a-a440-728f08e1852b admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:06.359793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f49ab-69e3-4c5a-a440-728f08e1852b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:06.360164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f49ab-69e3-4c5a-a440-728f08e1852b admin admin] PATH_INFO: `/v3/projects/6d650f27ee3f474e9695d8871deeb930/users/cd87544a83e040d18784f6d6688aba9e/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:06.376597 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f49ab-69e3-4c5a-a440-728f08e1852b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d650f27ee3f474e9695d8871deeb930, user_id=cd87544a83e040d18784f6d6688aba9e, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:06.380447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f49ab-69e3-4c5a-a440-728f08e1852b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:06.386258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4d1aec53-c838-48aa-a879-c85b462ec34a admin admin] The token cache is being invalidate because project 5536561089574e7ea5532eee751ffd23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:06.386562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4d1aec53-c838-48aa-a879-c85b462ec34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:06.387236 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4d1aec53-c838-48aa-a879-c85b462ec34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:06.388831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 894/1804] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:05 2022] DELETE /identity/v3/projects/5536561089574e7ea5532eee751ffd23 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:06.394820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aae9d-251a-42dc-8904-ca340b278328 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:06.395317 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aae9d-251a-42dc-8904-ca340b278328 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:06.395683 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aae9d-251a-42dc-8904-ca340b278328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:06.419414 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-d50aae9d-251a-42dc-8904-ca340b278328 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:06.420927 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d50aae9d-251a-42dc-8904-ca340b278328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:06.431198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 895/1805] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:06.439271 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e91a88-380f-43a7-9012-90354dc58818 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:06.439669 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e91a88-380f-43a7-9012-90354dc58818 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:06.439979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e91a88-380f-43a7-9012-90354dc58818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:06.461365 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-01e91a88-380f-43a7-9012-90354dc58818 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:06.462631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-01e91a88-380f-43a7-9012-90354dc58818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:06.471551 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 896/1806] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:07:06.475731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e91a88-380f-43a7-9012-90354dc58818 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:06.486618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e91a88-380f-43a7-9012-90354dc58818 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:06.492580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2b60a-86b1-4cd7-a477-ea8bab527e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:06.493260 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2b60a-86b1-4cd7-a477-ea8bab527e77 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:06.493562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2b60a-86b1-4cd7-a477-ea8bab527e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:06.493904 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2b60a-86b1-4cd7-a477-ea8bab527e77 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:06.494574 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2b60a-86b1-4cd7-a477-ea8bab527e77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:06.494898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2b60a-86b1-4cd7-a477-ea8bab527e77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:06.496671 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2b60a-86b1-4cd7-a477-ea8bab527e77 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:06.515259 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 897/1807] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:07:06.519919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2b60a-86b1-4cd7-a477-ea8bab527e77 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:06.530227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2b60a-86b1-4cd7-a477-ea8bab527e77 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:06.535940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f2fcf-9670-43e2-a202-a4185f1cc127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:06.536565 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f2fcf-9670-43e2-a202-a4185f1cc127 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:06.536846 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f2fcf-9670-43e2-a202-a4185f1cc127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:06.537120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f2fcf-9670-43e2-a202-a4185f1cc127 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:06.537754 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f2fcf-9670-43e2-a202-a4185f1cc127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:06.539661 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f2fcf-9670-43e2-a202-a4185f1cc127 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:06.567626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 911/1808] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:06 2022] PUT /identity/v3/projects/6d650f27ee3f474e9695d8871deeb930/users/cd87544a83e040d18784f6d6688aba9e/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:06.570203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f49ab-69e3-4c5a-a440-728f08e1852b admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:06.570203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c07f49ab-69e3-4c5a-a440-728f08e1852b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:06.638095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f49ab-69e3-4c5a-a440-728f08e1852b admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:06.643193 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c821b-10ce-44a8-b300-e3cdf01e8319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:06.643894 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c821b-10ce-44a8-b300-e3cdf01e8319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:06.644214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c821b-10ce-44a8-b300-e3cdf01e8319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:06.644492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c821b-10ce-44a8-b300-e3cdf01e8319 admin admin] PATH_INFO: `/v3/projects/eb0ca883569f460a8df2863d7a27cf7d` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:06.645660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c821b-10ce-44a8-b300-e3cdf01e8319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb0ca883569f460a8df2863d7a27cf7d)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:06.647594 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c821b-10ce-44a8-b300-e3cdf01e8319 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:06.660632 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 898/1809] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:06 2022] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:07:06.661977 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817b08-f5be-4526-b2fa-d797172aea26 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:06.662327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817b08-f5be-4526-b2fa-d797172aea26 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:06.662610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817b08-f5be-4526-b2fa-d797172aea26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:06.690357 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e1817b08-f5be-4526-b2fa-d797172aea26 None None] MFA Rules not processed for user `cd87544a83e040d18784f6d6688aba9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:06.691683 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e1817b08-f5be-4526-b2fa-d797172aea26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:06.755656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 899/1810] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:06.757132 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1817b08-f5be-4526-b2fa-d797172aea26 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:06.775007 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-da5c821b-10ce-44a8-b300-e3cdf01e8319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb0ca883569f460a8df2863d7a27cf7d', 'request_id': 'req-da5c821b-10ce-44a8-b300-e3cdf01e8319'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:06.820867 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1817b08-f5be-4526-b2fa-d797172aea26 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:06.874369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-da5c821b-10ce-44a8-b300-e3cdf01e8319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb0ca883569f460a8df2863d7a27cf7d', 'request_id': 'req-da5c821b-10ce-44a8-b300-e3cdf01e8319'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:06.876378 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70780f-25a5-421c-bd28-0460ae6a59ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:06.876992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70780f-25a5-421c-bd28-0460ae6a59ac admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:06.877275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70780f-25a5-421c-bd28-0460ae6a59ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:06.877546 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70780f-25a5-421c-bd28-0460ae6a59ac admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:06.878168 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70780f-25a5-421c-bd28-0460ae6a59ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:06.880109 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70780f-25a5-421c-bd28-0460ae6a59ac admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:06.881927 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-da5c821b-10ce-44a8-b300-e3cdf01e8319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb0ca883569f460a8df2863d7a27cf7d', 'request_id': 'req-da5c821b-10ce-44a8-b300-e3cdf01e8319'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:06.893779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-da5c821b-10ce-44a8-b300-e3cdf01e8319 admin admin] The token cache is being invalidate because project eb0ca883569f460a8df2863d7a27cf7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:06.894078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-da5c821b-10ce-44a8-b300-e3cdf01e8319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:06.894760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-da5c821b-10ce-44a8-b300-e3cdf01e8319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:06.896346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 912/1811] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:06 2022] DELETE /identity/v3/projects/eb0ca883569f460a8df2863d7a27cf7d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:06.899988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c821b-10ce-44a8-b300-e3cdf01e8319 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:06.899988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-da5c821b-10ce-44a8-b300-e3cdf01e8319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:06.911429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c821b-10ce-44a8-b300-e3cdf01e8319 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:06.916023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0cb36-c88f-4699-b029-9c31eee4dfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:06.916665 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0cb36-c88f-4699-b029-9c31eee4dfe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:06.919456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0cb36-c88f-4699-b029-9c31eee4dfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:06.919456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0cb36-c88f-4699-b029-9c31eee4dfe1 admin admin] PATH_INFO: `/v3/projects/2a2cbe161b16413bbf909dca99d551d1` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:06.919456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0cb36-c88f-4699-b029-9c31eee4dfe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2cbe161b16413bbf909dca99d551d1)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:06.920210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0cb36-c88f-4699-b029-9c31eee4dfe1 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:06.979835 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 900/1812] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:06 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:06.981247 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70780f-25a5-421c-bd28-0460ae6a59ac admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:06.983546 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ff70780f-25a5-421c-bd28-0460ae6a59ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:06.996085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70780f-25a5-421c-bd28-0460ae6a59ac admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:07.001919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ffda5-b51b-438b-9ddb-5aab88bbdcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:07.002812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ffda5-b51b-438b-9ddb-5aab88bbdcf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:07.003280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ffda5-b51b-438b-9ddb-5aab88bbdcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:07.003381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ffda5-b51b-438b-9ddb-5aab88bbdcf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:07.004085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ffda5-b51b-438b-9ddb-5aab88bbdcf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:07.006749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ffda5-b51b-438b-9ddb-5aab88bbdcf6 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:07.112631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:07.114216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f9e0cb36-c88f-4699-b029-9c31eee4dfe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2cbe161b16413bbf909dca99d551d1', 'request_id': 'req-f9e0cb36-c88f-4699-b029-9c31eee4dfe1'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:07.126493 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 901/1813] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:06 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:07.126888 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da578a-d57b-41b5-8b41-6187bff1d315 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:07.128293 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da578a-d57b-41b5-8b41-6187bff1d315 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:07.128584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da578a-d57b-41b5-8b41-6187bff1d315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:07.164410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-50da578a-d57b-41b5-8b41-6187bff1d315 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:07.167519 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-50da578a-d57b-41b5-8b41-6187bff1d315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:07.238714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 902/1814] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:07.239912 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da578a-d57b-41b5-8b41-6187bff1d315 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:07.241554 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-50da578a-d57b-41b5-8b41-6187bff1d315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:07.248647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f9e0cb36-c88f-4699-b029-9c31eee4dfe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2cbe161b16413bbf909dca99d551d1', 'request_id': 'req-f9e0cb36-c88f-4699-b029-9c31eee4dfe1'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:07.255172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da578a-d57b-41b5-8b41-6187bff1d315 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:07.256348 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f9e0cb36-c88f-4699-b029-9c31eee4dfe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2cbe161b16413bbf909dca99d551d1', 'request_id': 'req-f9e0cb36-c88f-4699-b029-9c31eee4dfe1'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:07.260262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3614972-e910-48ac-9a88-cd442325948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:07.261471 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3614972-e910-48ac-9a88-cd442325948f admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:07.261910 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3614972-e910-48ac-9a88-cd442325948f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:07.262191 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3614972-e910-48ac-9a88-cd442325948f admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:07.262955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3614972-e910-48ac-9a88-cd442325948f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:07.265764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3614972-e910-48ac-9a88-cd442325948f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:07.271427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f9e0cb36-c88f-4699-b029-9c31eee4dfe1 admin admin] The token cache is being invalidate because project 2a2cbe161b16413bbf909dca99d551d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:07.273963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f9e0cb36-c88f-4699-b029-9c31eee4dfe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:07.276763 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f9e0cb36-c88f-4699-b029-9c31eee4dfe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:07.278466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 903/1815] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:07.279312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3614972-e910-48ac-9a88-cd442325948f admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:07.282786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 913/1816] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:06 2022] DELETE /identity/v3/projects/2a2cbe161b16413bbf909dca99d551d1 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:07.285095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad4f17-f599-48cc-b7aa-9f5dcc8dbd04 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:07.285216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d3614972-e910-48ac-9a88-cd442325948f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:07.285310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad4f17-f599-48cc-b7aa-9f5dcc8dbd04 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:07.285524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad4f17-f599-48cc-b7aa-9f5dcc8dbd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:07.298977 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3614972-e910-48ac-9a88-cd442325948f admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:07.304539 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7841497-88c4-4e3e-8faa-08fcf34c3fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:07.305504 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7841497-88c4-4e3e-8faa-08fcf34c3fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:07.305932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7841497-88c4-4e3e-8faa-08fcf34c3fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:07.306349 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7841497-88c4-4e3e-8faa-08fcf34c3fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:07.307112 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7841497-88c4-4e3e-8faa-08fcf34c3fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:07.309534 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7841497-88c4-4e3e-8faa-08fcf34c3fa2 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:07.309693 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-d9ad4f17-f599-48cc-b7aa-9f5dcc8dbd04 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:07.310992 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d9ad4f17-f599-48cc-b7aa-9f5dcc8dbd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:07.327673 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 914/1817] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:07.327673 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad4f17-f599-48cc-b7aa-9f5dcc8dbd04 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:07.327673 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d9ad4f17-f599-48cc-b7aa-9f5dcc8dbd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:07.352140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad4f17-f599-48cc-b7aa-9f5dcc8dbd04 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:07.359703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651612d6-a2ce-42bc-a24c-1df277a45b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:07.382543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651612d6-a2ce-42bc-a24c-1df277a45b70 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:07.382543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651612d6-a2ce-42bc-a24c-1df277a45b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:07.382543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651612d6-a2ce-42bc-a24c-1df277a45b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:07.382543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651612d6-a2ce-42bc-a24c-1df277a45b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:07.382543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651612d6-a2ce-42bc-a24c-1df277a45b70 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:07.382543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 915/1818] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:07.383419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7b581-1ab4-4439-a1c8-d94dc1a6162b None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:07.383419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7b581-1ab4-4439-a1c8-d94dc1a6162b None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:07.383419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7b581-1ab4-4439-a1c8-d94dc1a6162b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:07.409931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-6ba7b581-1ab4-4439-a1c8-d94dc1a6162b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:07.411194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6ba7b581-1ab4-4439-a1c8-d94dc1a6162b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:07.419658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 916/1819] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:07.420388 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7b581-1ab4-4439-a1c8-d94dc1a6162b None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:07.451283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7b581-1ab4-4439-a1c8-d94dc1a6162b None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:07.451283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21e043-7c64-4366-aa6a-97b01bb707a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:07.451283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21e043-7c64-4366-aa6a-97b01bb707a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:07.451283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21e043-7c64-4366-aa6a-97b01bb707a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:07.451612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21e043-7c64-4366-aa6a-97b01bb707a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:07.451612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21e043-7c64-4366-aa6a-97b01bb707a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:07.451612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21e043-7c64-4366-aa6a-97b01bb707a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:07.451612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21e043-7c64-4366-aa6a-97b01bb707a7 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:07.454587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 917/1820] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:07:07.455847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21e043-7c64-4366-aa6a-97b01bb707a7 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:07.468539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21e043-7c64-4366-aa6a-97b01bb707a7 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:07.474827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e26c63-349b-4a09-bcf8-f2f302bdc505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:07.475787 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e26c63-349b-4a09-bcf8-f2f302bdc505 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:07.476172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e26c63-349b-4a09-bcf8-f2f302bdc505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:07.476514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e26c63-349b-4a09-bcf8-f2f302bdc505 admin admin] PATH_INFO: `/v3/projects/de93459ac43a4fe68c9c701766c6c2f0/users/c2ad881dae7e466c989ac94416677c10/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:07.508927 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e26c63-349b-4a09-bcf8-f2f302bdc505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de93459ac43a4fe68c9c701766c6c2f0, user_id=c2ad881dae7e466c989ac94416677c10, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:07.508927 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e26c63-349b-4a09-bcf8-f2f302bdc505 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:07.623742 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 904/1821] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:07 2022] POST /identity/v3/users => generated 290 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:07.625147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138efdb-73c2-4602-85c1-3d34a105690d None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:07.640760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138efdb-73c2-4602-85c1-3d34a105690d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:07.640760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138efdb-73c2-4602-85c1-3d34a105690d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:07.657829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b138efdb-73c2-4602-85c1-3d34a105690d None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:07.659419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b138efdb-73c2-4602-85c1-3d34a105690d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:07.674369 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 905/1822] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:07.675830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138efdb-73c2-4602-85c1-3d34a105690d None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:07.720868 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138efdb-73c2-4602-85c1-3d34a105690d None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:07.720958 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 918/1823] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:07 2022] PUT /identity/v3/projects/de93459ac43a4fe68c9c701766c6c2f0/users/c2ad881dae7e466c989ac94416677c10/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:07.720958 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e26c63-349b-4a09-bcf8-f2f302bdc505 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:07.797201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13973e9e-2551-4c64-b306-f63ce9385054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:07.797762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13973e9e-2551-4c64-b306-f63ce9385054 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:07.798046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13973e9e-2551-4c64-b306-f63ce9385054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:07.798321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13973e9e-2551-4c64-b306-f63ce9385054 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:07.799248 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13973e9e-2551-4c64-b306-f63ce9385054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:07.802072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13973e9e-2551-4c64-b306-f63ce9385054 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:07.818813 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e26c63-349b-4a09-bcf8-f2f302bdc505 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:07.826058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace744d4-3584-414f-b544-d5874081947d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:07.828186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace744d4-3584-414f-b544-d5874081947d admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:07.828186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace744d4-3584-414f-b544-d5874081947d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:07.828186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace744d4-3584-414f-b544-d5874081947d admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:07.828186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace744d4-3584-414f-b544-d5874081947d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:07.829840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace744d4-3584-414f-b544-d5874081947d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:07.842985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 919/1824] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:07.844164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace744d4-3584-414f-b544-d5874081947d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:07.858744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace744d4-3584-414f-b544-d5874081947d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:07.863565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7e36e-2f6e-46c9-aa59-adff5a50946a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:07.864204 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7e36e-2f6e-46c9-aa59-adff5a50946a admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:07.864489 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7e36e-2f6e-46c9-aa59-adff5a50946a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:07.864766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7e36e-2f6e-46c9-aa59-adff5a50946a admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:07.865406 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7e36e-2f6e-46c9-aa59-adff5a50946a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:07.865720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7e36e-2f6e-46c9-aa59-adff5a50946a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:07.867298 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7e36e-2f6e-46c9-aa59-adff5a50946a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:07.880773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 920/1825] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:07:07.882433 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0e296-ea69-44ee-b492-5e9937335d42 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:07.882729 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0e296-ea69-44ee-b492-5e9937335d42 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:07.883273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0e296-ea69-44ee-b492-5e9937335d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:07.914250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-2ec0e296-ea69-44ee-b492-5e9937335d42 None None] MFA Rules not processed for user `c2ad881dae7e466c989ac94416677c10`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:07.914250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2ec0e296-ea69-44ee-b492-5e9937335d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:07.981322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 921/1826] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:07.982297 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0e296-ea69-44ee-b492-5e9937335d42 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:07.993396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0e296-ea69-44ee-b492-5e9937335d42 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:08.001191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c02dba-80ec-4f08-a179-1aa060339356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:08.001874 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c02dba-80ec-4f08-a179-1aa060339356 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:08.002166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c02dba-80ec-4f08-a179-1aa060339356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:08.002453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c02dba-80ec-4f08-a179-1aa060339356 admin admin] PATH_INFO: `/v3/projects/1e66c8908a3f47b1a0f26ff89ec69931/users/8de1516f18fd47dbbd0f47ef7cf6f358/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:08.221820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c02dba-80ec-4f08-a179-1aa060339356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e66c8908a3f47b1a0f26ff89ec69931, user_id=8de1516f18fd47dbbd0f47ef7cf6f358, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:08.221820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c02dba-80ec-4f08-a179-1aa060339356 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:08.243702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 906/1827] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:07 2022] POST /identity/v3/projects => generated 405 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:08.246148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13973e9e-2551-4c64-b306-f63ce9385054 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:08.367766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13973e9e-2551-4c64-b306-f63ce9385054 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:08.372223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 922/1828] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:07 2022] PUT /identity/v3/projects/1e66c8908a3f47b1a0f26ff89ec69931/users/8de1516f18fd47dbbd0f47ef7cf6f358/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:08.375724 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c02dba-80ec-4f08-a179-1aa060339356 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:08.440556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fb3e8-4ecf-4e28-911a-810f9d160586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:08.441182 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fb3e8-4ecf-4e28-911a-810f9d160586 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:08.441457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fb3e8-4ecf-4e28-911a-810f9d160586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:08.441735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fb3e8-4ecf-4e28-911a-810f9d160586 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:08.442372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fb3e8-4ecf-4e28-911a-810f9d160586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:08.444364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163fb3e8-4ecf-4e28-911a-810f9d160586 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:08.473010 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c02dba-80ec-4f08-a179-1aa060339356 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:08.478113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34408-6f85-4e30-9332-8e18f55c5f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:08.478902 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34408-6f85-4e30-9332-8e18f55c5f52 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:08.480257 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34408-6f85-4e30-9332-8e18f55c5f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:08.480257 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34408-6f85-4e30-9332-8e18f55c5f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:08.480971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d34408-6f85-4e30-9332-8e18f55c5f52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:08.483243 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d34408-6f85-4e30-9332-8e18f55c5f52 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:08.670589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 907/1829] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:08 2022] POST /identity/v3/projects => generated 377 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:08.671909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fb3e8-4ecf-4e28-911a-810f9d160586 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:08.686396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 923/1830] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:08 2022] POST /identity/v3/projects => generated 389 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:08.687419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34408-6f85-4e30-9332-8e18f55c5f52 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:08.820039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fb3e8-4ecf-4e28-911a-810f9d160586 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:08.844364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:08.891321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34408-6f85-4e30-9332-8e18f55c5f52 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:08.917389 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab947bb-bb1d-424d-964b-6d1239012b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:08.918027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c128b-1f94-4957-aadd-9a9f7207f50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:08.918171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab947bb-bb1d-424d-964b-6d1239012b76 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:08.918389 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab947bb-bb1d-424d-964b-6d1239012b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:08.918667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab947bb-bb1d-424d-964b-6d1239012b76 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:08.919367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab947bb-bb1d-424d-964b-6d1239012b76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:08.919981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c128b-1f94-4957-aadd-9a9f7207f50a admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:08.920455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c128b-1f94-4957-aadd-9a9f7207f50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:08.920564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c128b-1f94-4957-aadd-9a9f7207f50a admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:08.923719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab947bb-bb1d-424d-964b-6d1239012b76 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:08.924674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c128b-1f94-4957-aadd-9a9f7207f50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:08.926493 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c128b-1f94-4957-aadd-9a9f7207f50a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:08.949862 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 924/1831] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:08.953897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c128b-1f94-4957-aadd-9a9f7207f50a admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:08.974564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c128b-1f94-4957-aadd-9a9f7207f50a admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:08.987241 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86387599-85d7-48dc-a5ac-cbf4b7947b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:08.992256 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86387599-85d7-48dc-a5ac-cbf4b7947b5d admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:08.992256 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86387599-85d7-48dc-a5ac-cbf4b7947b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:08.992256 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86387599-85d7-48dc-a5ac-cbf4b7947b5d admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:08.992256 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86387599-85d7-48dc-a5ac-cbf4b7947b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:08.997779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86387599-85d7-48dc-a5ac-cbf4b7947b5d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:09.022376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 908/1832] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:08 2022] POST /identity/v3/users => generated 303 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:09.023292 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab947bb-bb1d-424d-964b-6d1239012b76 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:09.034450 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab947bb-bb1d-424d-964b-6d1239012b76 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:09.039319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e12cbf-1bb4-4f22-884d-5bb58c13a7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:09.040001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e12cbf-1bb4-4f22-884d-5bb58c13a7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.040290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e12cbf-1bb4-4f22-884d-5bb58c13a7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.040570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e12cbf-1bb4-4f22-884d-5bb58c13a7b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.041367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e12cbf-1bb4-4f22-884d-5bb58c13a7b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:09.043396 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e12cbf-1bb4-4f22-884d-5bb58c13a7b3 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:09.105078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 925/1833] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:08 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:09.106652 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86387599-85d7-48dc-a5ac-cbf4b7947b5d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:09.132034 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86387599-85d7-48dc-a5ac-cbf4b7947b5d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:09.140027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bacd7-5a35-4015-8105-7a90fbfc7d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:09.141042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bacd7-5a35-4015-8105-7a90fbfc7d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.141922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bacd7-5a35-4015-8105-7a90fbfc7d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.142418 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bacd7-5a35-4015-8105-7a90fbfc7d9c admin admin] PATH_INFO: `/v3/projects/1e66c8908a3f47b1a0f26ff89ec69931/users/8de1516f18fd47dbbd0f47ef7cf6f358/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.147109 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bacd7-5a35-4015-8105-7a90fbfc7d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e66c8908a3f47b1a0f26ff89ec69931, user_id=8de1516f18fd47dbbd0f47ef7cf6f358, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:09.150493 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bacd7-5a35-4015-8105-7a90fbfc7d9c admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:09.179186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 926/1834] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:09 2022] PUT /identity/v3/projects/1e66c8908a3f47b1a0f26ff89ec69931/users/8de1516f18fd47dbbd0f47ef7cf6f358/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:09.179186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bacd7-5a35-4015-8105-7a90fbfc7d9c admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:09.194436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 909/1835] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:09 2022] POST /identity/v3/users => generated 301 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:09.195426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e12cbf-1bb4-4f22-884d-5bb58c13a7b3 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:09.214223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e12cbf-1bb4-4f22-884d-5bb58c13a7b3 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:09.262790 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bacd7-5a35-4015-8105-7a90fbfc7d9c admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:09.268228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7537b-f64b-4bf9-bc01-e914e269c51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:09.268942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7537b-f64b-4bf9-bc01-e914e269c51c admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.269322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7537b-f64b-4bf9-bc01-e914e269c51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.269663 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7537b-f64b-4bf9-bc01-e914e269c51c admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.271132 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7537b-f64b-4bf9-bc01-e914e269c51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:09.273022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7537b-f64b-4bf9-bc01-e914e269c51c admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:09.291601 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 927/1836] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:09.295721 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21edd-bb6a-470d-80d4-a630966b443d None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.296138 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b1658-3f65-4cae-9eb6-cb5488e74a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:09.296789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21edd-bb6a-470d-80d4-a630966b443d None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.296909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b1658-3f65-4cae-9eb6-cb5488e74a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.296993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db21edd-bb6a-470d-80d4-a630966b443d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.297152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b1658-3f65-4cae-9eb6-cb5488e74a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.298188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b1658-3f65-4cae-9eb6-cb5488e74a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.298188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b1658-3f65-4cae-9eb6-cb5488e74a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:09.299980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b1658-3f65-4cae-9eb6-cb5488e74a65 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:09.319597 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 910/1837] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:09.320586 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b1658-3f65-4cae-9eb6-cb5488e74a65 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:09.335490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-6db21edd-bb6a-470d-80d4-a630966b443d None None] MFA Rules not processed for user `8de1516f18fd47dbbd0f47ef7cf6f358`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:09.335719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b1658-3f65-4cae-9eb6-cb5488e74a65 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:09.338276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6db21edd-bb6a-470d-80d4-a630966b443d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:09.341365 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd750e20-de6f-4a06-85a4-9609529db44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:09.342298 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd750e20-de6f-4a06-85a4-9609529db44d admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.342298 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd750e20-de6f-4a06-85a4-9609529db44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.342532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd750e20-de6f-4a06-85a4-9609529db44d admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.343394 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd750e20-de6f-4a06-85a4-9609529db44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:09.345866 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd750e20-de6f-4a06-85a4-9609529db44d admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:09.360178 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 911/1838] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:09.360178 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd750e20-de6f-4a06-85a4-9609529db44d admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:09.371029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd750e20-de6f-4a06-85a4-9609529db44d admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:09.377184 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09c427-e74d-4b1c-a8d2-6e3fe285a995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:09.377869 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09c427-e74d-4b1c-a8d2-6e3fe285a995 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.378393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09c427-e74d-4b1c-a8d2-6e3fe285a995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.378393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09c427-e74d-4b1c-a8d2-6e3fe285a995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.379051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09c427-e74d-4b1c-a8d2-6e3fe285a995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:09.382008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09c427-e74d-4b1c-a8d2-6e3fe285a995 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:09.396492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 912/1839] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:09.397442 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09c427-e74d-4b1c-a8d2-6e3fe285a995 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:09.410198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09c427-e74d-4b1c-a8d2-6e3fe285a995 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:09.415123 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145199ba-9f8d-465c-912b-4014de0cdf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:09.415788 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145199ba-9f8d-465c-912b-4014de0cdf15 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.416056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145199ba-9f8d-465c-912b-4014de0cdf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.416438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145199ba-9f8d-465c-912b-4014de0cdf15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.417675 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145199ba-9f8d-465c-912b-4014de0cdf15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:09.419313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145199ba-9f8d-465c-912b-4014de0cdf15 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:09.432571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 913/1840] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:09.432571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145199ba-9f8d-465c-912b-4014de0cdf15 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:09.445576 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 928/1841] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:09.445576 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db21edd-bb6a-470d-80d4-a630966b443d None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:09.445890 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145199ba-9f8d-465c-912b-4014de0cdf15 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:09.451145 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2c1d2-1964-4ec6-b2d7-7f0011b807d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:09.461381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2c1d2-1964-4ec6-b2d7-7f0011b807d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.461381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2c1d2-1964-4ec6-b2d7-7f0011b807d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.461381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2c1d2-1964-4ec6-b2d7-7f0011b807d1 admin admin] PATH_INFO: `/v3/projects/ff76e4a0bbc94668ae337f07825067a3/users/de443b60dfe54905beb1696f66f9d63b/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.461718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db21edd-bb6a-470d-80d4-a630966b443d None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:09.461718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f97de-8f7f-49f4-88c8-2e48681c68a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:09.461718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f97de-8f7f-49f4-88c8-2e48681c68a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.461718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f97de-8f7f-49f4-88c8-2e48681c68a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.462010 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f97de-8f7f-49f4-88c8-2e48681c68a6 admin admin] PATH_INFO: `/v3/projects/155fa43d6cd04c26b46b35aa04e86355/users/a0726f407bec450aa7c45a6b7a3cc787/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.473097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2c1d2-1964-4ec6-b2d7-7f0011b807d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff76e4a0bbc94668ae337f07825067a3, user_id=de443b60dfe54905beb1696f66f9d63b, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:09.476646 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2c1d2-1964-4ec6-b2d7-7f0011b807d1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:09.491595 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f97de-8f7f-49f4-88c8-2e48681c68a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=155fa43d6cd04c26b46b35aa04e86355, user_id=a0726f407bec450aa7c45a6b7a3cc787, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:09.494560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f97de-8f7f-49f4-88c8-2e48681c68a6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:09.637823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 914/1842] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:09 2022] PUT /identity/v3/projects/ff76e4a0bbc94668ae337f07825067a3/users/de443b60dfe54905beb1696f66f9d63b/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:09.645014 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2c1d2-1964-4ec6-b2d7-7f0011b807d1 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:09.645162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 929/1843] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:09 2022] PUT /identity/v3/projects/155fa43d6cd04c26b46b35aa04e86355/users/a0726f407bec450aa7c45a6b7a3cc787/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:09.647486 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f97de-8f7f-49f4-88c8-2e48681c68a6 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:09.653064 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b24f97de-8f7f-49f4-88c8-2e48681c68a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:09.739748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2c1d2-1964-4ec6-b2d7-7f0011b807d1 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:09.756034 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f97de-8f7f-49f4-88c8-2e48681c68a6 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:09.771205 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9bbec-8fbc-498f-a8f7-c01f1f74b620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:09.771205 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9bbec-8fbc-498f-a8f7-c01f1f74b620 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.771205 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9bbec-8fbc-498f-a8f7-c01f1f74b620 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.771205 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9bbec-8fbc-498f-a8f7-c01f1f74b620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.829369 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59326f77-948a-4250-89d9-1d85a562a72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:09.830369 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59326f77-948a-4250-89d9-1d85a562a72b admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.832977 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59326f77-948a-4250-89d9-1d85a562a72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.833337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59326f77-948a-4250-89d9-1d85a562a72b admin admin] PATH_INFO: `/v3/projects/657f966a9e784a459a8e5c1e28b22ef1/users/74618bf1508747b999ea42ff14988481/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.843301 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9bbec-8fbc-498f-a8f7-c01f1f74b620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:09.845550 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9bbec-8fbc-498f-a8f7-c01f1f74b620 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:09.855655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59326f77-948a-4250-89d9-1d85a562a72b admin admin] RBAC: Authorizing `identity:create_grant(project_id=657f966a9e784a459a8e5c1e28b22ef1, user_id=74618bf1508747b999ea42ff14988481, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:09.858848 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59326f77-948a-4250-89d9-1d85a562a72b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:09.862827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 930/1844] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:09.864110 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9bbec-8fbc-498f-a8f7-c01f1f74b620 service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:09.875755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9bbec-8fbc-498f-a8f7-c01f1f74b620 service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:09.881866 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b947863-7fab-47da-86be-dac31b64be86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:09.882482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b947863-7fab-47da-86be-dac31b64be86 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.882771 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b947863-7fab-47da-86be-dac31b64be86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.883050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b947863-7fab-47da-86be-dac31b64be86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.883754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b947863-7fab-47da-86be-dac31b64be86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:09.887203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b947863-7fab-47da-86be-dac31b64be86 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:09.903903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 931/1845] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:09.903903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510a18-07b0-40d5-b40f-5acac4a40726 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.903903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510a18-07b0-40d5-b40f-5acac4a40726 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.903903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510a18-07b0-40d5-b40f-5acac4a40726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.921827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-f3510a18-07b0-40d5-b40f-5acac4a40726 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:09.923044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f3510a18-07b0-40d5-b40f-5acac4a40726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:09.931259 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 932/1846] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:09.938373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3510a18-07b0-40d5-b40f-5acac4a40726 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:09.945436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3510a18-07b0-40d5-b40f-5acac4a40726 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:09.950861 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b20328-15e3-48c5-89ed-9f3ec7f620e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:09.951597 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20328-15e3-48c5-89ed-9f3ec7f620e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.952090 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20328-15e3-48c5-89ed-9f3ec7f620e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.952373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b20328-15e3-48c5-89ed-9f3ec7f620e2 admin admin] PATH_INFO: `/v3/projects/ff76e4a0bbc94668ae337f07825067a3/users/de443b60dfe54905beb1696f66f9d63b/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:09.954904 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b20328-15e3-48c5-89ed-9f3ec7f620e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff76e4a0bbc94668ae337f07825067a3, user_id=de443b60dfe54905beb1696f66f9d63b, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:09.957598 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b20328-15e3-48c5-89ed-9f3ec7f620e2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:09.981305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 915/1847] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:09 2022] PUT /identity/v3/projects/657f966a9e784a459a8e5c1e28b22ef1/users/74618bf1508747b999ea42ff14988481/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:09.981305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59326f77-948a-4250-89d9-1d85a562a72b admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:09.981305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-59326f77-948a-4250-89d9-1d85a562a72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:09.981581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 933/1848] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:09 2022] PUT /identity/v3/projects/ff76e4a0bbc94668ae337f07825067a3/users/de443b60dfe54905beb1696f66f9d63b/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:09.981581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccadd06-08e6-41d6-b363-65c9ff54a1eb None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:09.981581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccadd06-08e6-41d6-b363-65c9ff54a1eb None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:09.981581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccadd06-08e6-41d6-b363-65c9ff54a1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:10.011030 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1ccadd06-08e6-41d6-b363-65c9ff54a1eb None None] MFA Rules not processed for user `74618bf1508747b999ea42ff14988481`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:10.012476 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1ccadd06-08e6-41d6-b363-65c9ff54a1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:10.052874 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59326f77-948a-4250-89d9-1d85a562a72b admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:10.113926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 934/1849] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:10.117796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f21d0-325c-44be-8df6-20b555b72263 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:10.118097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f21d0-325c-44be-8df6-20b555b72263 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:10.118391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f21d0-325c-44be-8df6-20b555b72263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:10.126179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181c7f9-2af5-47da-bd4c-f331d6e7e19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:10.131960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181c7f9-2af5-47da-bd4c-f331d6e7e19e service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:10.131960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181c7f9-2af5-47da-bd4c-f331d6e7e19e service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:10.131960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181c7f9-2af5-47da-bd4c-f331d6e7e19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:10.193434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-b87f21d0-325c-44be-8df6-20b555b72263 None None] MFA Rules not processed for user `de443b60dfe54905beb1696f66f9d63b`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:10.197094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b87f21d0-325c-44be-8df6-20b555b72263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:10.211063 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181c7f9-2af5-47da-bd4c-f331d6e7e19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:10.213933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181c7f9-2af5-47da-bd4c-f331d6e7e19e service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:10.253613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 916/1850] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:10.253613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181c7f9-2af5-47da-bd4c-f331d6e7e19e service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:10.253613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181c7f9-2af5-47da-bd4c-f331d6e7e19e service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:10.253613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e66dde-4c02-4222-baa2-9351cc0d5a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:10.254373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e66dde-4c02-4222-baa2-9351cc0d5a5f admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:10.254373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e66dde-4c02-4222-baa2-9351cc0d5a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:10.254373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e66dde-4c02-4222-baa2-9351cc0d5a5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:10.254373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e66dde-4c02-4222-baa2-9351cc0d5a5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:10.256635 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e66dde-4c02-4222-baa2-9351cc0d5a5f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:10.306483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 935/1851] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:10 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:10.317776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f21d0-325c-44be-8df6-20b555b72263 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:10.319282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b87f21d0-325c-44be-8df6-20b555b72263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:10.388396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f21d0-325c-44be-8df6-20b555b72263 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:10.396938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc5b37-482e-4364-a8c1-829e55293836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:10.396938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5b37-482e-4364-a8c1-829e55293836 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:10.396938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5b37-482e-4364-a8c1-829e55293836 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:10.396938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5b37-482e-4364-a8c1-829e55293836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:10.443516 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 917/1852] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:10 2022] POST /identity/v3/projects => generated 379 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:10.448874 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc5b37-482e-4364-a8c1-829e55293836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:10.452711 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc5b37-482e-4364-a8c1-829e55293836 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:10.454598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a1c5a-2f6f-4d78-bf3e-75a3d6bb2987 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:10.455131 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a1c5a-2f6f-4d78-bf3e-75a3d6bb2987 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:10.455634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a1c5a-2f6f-4d78-bf3e-75a3d6bb2987 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:10.465962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 918/1853] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 14:07:10 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:07:10.467389 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a1c5a-2f6f-4d78-bf3e-75a3d6bb2987 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:10.482151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 936/1854] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:07:10.483753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f316f8-4d01-4759-a278-cd471a17dff1 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:10.484075 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f316f8-4d01-4759-a278-cd471a17dff1 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:10.484334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f316f8-4d01-4759-a278-cd471a17dff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:10.506218 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-b3f316f8-4d01-4759-a278-cd471a17dff1 None None] MFA Rules not processed for user `4b3c8a90b97246a98612b627b5f8da80`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:10.507526 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b3f316f8-4d01-4759-a278-cd471a17dff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:10.664373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a1c5a-2f6f-4d78-bf3e-75a3d6bb2987 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:10.666680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 937/1855] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 14:07:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:10.671090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b1dc7-ce9d-4b28-80ef-51d0e3383bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:10.671831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b1dc7-ce9d-4b28-80ef-51d0e3383bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:10.672216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b1dc7-ce9d-4b28-80ef-51d0e3383bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:10.672556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b1dc7-ce9d-4b28-80ef-51d0e3383bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:10.673585 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b1dc7-ce9d-4b28-80ef-51d0e3383bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:10.675518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b1dc7-ce9d-4b28-80ef-51d0e3383bf9 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:10.818980 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f316f8-4d01-4759-a278-cd471a17dff1 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:10.831643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f316f8-4d01-4759-a278-cd471a17dff1 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:10.837992 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7356e4-f9b9-45ba-bfe6-fc7a1e3446f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:10.838934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7356e4-f9b9-45ba-bfe6-fc7a1e3446f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:10.839193 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7356e4-f9b9-45ba-bfe6-fc7a1e3446f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:10.839459 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7356e4-f9b9-45ba-bfe6-fc7a1e3446f1 admin admin] PATH_INFO: `/v3/users/c2ad881dae7e466c989ac94416677c10` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:10.840914 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7356e4-f9b9-45ba-bfe6-fc7a1e3446f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2ad881dae7e466c989ac94416677c10)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:10.842958 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7356e4-f9b9-45ba-bfe6-fc7a1e3446f1 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:11.077538 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 919/1856] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:10 2022] POST /identity/v3/users => generated 296 bytes in 612 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:11.078293 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b1dc7-ce9d-4b28-80ef-51d0e3383bf9 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:11.080982 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ef4b1dc7-ce9d-4b28-80ef-51d0e3383bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:11.097667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b1dc7-ce9d-4b28-80ef-51d0e3383bf9 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:11.103513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08152a18-c3fc-4893-ac53-c0b24c759ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:11.104323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08152a18-c3fc-4893-ac53-c0b24c759ca5 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:11.104700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08152a18-c3fc-4893-ac53-c0b24c759ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:11.105044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08152a18-c3fc-4893-ac53-c0b24c759ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:11.114412 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08152a18-c3fc-4893-ac53-c0b24c759ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:11.116039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08152a18-c3fc-4893-ac53-c0b24c759ca5 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:11.126916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 920/1857] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:11.127583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08152a18-c3fc-4893-ac53-c0b24c759ca5 service nova] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:11.138339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08152a18-c3fc-4893-ac53-c0b24c759ca5 service nova] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:11.143371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e603c-86c0-47cc-8b08-03d4b71abfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:11.144170 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e603c-86c0-47cc-8b08-03d4b71abfca admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:11.144443 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e603c-86c0-47cc-8b08-03d4b71abfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:11.144852 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e603c-86c0-47cc-8b08-03d4b71abfca admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:11.145968 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e603c-86c0-47cc-8b08-03d4b71abfca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:11.148226 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e603c-86c0-47cc-8b08-03d4b71abfca admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:11.178704 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 921/1858] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:11.184256 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e603c-86c0-47cc-8b08-03d4b71abfca admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:11.202059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e603c-86c0-47cc-8b08-03d4b71abfca admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:11.222329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64319f-5fd9-4c58-bb36-6b374691ec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:11.223251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64319f-5fd9-4c58-bb36-6b374691ec2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:11.224260 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64319f-5fd9-4c58-bb36-6b374691ec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:11.224604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64319f-5fd9-4c58-bb36-6b374691ec2b admin admin] PATH_INFO: `/v3/projects/7272742248994d0daf74532e395875f6/users/765565767c7547e39fefb3947adcd8b7/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:11.244503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64319f-5fd9-4c58-bb36-6b374691ec2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7272742248994d0daf74532e395875f6, user_id=765565767c7547e39fefb3947adcd8b7, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:11.247513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64319f-5fd9-4c58-bb36-6b374691ec2b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:11.323273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-eb7356e4-f9b9-45ba-bfe6-fc7a1e3446f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ad881dae7e466c989ac94416677c10'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:11.360005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-eb7356e4-f9b9-45ba-bfe6-fc7a1e3446f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ad881dae7e466c989ac94416677c10'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:11.440312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 922/1859] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:11 2022] PUT /identity/v3/projects/7272742248994d0daf74532e395875f6/users/765565767c7547e39fefb3947adcd8b7/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:07:11.441678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd1595-6b93-418f-b6af-2026e3e629a7 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:11.441971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd1595-6b93-418f-b6af-2026e3e629a7 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:11.442250 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd1595-6b93-418f-b6af-2026e3e629a7 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:11.444086 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 923/1860] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 14:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:07:11.444639 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd1595-6b93-418f-b6af-2026e3e629a7 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:11.498227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-eb7356e4-f9b9-45ba-bfe6-fc7a1e3446f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ad881dae7e466c989ac94416677c10'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:11.509241 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-eb7356e4-f9b9-45ba-bfe6-fc7a1e3446f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ad881dae7e466c989ac94416677c10'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:11.510068 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-eb7356e4-f9b9-45ba-bfe6-fc7a1e3446f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ad881dae7e466c989ac94416677c10'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:11.511995 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd1595-6b93-418f-b6af-2026e3e629a7 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:11.518203 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096fe45-9027-4fd6-a16e-94e335fa1c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:11.518836 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096fe45-9027-4fd6-a16e-94e335fa1c85 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:11.518985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 938/1861] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:10 2022] DELETE /identity/v3/users/c2ad881dae7e466c989ac94416677c10 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:11.519189 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096fe45-9027-4fd6-a16e-94e335fa1c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:11.519534 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096fe45-9027-4fd6-a16e-94e335fa1c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:11.520228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096fe45-9027-4fd6-a16e-94e335fa1c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:11.520776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc20c5d-78a7-4bf6-b64c-add9bb0b423c None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:11.521702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc20c5d-78a7-4bf6-b64c-add9bb0b423c None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:11.522078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc20c5d-78a7-4bf6-b64c-add9bb0b423c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:11.522542 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c096fe45-9027-4fd6-a16e-94e335fa1c85 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:11.536161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 924/1862] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:11.537581 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05befdf5-72cb-4244-96f3-07622217e7ef None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:11.544086 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05befdf5-72cb-4244-96f3-07622217e7ef None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:11.544086 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05befdf5-72cb-4244-96f3-07622217e7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:11.561977 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-05befdf5-72cb-4244-96f3-07622217e7ef None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:11.563233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-05befdf5-72cb-4244-96f3-07622217e7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:11.595903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-2dc20c5d-78a7-4bf6-b64c-add9bb0b423c None None] MFA Rules not processed for user `4b3c8a90b97246a98612b627b5f8da80`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:11.609447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2dc20c5d-78a7-4bf6-b64c-add9bb0b423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:11.659559 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 925/1863] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:11.660610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05befdf5-72cb-4244-96f3-07622217e7ef None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:11.661934 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-05befdf5-72cb-4244-96f3-07622217e7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:11.676290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05befdf5-72cb-4244-96f3-07622217e7ef None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:11.681650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a31c8b-6914-41e8-b5e5-0ea0905419cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:11.683302 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a31c8b-6914-41e8-b5e5-0ea0905419cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:11.683592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a31c8b-6914-41e8-b5e5-0ea0905419cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:11.683891 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a31c8b-6914-41e8-b5e5-0ea0905419cb admin admin] PATH_INFO: `/v3/projects/7272742248994d0daf74532e395875f6/users/765565767c7547e39fefb3947adcd8b7/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:11.686744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a31c8b-6914-41e8-b5e5-0ea0905419cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7272742248994d0daf74532e395875f6, user_id=765565767c7547e39fefb3947adcd8b7, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:11.690320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a31c8b-6914-41e8-b5e5-0ea0905419cb admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:11.694473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 939/1864] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 14:07:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:11.695090 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc20c5d-78a7-4bf6-b64c-add9bb0b423c None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:11.698033 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2dc20c5d-78a7-4bf6-b64c-add9bb0b423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:11.715840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 926/1865] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:11 2022] PUT /identity/v3/projects/7272742248994d0daf74532e395875f6/users/765565767c7547e39fefb3947adcd8b7/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:11.718745 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e622-9653-4e91-82c5-acaa24745f4c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:11.719559 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e622-9653-4e91-82c5-acaa24745f4c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:11.719851 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005e622-9653-4e91-82c5-acaa24745f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:11.763592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-2005e622-9653-4e91-82c5-acaa24745f4c None None] MFA Rules not processed for user `765565767c7547e39fefb3947adcd8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:11.765255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:11.769060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2005e622-9653-4e91-82c5-acaa24745f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:11.794743 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc20c5d-78a7-4bf6-b64c-add9bb0b423c None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:11.850715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546b609-b42a-487c-bbe9-9bc2c7cb7381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:11.851427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546b609-b42a-487c-bbe9-9bc2c7cb7381 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:11.851818 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546b609-b42a-487c-bbe9-9bc2c7cb7381 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:11.852229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546b609-b42a-487c-bbe9-9bc2c7cb7381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:11.866500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 927/1866] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:11.866500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005e622-9653-4e91-82c5-acaa24745f4c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:11.870380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2005e622-9653-4e91-82c5-acaa24745f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:11.932011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546b609-b42a-487c-bbe9-9bc2c7cb7381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:11.934033 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546b609-b42a-487c-bbe9-9bc2c7cb7381 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:11.948119 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 940/1867] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:11.949211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546b609-b42a-487c-bbe9-9bc2c7cb7381 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:11.951420 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-7546b609-b42a-487c-bbe9-9bc2c7cb7381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:11.976373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005e622-9653-4e91-82c5-acaa24745f4c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:11.984333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42075e36-b5c6-47f4-a5c8-9d8762c451e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:11.985099 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42075e36-b5c6-47f4-a5c8-9d8762c451e6 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:11.985445 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42075e36-b5c6-47f4-a5c8-9d8762c451e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:11.985828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42075e36-b5c6-47f4-a5c8-9d8762c451e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:11.997779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42075e36-b5c6-47f4-a5c8-9d8762c451e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:12.001245 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42075e36-b5c6-47f4-a5c8-9d8762c451e6 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:12.014879 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 928/1868] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:12.021152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546b609-b42a-487c-bbe9-9bc2c7cb7381 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:12.025107 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186989e-cdca-4c83-a710-246257d23d33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:12.026474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186989e-cdca-4c83-a710-246257d23d33 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:12.026915 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186989e-cdca-4c83-a710-246257d23d33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:12.027228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186989e-cdca-4c83-a710-246257d23d33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:12.029349 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a186989e-cdca-4c83-a710-246257d23d33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:12.138095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186989e-cdca-4c83-a710-246257d23d33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:12.139551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186989e-cdca-4c83-a710-246257d23d33 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:12.149484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 941/1869] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:12.987091 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42075e36-b5c6-47f4-a5c8-9d8762c451e6 service nova] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:12.989933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-42075e36-b5c6-47f4-a5c8-9d8762c451e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:13.010218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42075e36-b5c6-47f4-a5c8-9d8762c451e6 service nova] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:13.018729 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:13.019775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:13.020234 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:13.023690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4 admin admin] PATH_INFO: `/v3/projects/de93459ac43a4fe68c9c701766c6c2f0` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:13.023690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de93459ac43a4fe68c9c701766c6c2f0)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:13.024816 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:13.153757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc27e72-9a26-4c56-9980-77190bc16cf3 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:13.154322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc27e72-9a26-4c56-9980-77190bc16cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:13.156803 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc27e72-9a26-4c56-9980-77190bc16cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:13.214626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-dfc27e72-9a26-4c56-9980-77190bc16cf3 None None] MFA Rules not processed for user `a0726f407bec450aa7c45a6b7a3cc787`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:13.216254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-dfc27e72-9a26-4c56-9980-77190bc16cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:13.278828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de93459ac43a4fe68c9c701766c6c2f0', 'request_id': 'req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:13.300684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de93459ac43a4fe68c9c701766c6c2f0', 'request_id': 'req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:13.350885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 942/1870] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:13 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:07:13.356277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc27e72-9a26-4c56-9980-77190bc16cf3 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:13.358458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-dfc27e72-9a26-4c56-9980-77190bc16cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:13.375094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc27e72-9a26-4c56-9980-77190bc16cf3 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:13.418873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de93459ac43a4fe68c9c701766c6c2f0', 'request_id': 'req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:13.450297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4 admin admin] The token cache is being invalidate because project de93459ac43a4fe68c9c701766c6c2f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:13.452352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:13.453175 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:13.457290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 929/1871] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:12 2022] DELETE /identity/v3/projects/de93459ac43a4fe68c9c701766c6c2f0 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:13.468923 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:13.469803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:13.521359 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf20163-133a-4996-94b2-246099b3e5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:13.522407 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf20163-133a-4996-94b2-246099b3e5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:13.522921 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf20163-133a-4996-94b2-246099b3e5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:13.523789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf20163-133a-4996-94b2-246099b3e5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:13.524690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf20163-133a-4996-94b2-246099b3e5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:13.527653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf20163-133a-4996-94b2-246099b3e5d9 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:13.599386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bea44e-f2c4-4e3d-a831-7bf0f12653e4 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:13.604907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91efa2-7484-4acd-8ab5-d465a97ad1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:13.605553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91efa2-7484-4acd-8ab5-d465a97ad1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:13.605832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91efa2-7484-4acd-8ab5-d465a97ad1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:13.606101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91efa2-7484-4acd-8ab5-d465a97ad1ad admin admin] PATH_INFO: `/v3/users/de443b60dfe54905beb1696f66f9d63b` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:13.607235 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91efa2-7484-4acd-8ab5-d465a97ad1ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=de443b60dfe54905beb1696f66f9d63b)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:13.609333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91efa2-7484-4acd-8ab5-d465a97ad1ad admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:14.566246 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 943/1872] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:13 2022] POST /identity/v3/projects => generated 403 bytes in 1208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:14.567619 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf20163-133a-4996-94b2-246099b3e5d9 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:14.569600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-cbf20163-133a-4996-94b2-246099b3e5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:14.657059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf20163-133a-4996-94b2-246099b3e5d9 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:14.662454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7107c73-142d-4ab1-8953-de3426545510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:14.663356 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7107c73-142d-4ab1-8953-de3426545510 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:14.664007 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7107c73-142d-4ab1-8953-de3426545510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:14.664381 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7107c73-142d-4ab1-8953-de3426545510 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:14.665162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7107c73-142d-4ab1-8953-de3426545510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:14.668057 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7107c73-142d-4ab1-8953-de3426545510 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:14.998456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 944/1873] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:14 2022] POST /identity/v3/users => generated 308 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:07:15.000036 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7107c73-142d-4ab1-8953-de3426545510 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:15.003408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ae91efa2-7484-4acd-8ab5-d465a97ad1ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de443b60dfe54905beb1696f66f9d63b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:15.004188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ae91efa2-7484-4acd-8ab5-d465a97ad1ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de443b60dfe54905beb1696f66f9d63b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:15.016253 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7107c73-142d-4ab1-8953-de3426545510 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:15.032059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189da9-e0dd-4d1d-9bf5-f13d49bbfb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:15.033699 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189da9-e0dd-4d1d-9bf5-f13d49bbfb04 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:15.034142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189da9-e0dd-4d1d-9bf5-f13d49bbfb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:15.034580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48189da9-e0dd-4d1d-9bf5-f13d49bbfb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:15.035540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48189da9-e0dd-4d1d-9bf5-f13d49bbfb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:15.037654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48189da9-e0dd-4d1d-9bf5-f13d49bbfb04 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:15.059733 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ae91efa2-7484-4acd-8ab5-d465a97ad1ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de443b60dfe54905beb1696f66f9d63b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:15.063906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 945/1874] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:07:15.067739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189da9-e0dd-4d1d-9bf5-f13d49bbfb04 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:15.093341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48189da9-e0dd-4d1d-9bf5-f13d49bbfb04 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:15.098498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c50c6-52e3-4e58-ba0c-f1f2cfd0ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:15.099319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c50c6-52e3-4e58-ba0c-f1f2cfd0ecac admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:15.099474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c50c6-52e3-4e58-ba0c-f1f2cfd0ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:15.099910 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c50c6-52e3-4e58-ba0c-f1f2cfd0ecac admin admin] PATH_INFO: `/v3/projects/37a6b21c18064e6ba1f173ffdacceef0/users/c08f3dec71234a39999a4998a87b6464/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:15.122806 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c50c6-52e3-4e58-ba0c-f1f2cfd0ecac admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a6b21c18064e6ba1f173ffdacceef0, user_id=c08f3dec71234a39999a4998a87b6464, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:15.125597 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c50c6-52e3-4e58-ba0c-f1f2cfd0ecac admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:15.206896 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ae91efa2-7484-4acd-8ab5-d465a97ad1ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de443b60dfe54905beb1696f66f9d63b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:15.207673 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ae91efa2-7484-4acd-8ab5-d465a97ad1ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de443b60dfe54905beb1696f66f9d63b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:15.221824 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 930/1875] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:13 2022] DELETE /identity/v3/users/de443b60dfe54905beb1696f66f9d63b => generated 0 bytes in 1760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:15.262432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 946/1876] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:15 2022] PUT /identity/v3/projects/37a6b21c18064e6ba1f173ffdacceef0/users/c08f3dec71234a39999a4998a87b6464/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:15.273178 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91efa2-7484-4acd-8ab5-d465a97ad1ad admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:15.274653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ae91efa2-7484-4acd-8ab5-d465a97ad1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:15.378446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91efa2-7484-4acd-8ab5-d465a97ad1ad admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:15.439141 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8222544-d78d-4d52-aaee-88b9de3ca817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:15.439778 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8222544-d78d-4d52-aaee-88b9de3ca817 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:15.440092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8222544-d78d-4d52-aaee-88b9de3ca817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:15.440369 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8222544-d78d-4d52-aaee-88b9de3ca817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:15.441023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8222544-d78d-4d52-aaee-88b9de3ca817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:15.442721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8222544-d78d-4d52-aaee-88b9de3ca817 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:15.453056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 931/1877] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:15.457614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c50c6-52e3-4e58-ba0c-f1f2cfd0ecac admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:15.470146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c50c6-52e3-4e58-ba0c-f1f2cfd0ecac admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:15.474918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3a3f2-24f2-493d-9177-a592b61a3443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:15.475696 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3a3f2-24f2-493d-9177-a592b61a3443 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:15.475991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3a3f2-24f2-493d-9177-a592b61a3443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:15.476271 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3a3f2-24f2-493d-9177-a592b61a3443 admin admin] PATH_INFO: `/v3/projects/37a6b21c18064e6ba1f173ffdacceef0/users/c08f3dec71234a39999a4998a87b6464/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:15.478253 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3a3f2-24f2-493d-9177-a592b61a3443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a6b21c18064e6ba1f173ffdacceef0, user_id=c08f3dec71234a39999a4998a87b6464, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:15.481913 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3a3f2-24f2-493d-9177-a592b61a3443 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:15.493314 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 947/1878] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:15 2022] PUT /identity/v3/projects/37a6b21c18064e6ba1f173ffdacceef0/users/c08f3dec71234a39999a4998a87b6464/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:16.093921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8222544-d78d-4d52-aaee-88b9de3ca817 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:16.095723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d8222544-d78d-4d52-aaee-88b9de3ca817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:16.114232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8222544-d78d-4d52-aaee-88b9de3ca817 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:16.115222 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3a3f2-24f2-493d-9177-a592b61a3443 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:16.117168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d8a3a3f2-24f2-493d-9177-a592b61a3443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:16.200801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663f340-9956-4a49-86e7-d5238a863147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:16.201466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663f340-9956-4a49-86e7-d5238a863147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:16.201914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663f340-9956-4a49-86e7-d5238a863147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:16.202020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663f340-9956-4a49-86e7-d5238a863147 admin admin] PATH_INFO: `/v3/users/cd87544a83e040d18784f6d6688aba9e` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:16.203849 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663f340-9956-4a49-86e7-d5238a863147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd87544a83e040d18784f6d6688aba9e)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:16.205927 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663f340-9956-4a49-86e7-d5238a863147 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:16.222058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3a3f2-24f2-493d-9177-a592b61a3443 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:16.227174 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:16.227841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:16.228155 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:16.228432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5 admin admin] PATH_INFO: `/v3/projects/ff76e4a0bbc94668ae337f07825067a3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:16.229651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff76e4a0bbc94668ae337f07825067a3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:16.231598 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:16.303929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:16.612333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff76e4a0bbc94668ae337f07825067a3', 'request_id': 'req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:16.612510 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f663f340-9956-4a49-86e7-d5238a863147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd87544a83e040d18784f6d6688aba9e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:16.620699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f663f340-9956-4a49-86e7-d5238a863147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd87544a83e040d18784f6d6688aba9e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:16.626690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f663f340-9956-4a49-86e7-d5238a863147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd87544a83e040d18784f6d6688aba9e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:16.789586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff76e4a0bbc94668ae337f07825067a3', 'request_id': 'req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:16.798556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff76e4a0bbc94668ae337f07825067a3', 'request_id': 'req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:16.810993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5 admin admin] The token cache is being invalidate because project ff76e4a0bbc94668ae337f07825067a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:16.811296 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:16.812087 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:16.813990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 948/1879] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:16 2022] DELETE /identity/v3/projects/ff76e4a0bbc94668ae337f07825067a3 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:16.814719 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:16.817947 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:16.870110 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f663f340-9956-4a49-86e7-d5238a863147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd87544a83e040d18784f6d6688aba9e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:16.870804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f663f340-9956-4a49-86e7-d5238a863147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd87544a83e040d18784f6d6688aba9e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:16.878887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db635cb-5b03-4d7f-b7cb-8af5ea88aba5 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:16.883296 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f686a-5734-4332-b204-c7aeac94da79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:16.884584 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f686a-5734-4332-b204-c7aeac94da79 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:16.884835 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f686a-5734-4332-b204-c7aeac94da79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:16.885129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f686a-5734-4332-b204-c7aeac94da79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:16.887643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-cf8f686a-5734-4332-b204-c7aeac94da79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:16.892949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 932/1880] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:16 2022] DELETE /identity/v3/users/cd87544a83e040d18784f6d6688aba9e => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:16.893464 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:16.894908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9657a-eec9-4a92-961a-de4670899b3e None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:16.895266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9657a-eec9-4a92-961a-de4670899b3e None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:16.895684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9657a-eec9-4a92-961a-de4670899b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:16.940763 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e2f9657a-eec9-4a92-961a-de4670899b3e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:16.942003 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e2f9657a-eec9-4a92-961a-de4670899b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:16.975964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f686a-5734-4332-b204-c7aeac94da79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:16.977414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f686a-5734-4332-b204-c7aeac94da79 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:16.988398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 949/1881] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:16.990100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e8b77-a338-42a5-b479-00e1e2a33fc4 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:16.990469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e8b77-a338-42a5-b479-00e1e2a33fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:16.990821 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e8b77-a338-42a5-b479-00e1e2a33fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:17.012759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-191e8b77-a338-42a5-b479-00e1e2a33fc4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:17.014309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-191e8b77-a338-42a5-b479-00e1e2a33fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:17.022928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 950/1882] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:17.027912 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 933/1883] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:17.036686 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9657a-eec9-4a92-961a-de4670899b3e None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:17.037050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b08d9-886c-4c04-90e1-3662af2dcff4 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:17.037490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b08d9-886c-4c04-90e1-3662af2dcff4 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:17.037913 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b08d9-886c-4c04-90e1-3662af2dcff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:17.038366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e2f9657a-eec9-4a92-961a-de4670899b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:17.074151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-8b2b08d9-886c-4c04-90e1-3662af2dcff4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:17.089456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-8b2b08d9-886c-4c04-90e1-3662af2dcff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:17.089456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 951/1884] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:17.111013 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b08d9-886c-4c04-90e1-3662af2dcff4 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:17.115639 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9657a-eec9-4a92-961a-de4670899b3e None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:17.119401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f6123-c5e4-4418-807c-714ad2bd4f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:17.120098 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f6123-c5e4-4418-807c-714ad2bd4f99 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:17.120436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f6123-c5e4-4418-807c-714ad2bd4f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:17.120653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f6123-c5e4-4418-807c-714ad2bd4f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:17.127494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b08d9-886c-4c04-90e1-3662af2dcff4 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:17.131516 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f6123-c5e4-4418-807c-714ad2bd4f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:17.133079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f6123-c5e4-4418-807c-714ad2bd4f99 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:17.136858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012385d5-4898-41ed-a052-da77475ad702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:17.138304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012385d5-4898-41ed-a052-da77475ad702 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:17.138805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012385d5-4898-41ed-a052-da77475ad702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:17.139343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012385d5-4898-41ed-a052-da77475ad702 admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:17.140918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012385d5-4898-41ed-a052-da77475ad702 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:17.141821 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012385d5-4898-41ed-a052-da77475ad702 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:17.144077 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012385d5-4898-41ed-a052-da77475ad702 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:17.145890 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 934/1885] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:17.166174 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 952/1886] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:07:17.176330 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f6123-c5e4-4418-807c-714ad2bd4f99 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:17.188899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f6123-c5e4-4418-807c-714ad2bd4f99 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:17.194991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85065c-814f-47aa-9bc7-e3a930039bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:17.199142 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85065c-814f-47aa-9bc7-e3a930039bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:17.199142 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85065c-814f-47aa-9bc7-e3a930039bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:17.199142 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85065c-814f-47aa-9bc7-e3a930039bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:17.199142 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85065c-814f-47aa-9bc7-e3a930039bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:17.200187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85065c-814f-47aa-9bc7-e3a930039bc4 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:17.310782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 935/1887] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:17 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:17.315150 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012385d5-4898-41ed-a052-da77475ad702 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:17.325646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012385d5-4898-41ed-a052-da77475ad702 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:17.382646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ed77d-9cbe-485c-9a04-dc20edefd719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:17.383175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ed77d-9cbe-485c-9a04-dc20edefd719 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:17.383454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ed77d-9cbe-485c-9a04-dc20edefd719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:17.383727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ed77d-9cbe-485c-9a04-dc20edefd719 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:17.384407 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ed77d-9cbe-485c-9a04-dc20edefd719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:17.386830 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ed77d-9cbe-485c-9a04-dc20edefd719 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:17.605902 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 953/1888] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:17 2022] POST /identity/v3/users => generated 294 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:17.607225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85065c-814f-47aa-9bc7-e3a930039bc4 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:17.620328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85065c-814f-47aa-9bc7-e3a930039bc4 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:17.627552 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20175afc-0c29-4e38-b6f2-76e9f0e974ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:17.628689 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20175afc-0c29-4e38-b6f2-76e9f0e974ef admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:17.631159 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20175afc-0c29-4e38-b6f2-76e9f0e974ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:17.631159 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20175afc-0c29-4e38-b6f2-76e9f0e974ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:17.631159 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20175afc-0c29-4e38-b6f2-76e9f0e974ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:17.631678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20175afc-0c29-4e38-b6f2-76e9f0e974ef admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:17.643966 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 936/1889] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:17.648000 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ed77d-9cbe-485c-9a04-dc20edefd719 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:17.666317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ed77d-9cbe-485c-9a04-dc20edefd719 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:17.672372 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff2090-c9eb-4b06-a85a-eca083f25005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:17.672989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff2090-c9eb-4b06-a85a-eca083f25005 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:17.673268 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff2090-c9eb-4b06-a85a-eca083f25005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:17.673547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff2090-c9eb-4b06-a85a-eca083f25005 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:17.674566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff2090-c9eb-4b06-a85a-eca083f25005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:17.676088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff2090-c9eb-4b06-a85a-eca083f25005 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:17.692294 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 954/1890] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:17.694106 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20175afc-0c29-4e38-b6f2-76e9f0e974ef admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:17.706138 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20175afc-0c29-4e38-b6f2-76e9f0e974ef admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:17.711587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd36a91-c702-4a36-a11b-f56f0b6742c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:17.713877 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd36a91-c702-4a36-a11b-f56f0b6742c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:17.714199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd36a91-c702-4a36-a11b-f56f0b6742c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:17.714484 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd36a91-c702-4a36-a11b-f56f0b6742c5 admin admin] PATH_INFO: `/v3/projects/3cf2915e1afa45ea86cee27dc0d566de/users/808fd530fa204ca4a6ad1b570a6199c7/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:17.731593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd36a91-c702-4a36-a11b-f56f0b6742c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf2915e1afa45ea86cee27dc0d566de, user_id=808fd530fa204ca4a6ad1b570a6199c7, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:17.734402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd36a91-c702-4a36-a11b-f56f0b6742c5 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:17.775956 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fd1d0-bd80-4651-b7db-fddf02bc04f4 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:17.776547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fd1d0-bd80-4651-b7db-fddf02bc04f4 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:17.778374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fd1d0-bd80-4651-b7db-fddf02bc04f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:17.820439 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-da9fd1d0-bd80-4651-b7db-fddf02bc04f4 None None] MFA Rules not processed for user `c08f3dec71234a39999a4998a87b6464`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:17.821848 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 937/1891] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:17 2022] PUT /identity/v3/projects/3cf2915e1afa45ea86cee27dc0d566de/users/808fd530fa204ca4a6ad1b570a6199c7/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:17.822699 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-da9fd1d0-bd80-4651-b7db-fddf02bc04f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:17.833031 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229e586-1954-4159-bff8-b6a04403424d None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:17.833308 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229e586-1954-4159-bff8-b6a04403424d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:17.833649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229e586-1954-4159-bff8-b6a04403424d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:17.866316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-8229e586-1954-4159-bff8-b6a04403424d None None] MFA Rules not processed for user `808fd530fa204ca4a6ad1b570a6199c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:17.867758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-8229e586-1954-4159-bff8-b6a04403424d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:17.913626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 955/1892] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:17 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:17.949028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 938/1893] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:17.953530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fd1d0-bd80-4651-b7db-fddf02bc04f4 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:17.966517 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229e586-1954-4159-bff8-b6a04403424d None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:17.972353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-8229e586-1954-4159-bff8-b6a04403424d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:18.086742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fd1d0-bd80-4651-b7db-fddf02bc04f4 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:18.093599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b889d-ff30-4028-a232-0ed39dbd3b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:18.094989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b889d-ff30-4028-a232-0ed39dbd3b6e admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:18.094989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b889d-ff30-4028-a232-0ed39dbd3b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:18.095199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b889d-ff30-4028-a232-0ed39dbd3b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:18.096341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b889d-ff30-4028-a232-0ed39dbd3b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:18.098634 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b889d-ff30-4028-a232-0ed39dbd3b6e admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:18.099455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229e586-1954-4159-bff8-b6a04403424d None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:18.105054 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91183180-32a2-4934-824a-b3926ced444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:18.105710 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183180-32a2-4934-824a-b3926ced444c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:18.106030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183180-32a2-4934-824a-b3926ced444c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:18.106269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91183180-32a2-4934-824a-b3926ced444c admin admin] PATH_INFO: `/v3/projects/6d650f27ee3f474e9695d8871deeb930` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:18.109215 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91183180-32a2-4934-824a-b3926ced444c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d650f27ee3f474e9695d8871deeb930)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:18.111582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91183180-32a2-4934-824a-b3926ced444c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:18.260259 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 956/1894] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:17 2022] POST /identity/v3/projects => generated 387 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:18.264975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b889d-ff30-4028-a232-0ed39dbd3b6e admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:18.276656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-91183180-32a2-4934-824a-b3926ced444c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d650f27ee3f474e9695d8871deeb930', 'request_id': 'req-91183180-32a2-4934-824a-b3926ced444c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:18.284397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-91183180-32a2-4934-824a-b3926ced444c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d650f27ee3f474e9695d8871deeb930', 'request_id': 'req-91183180-32a2-4934-824a-b3926ced444c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:18.334172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b889d-ff30-4028-a232-0ed39dbd3b6e admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:18.339207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bff2d-95e9-439c-aed4-48239c503aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:18.339825 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bff2d-95e9-439c-aed4-48239c503aea admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:18.340143 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bff2d-95e9-439c-aed4-48239c503aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:18.340441 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bff2d-95e9-439c-aed4-48239c503aea admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:18.341059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bff2d-95e9-439c-aed4-48239c503aea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:18.342997 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bff2d-95e9-439c-aed4-48239c503aea admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:18.623934 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-91183180-32a2-4934-824a-b3926ced444c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d650f27ee3f474e9695d8871deeb930', 'request_id': 'req-91183180-32a2-4934-824a-b3926ced444c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:18.631995 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 957/1895] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:18 2022] POST /identity/v3/users => generated 300 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:07:18.636731 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bff2d-95e9-439c-aed4-48239c503aea admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:18.644892 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-91183180-32a2-4934-824a-b3926ced444c admin admin] The token cache is being invalidate because project 6d650f27ee3f474e9695d8871deeb930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:18.645495 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-91183180-32a2-4934-824a-b3926ced444c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:18.646498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-91183180-32a2-4934-824a-b3926ced444c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:18.651657 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 939/1896] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:17 2022] DELETE /identity/v3/projects/6d650f27ee3f474e9695d8871deeb930 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:18.651793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bff2d-95e9-439c-aed4-48239c503aea admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:18.653411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91183180-32a2-4934-824a-b3926ced444c admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:18.655768 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-91183180-32a2-4934-824a-b3926ced444c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:18.656121 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7f733-e565-4cc4-ba5b-fe95fcc668db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:18.656744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7f733-e565-4cc4-ba5b-fe95fcc668db admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:18.657028 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7f733-e565-4cc4-ba5b-fe95fcc668db admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:18.657434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7f733-e565-4cc4-ba5b-fe95fcc668db admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:18.658411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7f733-e565-4cc4-ba5b-fe95fcc668db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:18.660195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7f733-e565-4cc4-ba5b-fe95fcc668db admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:18.677026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 958/1897] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:07:18.684251 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7f733-e565-4cc4-ba5b-fe95fcc668db admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:18.686109 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f9f7f733-e565-4cc4-ba5b-fe95fcc668db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:18.700729 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7f733-e565-4cc4-ba5b-fe95fcc668db admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:18.718651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e267f37-9501-4f17-a578-a56519a2f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:18.721679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e267f37-9501-4f17-a578-a56519a2f4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:18.722040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e267f37-9501-4f17-a578-a56519a2f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:18.722424 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e267f37-9501-4f17-a578-a56519a2f4a7 admin admin] PATH_INFO: `/v3/projects/daf3e7ac4c6341628baed43e664f4b8c/users/df41dafa5df84aee9936c698e91121c2/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:18.758016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e267f37-9501-4f17-a578-a56519a2f4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf3e7ac4c6341628baed43e664f4b8c, user_id=df41dafa5df84aee9936c698e91121c2, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:18.760793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e267f37-9501-4f17-a578-a56519a2f4a7 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:18.805710 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91183180-32a2-4934-824a-b3926ced444c admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:18.824951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be949ca-28b4-4539-b3cc-e85dc39c32b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:18.831046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be949ca-28b4-4539-b3cc-e85dc39c32b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:18.831339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be949ca-28b4-4539-b3cc-e85dc39c32b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:18.831619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be949ca-28b4-4539-b3cc-e85dc39c32b5 admin admin] PATH_INFO: `/v3/users/8de1516f18fd47dbbd0f47ef7cf6f358` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:18.836374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be949ca-28b4-4539-b3cc-e85dc39c32b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de1516f18fd47dbbd0f47ef7cf6f358)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:18.838626 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be949ca-28b4-4539-b3cc-e85dc39c32b5 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:18.909582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 959/1898] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:18 2022] PUT /identity/v3/projects/daf3e7ac4c6341628baed43e664f4b8c/users/df41dafa5df84aee9936c698e91121c2/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:18.910876 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4c3bf-d04e-4c13-b150-ca4e63e5b3d6 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:18.911170 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4c3bf-d04e-4c13-b150-ca4e63e5b3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:18.911450 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4c3bf-d04e-4c13-b150-ca4e63e5b3d6 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:18.912732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 960/1899] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 14:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:07:18.913431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4c3bf-d04e-4c13-b150-ca4e63e5b3d6 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:19.013998 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4c3bf-d04e-4c13-b150-ca4e63e5b3d6 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:19.024753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92c2ef-5ce1-48c0-9283-4a6cb00cb223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:19.030895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92c2ef-5ce1-48c0-9283-4a6cb00cb223 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:19.030895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92c2ef-5ce1-48c0-9283-4a6cb00cb223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:19.030895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92c2ef-5ce1-48c0-9283-4a6cb00cb223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:19.030895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92c2ef-5ce1-48c0-9283-4a6cb00cb223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:19.032705 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92c2ef-5ce1-48c0-9283-4a6cb00cb223 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:19.066653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 961/1900] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:19.070292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcc392-cbc9-404f-823f-0a0d44c87f0d None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:19.070739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcc392-cbc9-404f-823f-0a0d44c87f0d None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:19.071164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcc392-cbc9-404f-823f-0a0d44c87f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:19.125880 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7be949ca-28b4-4539-b3cc-e85dc39c32b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de1516f18fd47dbbd0f47ef7cf6f358'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:19.127281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7be949ca-28b4-4539-b3cc-e85dc39c32b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de1516f18fd47dbbd0f47ef7cf6f358'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:19.134529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-badcc392-cbc9-404f-823f-0a0d44c87f0d None None] MFA Rules not processed for user `cec4f437077c41039cae3d505b43b558`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:19.136382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-badcc392-cbc9-404f-823f-0a0d44c87f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:19.157310 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7be949ca-28b4-4539-b3cc-e85dc39c32b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de1516f18fd47dbbd0f47ef7cf6f358'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:19.248812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7be949ca-28b4-4539-b3cc-e85dc39c32b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de1516f18fd47dbbd0f47ef7cf6f358'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:19.249942 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7be949ca-28b4-4539-b3cc-e85dc39c32b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de1516f18fd47dbbd0f47ef7cf6f358'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:19.267250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 962/1901] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 14:07:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:19.268648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcc392-cbc9-404f-823f-0a0d44c87f0d None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:19.270409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-badcc392-cbc9-404f-823f-0a0d44c87f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:19.282118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 940/1902] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:18 2022] DELETE /identity/v3/users/8de1516f18fd47dbbd0f47ef7cf6f358 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:19.290181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcc392-cbc9-404f-823f-0a0d44c87f0d None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:19.320758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be949ca-28b4-4539-b3cc-e85dc39c32b5 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:19.323167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7be949ca-28b4-4539-b3cc-e85dc39c32b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:19.384414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb860515-2ce5-4e45-87cc-640c2c36dd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:19.385940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb860515-2ce5-4e45-87cc-640c2c36dd79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:19.386405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb860515-2ce5-4e45-87cc-640c2c36dd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:19.386916 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb860515-2ce5-4e45-87cc-640c2c36dd79 admin admin] PATH_INFO: `/v3/projects/daf3e7ac4c6341628baed43e664f4b8c/users/df41dafa5df84aee9936c698e91121c2/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:19.389462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb860515-2ce5-4e45-87cc-640c2c36dd79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf3e7ac4c6341628baed43e664f4b8c, user_id=df41dafa5df84aee9936c698e91121c2, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:19.393629 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb860515-2ce5-4e45-87cc-640c2c36dd79 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:19.446836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 963/1903] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:19 2022] PUT /identity/v3/projects/daf3e7ac4c6341628baed43e664f4b8c/users/df41dafa5df84aee9936c698e91121c2/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:19.459629 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5b679-72e8-4f7b-8521-28819cd167ee None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:19.460047 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5b679-72e8-4f7b-8521-28819cd167ee None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:19.460511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5b679-72e8-4f7b-8521-28819cd167ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:19.476551 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be949ca-28b4-4539-b3cc-e85dc39c32b5 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:19.498527 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-15f5b679-72e8-4f7b-8521-28819cd167ee None None] MFA Rules not processed for user `df41dafa5df84aee9936c698e91121c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:19.499820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-15f5b679-72e8-4f7b-8521-28819cd167ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:19.552664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0a717-3806-4275-be45-2be2ec5c17d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec4f437077c41039cae3d505b43b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:19.553527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0a717-3806-4275-be45-2be2ec5c17d3 service placement] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:19.554234 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0a717-3806-4275-be45-2be2ec5c17d3 service placement] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:19.554572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0a717-3806-4275-be45-2be2ec5c17d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:19.564097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0a717-3806-4275-be45-2be2ec5c17d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:19.565834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0a717-3806-4275-be45-2be2ec5c17d3 service placement] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:19.577859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 964/1904] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:07:19.578244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 941/1905] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:07:19.590491 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5b679-72e8-4f7b-8521-28819cd167ee None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:19.592341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-15f5b679-72e8-4f7b-8521-28819cd167ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:19.659302 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5b679-72e8-4f7b-8521-28819cd167ee None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:19.663275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df17a7-2e60-4345-90ce-c792953d1aee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:19.663932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df17a7-2e60-4345-90ce-c792953d1aee service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:19.664295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df17a7-2e60-4345-90ce-c792953d1aee service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:19.664649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df17a7-2e60-4345-90ce-c792953d1aee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:19.675247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df17a7-2e60-4345-90ce-c792953d1aee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:19.676895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df17a7-2e60-4345-90ce-c792953d1aee service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:19.689298 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 965/1906] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:19.744281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:20.086959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0a717-3806-4275-be45-2be2ec5c17d3 service placement] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:20.088840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b5e0a717-3806-4275-be45-2be2ec5c17d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:20.104420 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:20.151276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df17a7-2e60-4345-90ce-c792953d1aee service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:20.153344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-32df17a7-2e60-4345-90ce-c792953d1aee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:20.230440 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0a717-3806-4275-be45-2be2ec5c17d3 service placement] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:20.235891 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e997d-74c7-4993-82db-0c5a59b330ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:20.236629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e997d-74c7-4993-82db-0c5a59b330ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:20.237151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e997d-74c7-4993-82db-0c5a59b330ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:20.237493 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e997d-74c7-4993-82db-0c5a59b330ff admin admin] PATH_INFO: `/v3/users/a0726f407bec450aa7c45a6b7a3cc787` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:20.238745 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e997d-74c7-4993-82db-0c5a59b330ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0726f407bec450aa7c45a6b7a3cc787)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:20.241449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e997d-74c7-4993-82db-0c5a59b330ff admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:20.273867 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df17a7-2e60-4345-90ce-c792953d1aee service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:20.280961 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7430e0-257f-4deb-92ba-d03fd2705761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:20.292344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7430e0-257f-4deb-92ba-d03fd2705761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:20.292344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7430e0-257f-4deb-92ba-d03fd2705761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:20.292344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7430e0-257f-4deb-92ba-d03fd2705761 admin admin] PATH_INFO: `/v3/projects/1e66c8908a3f47b1a0f26ff89ec69931` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:20.292344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7430e0-257f-4deb-92ba-d03fd2705761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e66c8908a3f47b1a0f26ff89ec69931)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:20.292344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7430e0-257f-4deb-92ba-d03fd2705761 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:20.453643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-da7430e0-257f-4deb-92ba-d03fd2705761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e66c8908a3f47b1a0f26ff89ec69931', 'request_id': 'req-da7430e0-257f-4deb-92ba-d03fd2705761'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:20.602218 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-da7430e0-257f-4deb-92ba-d03fd2705761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e66c8908a3f47b1a0f26ff89ec69931', 'request_id': 'req-da7430e0-257f-4deb-92ba-d03fd2705761'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:20.611794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-da7430e0-257f-4deb-92ba-d03fd2705761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e66c8908a3f47b1a0f26ff89ec69931', 'request_id': 'req-da7430e0-257f-4deb-92ba-d03fd2705761'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:20.625362 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-da7430e0-257f-4deb-92ba-d03fd2705761 admin admin] The token cache is being invalidate because project 1e66c8908a3f47b1a0f26ff89ec69931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:20.625678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-da7430e0-257f-4deb-92ba-d03fd2705761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:20.626327 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-da7430e0-257f-4deb-92ba-d03fd2705761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:20.631424 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 966/1907] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:20 2022] DELETE /identity/v3/projects/1e66c8908a3f47b1a0f26ff89ec69931 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:07:20.633167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e577ac-5d63-4966-871a-40684025ad82 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:20.633462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e577ac-5d63-4966-871a-40684025ad82 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:20.633829 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e577ac-5d63-4966-871a-40684025ad82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:20.660707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-d4e577ac-5d63-4966-871a-40684025ad82 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:20.661977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d4e577ac-5d63-4966-871a-40684025ad82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:20.722877 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-063e997d-74c7-4993-82db-0c5a59b330ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0726f407bec450aa7c45a6b7a3cc787'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:20.724247 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-063e997d-74c7-4993-82db-0c5a59b330ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0726f407bec450aa7c45a6b7a3cc787'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:20.738328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-063e997d-74c7-4993-82db-0c5a59b330ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0726f407bec450aa7c45a6b7a3cc787'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:20.751992 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 967/1908] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:20.759647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b8048-50a7-46c5-8fc2-6cef1b7df51a None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:20.760043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b8048-50a7-46c5-8fc2-6cef1b7df51a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:20.760356 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b8048-50a7-46c5-8fc2-6cef1b7df51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:20.781871 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-027b8048-50a7-46c5-8fc2-6cef1b7df51a None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:20.781871 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-027b8048-50a7-46c5-8fc2-6cef1b7df51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:20.789527 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 968/1909] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:07:20.794407 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b8048-50a7-46c5-8fc2-6cef1b7df51a None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:20.807362 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b8048-50a7-46c5-8fc2-6cef1b7df51a None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:20.812130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e429440-a1a2-4413-ab32-a0ce95dad0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:20.812739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e429440-a1a2-4413-ab32-a0ce95dad0cd admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:20.813022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e429440-a1a2-4413-ab32-a0ce95dad0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:20.813298 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e429440-a1a2-4413-ab32-a0ce95dad0cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:20.813967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e429440-a1a2-4413-ab32-a0ce95dad0cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:20.814275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e429440-a1a2-4413-ab32-a0ce95dad0cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:20.815912 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e429440-a1a2-4413-ab32-a0ce95dad0cd admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:20.831615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 969/1910] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:07:20.836214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e429440-a1a2-4413-ab32-a0ce95dad0cd admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:20.847041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e429440-a1a2-4413-ab32-a0ce95dad0cd admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:20.852590 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37068a32-f725-4975-b620-0be1eefc0042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:20.853190 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37068a32-f725-4975-b620-0be1eefc0042 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:20.853476 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37068a32-f725-4975-b620-0be1eefc0042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:20.853746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37068a32-f725-4975-b620-0be1eefc0042 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:20.854421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37068a32-f725-4975-b620-0be1eefc0042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:20.856423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37068a32-f725-4975-b620-0be1eefc0042 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:20.858291 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-063e997d-74c7-4993-82db-0c5a59b330ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0726f407bec450aa7c45a6b7a3cc787'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:20.859280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-063e997d-74c7-4993-82db-0c5a59b330ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0726f407bec450aa7c45a6b7a3cc787'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:20.881285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 942/1911] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:20 2022] DELETE /identity/v3/users/a0726f407bec450aa7c45a6b7a3cc787 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:21.017888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 970/1912] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:20 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:07:21.018426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e997d-74c7-4993-82db-0c5a59b330ff admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:21.019990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-063e997d-74c7-4993-82db-0c5a59b330ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:21.093509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e997d-74c7-4993-82db-0c5a59b330ff admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:21.184167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b86fd-5ecf-4746-b1b3-62a35ffa7b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:21.185261 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b86fd-5ecf-4746-b1b3-62a35ffa7b97 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:21.185691 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b86fd-5ecf-4746-b1b3-62a35ffa7b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:21.186178 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b86fd-5ecf-4746-b1b3-62a35ffa7b97 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:21.187009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b86fd-5ecf-4746-b1b3-62a35ffa7b97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:21.189897 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b86fd-5ecf-4746-b1b3-62a35ffa7b97 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:21.232627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37068a32-f725-4975-b620-0be1eefc0042 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:21.238885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-37068a32-f725-4975-b620-0be1eefc0042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:21.250479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37068a32-f725-4975-b620-0be1eefc0042 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:21.257100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:21.257720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:21.258010 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:21.258634 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91 admin admin] PATH_INFO: `/v3/projects/155fa43d6cd04c26b46b35aa04e86355` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:21.259439 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=155fa43d6cd04c26b46b35aa04e86355)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:21.281046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:21.349152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 943/1913] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:21 2022] POST /identity/v3/users => generated 294 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:07:21.353842 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b86fd-5ecf-4746-b1b3-62a35ffa7b97 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:21.383004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b86fd-5ecf-4746-b1b3-62a35ffa7b97 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:21.400333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50794b08-4eb1-43e0-b5ce-fea506365fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:21.404913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50794b08-4eb1-43e0-b5ce-fea506365fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:21.404913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50794b08-4eb1-43e0-b5ce-fea506365fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:21.404913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50794b08-4eb1-43e0-b5ce-fea506365fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:21.404913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50794b08-4eb1-43e0-b5ce-fea506365fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:21.404913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50794b08-4eb1-43e0-b5ce-fea506365fb7 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:21.438764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 944/1914] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:21.439732 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50794b08-4eb1-43e0-b5ce-fea506365fb7 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:21.448813 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-50794b08-4eb1-43e0-b5ce-fea506365fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:21.471190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50794b08-4eb1-43e0-b5ce-fea506365fb7 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:21.476741 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a9a08-c014-4b36-8cb4-da63a83d4f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:21.478331 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a9a08-c014-4b36-8cb4-da63a83d4f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:21.478898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a9a08-c014-4b36-8cb4-da63a83d4f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:21.480068 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a9a08-c014-4b36-8cb4-da63a83d4f2a admin admin] PATH_INFO: `/v3/users/808fd530fa204ca4a6ad1b570a6199c7` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:21.482216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a9a08-c014-4b36-8cb4-da63a83d4f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=808fd530fa204ca4a6ad1b570a6199c7)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:21.484965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a9a08-c014-4b36-8cb4-da63a83d4f2a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:21.514490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '155fa43d6cd04c26b46b35aa04e86355', 'request_id': 'req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:21.649402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '155fa43d6cd04c26b46b35aa04e86355', 'request_id': 'req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:21.659708 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '155fa43d6cd04c26b46b35aa04e86355', 'request_id': 'req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:21.674859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91 admin admin] The token cache is being invalidate because project 155fa43d6cd04c26b46b35aa04e86355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:21.675161 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:21.675913 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:21.677929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 971/1915] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:21 2022] DELETE /identity/v3/projects/155fa43d6cd04c26b46b35aa04e86355 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:21.679302 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:21.682145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:21.765697 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-0e6a9a08-c014-4b36-8cb4-da63a83d4f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '808fd530fa204ca4a6ad1b570a6199c7'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:21.767392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-0e6a9a08-c014-4b36-8cb4-da63a83d4f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '808fd530fa204ca4a6ad1b570a6199c7'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:21.779181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd5bbf-6890-4c66-a429-1bb3a9c06b91 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:21.786984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e9d67-42d2-4a56-9248-f41d8a9def59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:21.789086 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e9d67-42d2-4a56-9248-f41d8a9def59 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:21.789444 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e9d67-42d2-4a56-9248-f41d8a9def59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:21.789590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-0e6a9a08-c014-4b36-8cb4-da63a83d4f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '808fd530fa204ca4a6ad1b570a6199c7'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:21.789753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e9d67-42d2-4a56-9248-f41d8a9def59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:21.790502 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e9d67-42d2-4a56-9248-f41d8a9def59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:21.792846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e9d67-42d2-4a56-9248-f41d8a9def59 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:21.805274 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 972/1916] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:21.806472 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e9d67-42d2-4a56-9248-f41d8a9def59 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:21.808536 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-bd7e9d67-42d2-4a56-9248-f41d8a9def59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:21.826602 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e9d67-42d2-4a56-9248-f41d8a9def59 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:21.832752 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728a967-f46c-4644-b5a7-82f785b78d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:21.833658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728a967-f46c-4644-b5a7-82f785b78d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:21.834110 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728a967-f46c-4644-b5a7-82f785b78d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:21.834451 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728a967-f46c-4644-b5a7-82f785b78d05 admin admin] PATH_INFO: `/v3/users/c08f3dec71234a39999a4998a87b6464` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:21.835760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728a967-f46c-4644-b5a7-82f785b78d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08f3dec71234a39999a4998a87b6464)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:21.838327 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728a967-f46c-4644-b5a7-82f785b78d05 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:21.957476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-0e6a9a08-c014-4b36-8cb4-da63a83d4f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '808fd530fa204ca4a6ad1b570a6199c7'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:21.958378 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-0e6a9a08-c014-4b36-8cb4-da63a83d4f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '808fd530fa204ca4a6ad1b570a6199c7'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:21.975051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 945/1917] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:21 2022] DELETE /identity/v3/users/808fd530fa204ca4a6ad1b570a6199c7 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:21.976710 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a9a08-c014-4b36-8cb4-da63a83d4f2a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:21.978622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-0e6a9a08-c014-4b36-8cb4-da63a83d4f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:22.093919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a9a08-c014-4b36-8cb4-da63a83d4f2a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:22.099356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775296c-3c0f-47f3-a01c-9269ea1cfcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:22.100233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775296c-3c0f-47f3-a01c-9269ea1cfcac admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:22.100528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775296c-3c0f-47f3-a01c-9269ea1cfcac admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:22.100829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775296c-3c0f-47f3-a01c-9269ea1cfcac admin admin] PATH_INFO: `/v3/projects/c47e5ed616ae4919bbd5f213a1f9077e/users/1ecd233f84de4931bb91a536f87fe6ae/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:22.117475 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775296c-3c0f-47f3-a01c-9269ea1cfcac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47e5ed616ae4919bbd5f213a1f9077e, user_id=1ecd233f84de4931bb91a536f87fe6ae, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:22.119351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9728a967-f46c-4644-b5a7-82f785b78d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08f3dec71234a39999a4998a87b6464'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:22.120269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775296c-3c0f-47f3-a01c-9269ea1cfcac admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:22.134885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9728a967-f46c-4644-b5a7-82f785b78d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08f3dec71234a39999a4998a87b6464'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:22.237143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 946/1918] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:21 2022] PUT /identity/v3/projects/c47e5ed616ae4919bbd5f213a1f9077e/users/1ecd233f84de4931bb91a536f87fe6ae/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:22.238695 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08677a3c-62b0-44d5-9a0c-13e4273d4557 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:22.238987 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08677a3c-62b0-44d5-9a0c-13e4273d4557 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:22.239311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08677a3c-62b0-44d5-9a0c-13e4273d4557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:22.259497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-08677a3c-62b0-44d5-9a0c-13e4273d4557 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:22.260850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-08677a3c-62b0-44d5-9a0c-13e4273d4557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:22.269439 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9728a967-f46c-4644-b5a7-82f785b78d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08f3dec71234a39999a4998a87b6464'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:22.277822 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9728a967-f46c-4644-b5a7-82f785b78d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08f3dec71234a39999a4998a87b6464'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:22.278564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9728a967-f46c-4644-b5a7-82f785b78d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08f3dec71234a39999a4998a87b6464'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:22.284675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 973/1919] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:21 2022] DELETE /identity/v3/users/c08f3dec71234a39999a4998a87b6464 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:22.286023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12e7ca-d834-449e-9a4d-e31f5d6bcc38 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:22.286375 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12e7ca-d834-449e-9a4d-e31f5d6bcc38 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:22.286758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12e7ca-d834-449e-9a4d-e31f5d6bcc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:22.317095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-ac12e7ca-d834-449e-9a4d-e31f5d6bcc38 None None] MFA Rules not processed for user `1ecd233f84de4931bb91a536f87fe6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:22.318313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ac12e7ca-d834-449e-9a4d-e31f5d6bcc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:22.331197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 947/1920] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:22.348807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08677a3c-62b0-44d5-9a0c-13e4273d4557 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:22.349260 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-08677a3c-62b0-44d5-9a0c-13e4273d4557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:22.357872 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:22.403452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 974/1921] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:22.414702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08677a3c-62b0-44d5-9a0c-13e4273d4557 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:22.415270 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12e7ca-d834-449e-9a4d-e31f5d6bcc38 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:22.417462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ac12e7ca-d834-449e-9a4d-e31f5d6bcc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:22.474796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807ca0f-2642-4e00-82aa-704b3c8d4928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:22.476003 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807ca0f-2642-4e00-82aa-704b3c8d4928 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:22.476591 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807ca0f-2642-4e00-82aa-704b3c8d4928 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:22.477308 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807ca0f-2642-4e00-82aa-704b3c8d4928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:22.508269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12e7ca-d834-449e-9a4d-e31f5d6bcc38 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:22.517761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88454120-112d-41ae-950e-6d4c8843aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:22.519417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88454120-112d-41ae-950e-6d4c8843aac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:22.520287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88454120-112d-41ae-950e-6d4c8843aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:22.521074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88454120-112d-41ae-950e-6d4c8843aac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:22.522422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88454120-112d-41ae-950e-6d4c8843aac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:22.526442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88454120-112d-41ae-950e-6d4c8843aac1 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:22.568162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807ca0f-2642-4e00-82aa-704b3c8d4928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:22.569605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807ca0f-2642-4e00-82aa-704b3c8d4928 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:22.581328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 948/1922] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:07:22.625841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807ca0f-2642-4e00-82aa-704b3c8d4928 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:22.628096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e807ca0f-2642-4e00-82aa-704b3c8d4928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:22.647002 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807ca0f-2642-4e00-82aa-704b3c8d4928 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:22.652449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4da40-5ae9-4f0d-a36b-cf4b898f6f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:22.653242 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4da40-5ae9-4f0d-a36b-cf4b898f6f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:22.653610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4da40-5ae9-4f0d-a36b-cf4b898f6f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:22.653978 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4da40-5ae9-4f0d-a36b-cf4b898f6f64 admin admin] PATH_INFO: `/v3/projects/37a6b21c18064e6ba1f173ffdacceef0` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:22.655276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4da40-5ae9-4f0d-a36b-cf4b898f6f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a6b21c18064e6ba1f173ffdacceef0)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:22.658511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4da40-5ae9-4f0d-a36b-cf4b898f6f64 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:22.696848 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 975/1923] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:22 2022] POST /identity/v3/projects => generated 385 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:22.704320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88454120-112d-41ae-950e-6d4c8843aac1 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:22.771241 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88454120-112d-41ae-950e-6d4c8843aac1 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:22.776952 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa4fdf-5ac2-4e87-ab9e-3aa0d927b8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:22.777566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa4fdf-5ac2-4e87-ab9e-3aa0d927b8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:22.777843 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa4fdf-5ac2-4e87-ab9e-3aa0d927b8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:22.778114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa4fdf-5ac2-4e87-ab9e-3aa0d927b8e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:22.779057 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa4fdf-5ac2-4e87-ab9e-3aa0d927b8e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:22.781420 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfa4fdf-5ac2-4e87-ab9e-3aa0d927b8e2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:22.828244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7cb4da40-5ae9-4f0d-a36b-cf4b898f6f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a6b21c18064e6ba1f173ffdacceef0', 'request_id': 'req-7cb4da40-5ae9-4f0d-a36b-cf4b898f6f64'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:22.834274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7cb4da40-5ae9-4f0d-a36b-cf4b898f6f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a6b21c18064e6ba1f173ffdacceef0', 'request_id': 'req-7cb4da40-5ae9-4f0d-a36b-cf4b898f6f64'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:22.865989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:22.945728 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 976/1924] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:22 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:22.949144 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa4fdf-5ac2-4e87-ab9e-3aa0d927b8e2 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:22.959142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa4fdf-5ac2-4e87-ab9e-3aa0d927b8e2 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:22.978350 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7cb4da40-5ae9-4f0d-a36b-cf4b898f6f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a6b21c18064e6ba1f173ffdacceef0', 'request_id': 'req-7cb4da40-5ae9-4f0d-a36b-cf4b898f6f64'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:22.997993 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7cb4da40-5ae9-4f0d-a36b-cf4b898f6f64 admin admin] The token cache is being invalidate because project 37a6b21c18064e6ba1f173ffdacceef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:22.997993 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7cb4da40-5ae9-4f0d-a36b-cf4b898f6f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:22.997993 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7cb4da40-5ae9-4f0d-a36b-cf4b898f6f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:23.000487 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 949/1925] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:22 2022] DELETE /identity/v3/projects/37a6b21c18064e6ba1f173ffdacceef0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:23.007275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c18ccb-1ca3-4de8-83f9-cb32e1c63161 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:23.007817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c18ccb-1ca3-4de8-83f9-cb32e1c63161 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:23.009470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c18ccb-1ca3-4de8-83f9-cb32e1c63161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:23.037856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38298e1f-2240-4719-91ef-6ff610503503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:23.038719 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38298e1f-2240-4719-91ef-6ff610503503 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:23.039081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38298e1f-2240-4719-91ef-6ff610503503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:23.039677 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38298e1f-2240-4719-91ef-6ff610503503 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:23.040485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38298e1f-2240-4719-91ef-6ff610503503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:23.043072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38298e1f-2240-4719-91ef-6ff610503503 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:23.056175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 977/1926] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:07:23.059013 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38298e1f-2240-4719-91ef-6ff610503503 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:23.061240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-38298e1f-2240-4719-91ef-6ff610503503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:23.066726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-41c18ccb-1ca3-4de8-83f9-cb32e1c63161 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:23.072167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-41c18ccb-1ca3-4de8-83f9-cb32e1c63161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:23.087979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 950/1927] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:23.089468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38298e1f-2240-4719-91ef-6ff610503503 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:23.095515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a762ee3-84b0-474e-a775-d400178921cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:23.096945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a762ee3-84b0-474e-a775-d400178921cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:23.100670 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a762ee3-84b0-474e-a775-d400178921cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:23.100670 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a762ee3-84b0-474e-a775-d400178921cc admin admin] PATH_INFO: `/v3/projects/f1cf2837c00e4b899b998efe241181ce/users/71ef2adfc0f64fd682224bf6291dd3e3/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:23.108322 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97042b50-06c6-422b-8b6f-d4ab4a890ff3 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:23.108712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97042b50-06c6-422b-8b6f-d4ab4a890ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:23.109184 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97042b50-06c6-422b-8b6f-d4ab4a890ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:23.128181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a762ee3-84b0-474e-a775-d400178921cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1cf2837c00e4b899b998efe241181ce, user_id=71ef2adfc0f64fd682224bf6291dd3e3, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:23.135911 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a762ee3-84b0-474e-a775-d400178921cc admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:23.139679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-97042b50-06c6-422b-8b6f-d4ab4a890ff3 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:23.141023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-97042b50-06c6-422b-8b6f-d4ab4a890ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:23.155522 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 951/1928] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:23.162221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97042b50-06c6-422b-8b6f-d4ab4a890ff3 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:23.172479 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97042b50-06c6-422b-8b6f-d4ab4a890ff3 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:23.177814 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7d314-fcea-468d-81dd-cd2e0112f135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:23.178437 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7d314-fcea-468d-81dd-cd2e0112f135 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:23.178789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7d314-fcea-468d-81dd-cd2e0112f135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:23.179074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7d314-fcea-468d-81dd-cd2e0112f135 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:23.179726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7d314-fcea-468d-81dd-cd2e0112f135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:23.180122 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7d314-fcea-468d-81dd-cd2e0112f135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:23.182424 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7d314-fcea-468d-81dd-cd2e0112f135 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:23.195740 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 952/1929] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:07:23.195945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7d314-fcea-468d-81dd-cd2e0112f135 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:23.199120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-96e7d314-fcea-468d-81dd-cd2e0112f135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:23.210290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 978/1930] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:23 2022] PUT /identity/v3/projects/f1cf2837c00e4b899b998efe241181ce/users/71ef2adfc0f64fd682224bf6291dd3e3/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:07:23.210290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a762ee3-84b0-474e-a775-d400178921cc admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:23.221996 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7d314-fcea-468d-81dd-cd2e0112f135 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:23.280774 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3224d27-f4e6-4382-8f4d-0d28699ea4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:23.281594 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224d27-f4e6-4382-8f4d-0d28699ea4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:23.281975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224d27-f4e6-4382-8f4d-0d28699ea4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:23.282350 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224d27-f4e6-4382-8f4d-0d28699ea4e3 admin admin] PATH_INFO: `/v3/users/74618bf1508747b999ea42ff14988481` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:23.283601 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3224d27-f4e6-4382-8f4d-0d28699ea4e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74618bf1508747b999ea42ff14988481)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:23.285667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3224d27-f4e6-4382-8f4d-0d28699ea4e3 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:23.287474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a762ee3-84b0-474e-a775-d400178921cc admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:23.293021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204bdd0-9203-49ec-9858-7cca9c8c3baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:23.293675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204bdd0-9203-49ec-9858-7cca9c8c3baa admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:23.293961 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204bdd0-9203-49ec-9858-7cca9c8c3baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:23.294239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204bdd0-9203-49ec-9858-7cca9c8c3baa admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:23.294942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204bdd0-9203-49ec-9858-7cca9c8c3baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:23.297068 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204bdd0-9203-49ec-9858-7cca9c8c3baa admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:23.444544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 979/1931] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:23 2022] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:23.445454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204bdd0-9203-49ec-9858-7cca9c8c3baa admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:23.532679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204bdd0-9203-49ec-9858-7cca9c8c3baa admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:23.537625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598715fd-e15c-4c9a-b7eb-86b2f902e5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:23.538269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598715fd-e15c-4c9a-b7eb-86b2f902e5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:23.539014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598715fd-e15c-4c9a-b7eb-86b2f902e5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:23.539014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598715fd-e15c-4c9a-b7eb-86b2f902e5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:23.539508 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598715fd-e15c-4c9a-b7eb-86b2f902e5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:23.543225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598715fd-e15c-4c9a-b7eb-86b2f902e5f9 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:23.552430 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 980/1932] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:23.554049 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598715fd-e15c-4c9a-b7eb-86b2f902e5f9 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:23.564016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598715fd-e15c-4c9a-b7eb-86b2f902e5f9 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:23.568802 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212bf7b-69e7-46aa-b33e-a134b90c894d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:23.569412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212bf7b-69e7-46aa-b33e-a134b90c894d admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:23.569815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212bf7b-69e7-46aa-b33e-a134b90c894d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:23.570107 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212bf7b-69e7-46aa-b33e-a134b90c894d admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:23.571074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212bf7b-69e7-46aa-b33e-a134b90c894d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:23.573747 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212bf7b-69e7-46aa-b33e-a134b90c894d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:23.677971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f3224d27-f4e6-4382-8f4d-0d28699ea4e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74618bf1508747b999ea42ff14988481'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:23.678641 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f3224d27-f4e6-4382-8f4d-0d28699ea4e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74618bf1508747b999ea42ff14988481'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:23.691522 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f3224d27-f4e6-4382-8f4d-0d28699ea4e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74618bf1508747b999ea42ff14988481'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:23.719609 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 981/1933] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:23 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:23.719609 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212bf7b-69e7-46aa-b33e-a134b90c894d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:23.721014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-4212bf7b-69e7-46aa-b33e-a134b90c894d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:23.734377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212bf7b-69e7-46aa-b33e-a134b90c894d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:23.739230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50e319-bee0-41f5-a96e-09f60cd1dcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:23.739855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50e319-bee0-41f5-a96e-09f60cd1dcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:23.740199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50e319-bee0-41f5-a96e-09f60cd1dcde admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:23.740476 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50e319-bee0-41f5-a96e-09f60cd1dcde admin admin] PATH_INFO: `/v3/projects/3cf2915e1afa45ea86cee27dc0d566de` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:23.741614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50e319-bee0-41f5-a96e-09f60cd1dcde admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf2915e1afa45ea86cee27dc0d566de)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:23.743516 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50e319-bee0-41f5-a96e-09f60cd1dcde admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:23.794803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f3224d27-f4e6-4382-8f4d-0d28699ea4e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74618bf1508747b999ea42ff14988481'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:23.795442 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f3224d27-f4e6-4382-8f4d-0d28699ea4e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74618bf1508747b999ea42ff14988481'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:23.811804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 953/1934] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:23 2022] DELETE /identity/v3/users/74618bf1508747b999ea42ff14988481 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:23.812636 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3224d27-f4e6-4382-8f4d-0d28699ea4e3 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:23.813988 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f3224d27-f4e6-4382-8f4d-0d28699ea4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:23.875640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3224d27-f4e6-4382-8f4d-0d28699ea4e3 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:23.880290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a2b9-cb4b-4e67-9f5e-8fc5a46e62e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:23.880888 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a2b9-cb4b-4e67-9f5e-8fc5a46e62e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:23.881173 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a2b9-cb4b-4e67-9f5e-8fc5a46e62e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:23.881451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a2b9-cb4b-4e67-9f5e-8fc5a46e62e1 admin admin] PATH_INFO: `/v3/projects/f1cf2837c00e4b899b998efe241181ce/users/71ef2adfc0f64fd682224bf6291dd3e3/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:23.883326 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294a2b9-cb4b-4e67-9f5e-8fc5a46e62e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1cf2837c00e4b899b998efe241181ce, user_id=71ef2adfc0f64fd682224bf6291dd3e3, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:23.886819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294a2b9-cb4b-4e67-9f5e-8fc5a46e62e1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:23.898019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 954/1935] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:23 2022] PUT /identity/v3/projects/f1cf2837c00e4b899b998efe241181ce/users/71ef2adfc0f64fd682224bf6291dd3e3/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:23.904168 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a2b9-cb4b-4e67-9f5e-8fc5a46e62e1 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:23.904168 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7294a2b9-cb4b-4e67-9f5e-8fc5a46e62e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:23.908817 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ba50e319-bee0-41f5-a96e-09f60cd1dcde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf2915e1afa45ea86cee27dc0d566de', 'request_id': 'req-ba50e319-bee0-41f5-a96e-09f60cd1dcde'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:23.967247 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a2b9-cb4b-4e67-9f5e-8fc5a46e62e1 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:24.023915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb98cd1-9d6b-486f-bba6-2e3ea7749bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:24.024608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb98cd1-9d6b-486f-bba6-2e3ea7749bba admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:24.024893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb98cd1-9d6b-486f-bba6-2e3ea7749bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:24.025171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb98cd1-9d6b-486f-bba6-2e3ea7749bba admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:24.025818 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb98cd1-9d6b-486f-bba6-2e3ea7749bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:24.027417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb98cd1-9d6b-486f-bba6-2e3ea7749bba admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:24.037538 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 955/1936] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:24.038574 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08274e7-fca3-4bd0-b6e0-141156f38a7a None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:24.038864 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08274e7-fca3-4bd0-b6e0-141156f38a7a None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:24.039147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08274e7-fca3-4bd0-b6e0-141156f38a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:24.058200 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-d08274e7-fca3-4bd0-b6e0-141156f38a7a None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:24.059415 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d08274e7-fca3-4bd0-b6e0-141156f38a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:24.067343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 956/1937] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:24.068561 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52dd6b-c436-40b6-aafc-a5f4e3098d23 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:24.068826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52dd6b-c436-40b6-aafc-a5f4e3098d23 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:24.069103 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52dd6b-c436-40b6-aafc-a5f4e3098d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:24.075211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ba50e319-bee0-41f5-a96e-09f60cd1dcde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf2915e1afa45ea86cee27dc0d566de', 'request_id': 'req-ba50e319-bee0-41f5-a96e-09f60cd1dcde'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:24.083842 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ba50e319-bee0-41f5-a96e-09f60cd1dcde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf2915e1afa45ea86cee27dc0d566de', 'request_id': 'req-ba50e319-bee0-41f5-a96e-09f60cd1dcde'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:24.094899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ba50e319-bee0-41f5-a96e-09f60cd1dcde admin admin] The token cache is being invalidate because project 3cf2915e1afa45ea86cee27dc0d566de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:24.095194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ba50e319-bee0-41f5-a96e-09f60cd1dcde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:24.095991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ba50e319-bee0-41f5-a96e-09f60cd1dcde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:24.097593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 982/1938] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:23 2022] DELETE /identity/v3/projects/3cf2915e1afa45ea86cee27dc0d566de => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:24.098322 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-dc52dd6b-c436-40b6-aafc-a5f4e3098d23 None None] MFA Rules not processed for user `71ef2adfc0f64fd682224bf6291dd3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:24.098454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50e319-bee0-41f5-a96e-09f60cd1dcde admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:24.099539 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-dc52dd6b-c436-40b6-aafc-a5f4e3098d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:24.099649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ba50e319-bee0-41f5-a96e-09f60cd1dcde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:24.112042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50e319-bee0-41f5-a96e-09f60cd1dcde admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:24.116682 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34607c-9d1d-4d93-ba7c-5a3654584d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:24.117282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34607c-9d1d-4d93-ba7c-5a3654584d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:24.117563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34607c-9d1d-4d93-ba7c-5a3654584d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:24.117837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34607c-9d1d-4d93-ba7c-5a3654584d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:24.118530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34607c-9d1d-4d93-ba7c-5a3654584d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:24.121151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c34607c-9d1d-4d93-ba7c-5a3654584d10 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:24.134225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 983/1939] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:24.135695 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34607c-9d1d-4d93-ba7c-5a3654584d10 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:24.137645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-5c34607c-9d1d-4d93-ba7c-5a3654584d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:24.175464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 957/1940] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:24.176289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52dd6b-c436-40b6-aafc-a5f4e3098d23 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:24.177726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-dc52dd6b-c436-40b6-aafc-a5f4e3098d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:24.191650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52dd6b-c436-40b6-aafc-a5f4e3098d23 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:24.197125 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712f9fc-567b-4261-9f97-f6267ef93c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:24.197821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712f9fc-567b-4261-9f97-f6267ef93c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:24.198107 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712f9fc-567b-4261-9f97-f6267ef93c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:24.198385 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712f9fc-567b-4261-9f97-f6267ef93c66 admin admin] PATH_INFO: `/v3/users/df41dafa5df84aee9936c698e91121c2` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:24.199608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712f9fc-567b-4261-9f97-f6267ef93c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df41dafa5df84aee9936c698e91121c2)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:24.201573 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712f9fc-567b-4261-9f97-f6267ef93c66 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:24.203501 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34607c-9d1d-4d93-ba7c-5a3654584d10 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:24.207157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b757005-2366-4433-9b2f-6d6d4ad6f783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:24.207768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b757005-2366-4433-9b2f-6d6d4ad6f783 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:24.208082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b757005-2366-4433-9b2f-6d6d4ad6f783 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:24.208353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b757005-2366-4433-9b2f-6d6d4ad6f783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:24.210072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0b757005-2366-4433-9b2f-6d6d4ad6f783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:24.222713 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b757005-2366-4433-9b2f-6d6d4ad6f783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:24.224182 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b757005-2366-4433-9b2f-6d6d4ad6f783 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:24.234160 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 984/1941] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:24.241995 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b757005-2366-4433-9b2f-6d6d4ad6f783 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:24.257998 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b757005-2366-4433-9b2f-6d6d4ad6f783 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:24.263534 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c48062-d564-42f1-acd2-7f7057c2ce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:24.264240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c48062-d564-42f1-acd2-7f7057c2ce60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:24.264528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c48062-d564-42f1-acd2-7f7057c2ce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:24.264959 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c48062-d564-42f1-acd2-7f7057c2ce60 admin admin] PATH_INFO: `/v3/projects/c3b587babd2f4231817f56b5433e86c4/users/65089419af864d2ba23e53f249c609b5/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:24.285674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c48062-d564-42f1-acd2-7f7057c2ce60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b587babd2f4231817f56b5433e86c4, user_id=65089419af864d2ba23e53f249c609b5, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:24.285674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c48062-d564-42f1-acd2-7f7057c2ce60 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:24.442193 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 985/1942] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:24 2022] PUT /identity/v3/projects/c3b587babd2f4231817f56b5433e86c4/users/65089419af864d2ba23e53f249c609b5/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:24.451766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c48062-d564-42f1-acd2-7f7057c2ce60 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:24.454931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-87c48062-d564-42f1-acd2-7f7057c2ce60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:24.528473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c48062-d564-42f1-acd2-7f7057c2ce60 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:24.532345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c36711-2231-4fba-b7df-8bd63e0a24f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:24.532961 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c36711-2231-4fba-b7df-8bd63e0a24f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:24.533243 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c36711-2231-4fba-b7df-8bd63e0a24f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:24.533517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c36711-2231-4fba-b7df-8bd63e0a24f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:24.579325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-8712f9fc-567b-4261-9f97-f6267ef93c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df41dafa5df84aee9936c698e91121c2'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:24.580340 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-8712f9fc-567b-4261-9f97-f6267ef93c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df41dafa5df84aee9936c698e91121c2'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:24.593824 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-8712f9fc-567b-4261-9f97-f6267ef93c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df41dafa5df84aee9936c698e91121c2'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:24.605015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c36711-2231-4fba-b7df-8bd63e0a24f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:24.606636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c36711-2231-4fba-b7df-8bd63e0a24f0 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:24.618592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 986/1943] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:24.620333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ae0f2-e0eb-4aec-bdcc-709c5749971b None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:24.620626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ae0f2-e0eb-4aec-bdcc-709c5749971b None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:24.620907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ae0f2-e0eb-4aec-bdcc-709c5749971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:24.652241 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-652ae0f2-e0eb-4aec-bdcc-709c5749971b None None] MFA Rules not processed for user `65089419af864d2ba23e53f249c609b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:24.653568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-652ae0f2-e0eb-4aec-bdcc-709c5749971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:24.698397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-8712f9fc-567b-4261-9f97-f6267ef93c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df41dafa5df84aee9936c698e91121c2'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:24.699283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-8712f9fc-567b-4261-9f97-f6267ef93c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df41dafa5df84aee9936c698e91121c2'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:24.719660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 958/1944] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:24 2022] DELETE /identity/v3/users/df41dafa5df84aee9936c698e91121c2 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:24.721304 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712f9fc-567b-4261-9f97-f6267ef93c66 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:24.722843 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-8712f9fc-567b-4261-9f97-f6267ef93c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:24.758135 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 987/1945] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:24.769507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ae0f2-e0eb-4aec-bdcc-709c5749971b None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:24.771001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-652ae0f2-e0eb-4aec-bdcc-709c5749971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:24.790124 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ae0f2-e0eb-4aec-bdcc-709c5749971b None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:24.826532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:24.832748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712f9fc-567b-4261-9f97-f6267ef93c66 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:24.841951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9e80e-7951-4ea7-8f58-b55236567a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:24.843072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9e80e-7951-4ea7-8f58-b55236567a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:24.843360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9e80e-7951-4ea7-8f58-b55236567a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:24.843934 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9e80e-7951-4ea7-8f58-b55236567a69 admin admin] PATH_INFO: `/v3/users/1ecd233f84de4931bb91a536f87fe6ae` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:24.845233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9e80e-7951-4ea7-8f58-b55236567a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ecd233f84de4931bb91a536f87fe6ae)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:24.848296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9e80e-7951-4ea7-8f58-b55236567a69 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:24.867575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc9990-07d8-4556-abcd-ed8b038a0b20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:24.868507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc9990-07d8-4556-abcd-ed8b038a0b20 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:24.868893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc9990-07d8-4556-abcd-ed8b038a0b20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:24.869249 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc9990-07d8-4556-abcd-ed8b038a0b20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:24.937064 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc9990-07d8-4556-abcd-ed8b038a0b20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:24.939347 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc9990-07d8-4556-abcd-ed8b038a0b20 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:24.952062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 988/1946] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:07:24.952721 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc9990-07d8-4556-abcd-ed8b038a0b20 service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:24.954164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-66fc9990-07d8-4556-abcd-ed8b038a0b20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:24.971789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc9990-07d8-4556-abcd-ed8b038a0b20 service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:24.980133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ce6d1-56ac-4a10-b312-f3310947129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:24.981062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ce6d1-56ac-4a10-b312-f3310947129d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:24.981561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ce6d1-56ac-4a10-b312-f3310947129d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:24.982019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ce6d1-56ac-4a10-b312-f3310947129d admin admin] PATH_INFO: `/v3/projects/657f966a9e784a459a8e5c1e28b22ef1` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:24.983701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ce6d1-56ac-4a10-b312-f3310947129d admin admin] RBAC: Authorizing `identity:delete_project(project_id=657f966a9e784a459a8e5c1e28b22ef1)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:24.985991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ce6d1-56ac-4a10-b312-f3310947129d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:25.020563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:25.118086 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b9e9e80e-7951-4ea7-8f58-b55236567a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ecd233f84de4931bb91a536f87fe6ae'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.118756 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b9e9e80e-7951-4ea7-8f58-b55236567a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ecd233f84de4931bb91a536f87fe6ae'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.131473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b9e9e80e-7951-4ea7-8f58-b55236567a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ecd233f84de4931bb91a536f87fe6ae'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.178511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-cf9ce6d1-56ac-4a10-b312-f3310947129d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '657f966a9e784a459a8e5c1e28b22ef1', 'request_id': 'req-cf9ce6d1-56ac-4a10-b312-f3310947129d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.275647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b9e9e80e-7951-4ea7-8f58-b55236567a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ecd233f84de4931bb91a536f87fe6ae'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.276337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b9e9e80e-7951-4ea7-8f58-b55236567a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ecd233f84de4931bb91a536f87fe6ae'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.297018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 959/1947] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:24 2022] DELETE /identity/v3/users/1ecd233f84de4931bb91a536f87fe6ae => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:25.297018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9e80e-7951-4ea7-8f58-b55236567a69 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:25.298511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b9e9e80e-7951-4ea7-8f58-b55236567a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:25.378641 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-cf9ce6d1-56ac-4a10-b312-f3310947129d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '657f966a9e784a459a8e5c1e28b22ef1', 'request_id': 'req-cf9ce6d1-56ac-4a10-b312-f3310947129d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.383289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9e80e-7951-4ea7-8f58-b55236567a69 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:25.386147 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-cf9ce6d1-56ac-4a10-b312-f3310947129d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '657f966a9e784a459a8e5c1e28b22ef1', 'request_id': 'req-cf9ce6d1-56ac-4a10-b312-f3310947129d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.394360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdce0fc-5e54-4bc4-b180-9491126db33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:25.395115 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdce0fc-5e54-4bc4-b180-9491126db33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:25.395502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdce0fc-5e54-4bc4-b180-9491126db33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:25.395827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdce0fc-5e54-4bc4-b180-9491126db33d admin admin] PATH_INFO: `/v3/users/65089419af864d2ba23e53f249c609b5` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:25.397128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdce0fc-5e54-4bc4-b180-9491126db33d admin admin] RBAC: Authorizing `identity:delete_user(user_id=65089419af864d2ba23e53f249c609b5)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:25.397296 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-cf9ce6d1-56ac-4a10-b312-f3310947129d admin admin] The token cache is being invalidate because project 657f966a9e784a459a8e5c1e28b22ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:25.397478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-cf9ce6d1-56ac-4a10-b312-f3310947129d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.398089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-cf9ce6d1-56ac-4a10-b312-f3310947129d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.399593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdce0fc-5e54-4bc4-b180-9491126db33d admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:25.402581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 989/1948] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:24 2022] DELETE /identity/v3/projects/657f966a9e784a459a8e5c1e28b22ef1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:25.402581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2063366-0a2e-4856-807e-cf6e4ac04f86 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:25.402581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2063366-0a2e-4856-807e-cf6e4ac04f86 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:25.402581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2063366-0a2e-4856-807e-cf6e4ac04f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:25.424269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-c2063366-0a2e-4856-807e-cf6e4ac04f86 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:25.425533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c2063366-0a2e-4856-807e-cf6e4ac04f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:25.435912 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 990/1949] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:25.436653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2063366-0a2e-4856-807e-cf6e4ac04f86 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:25.438098 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c2063366-0a2e-4856-807e-cf6e4ac04f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:25.453788 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2063366-0a2e-4856-807e-cf6e4ac04f86 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:25.459340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9da15b-b220-4a83-adb6-2757b0352b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:25.460035 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9da15b-b220-4a83-adb6-2757b0352b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:25.460318 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9da15b-b220-4a83-adb6-2757b0352b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:25.460591 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9da15b-b220-4a83-adb6-2757b0352b4d admin admin] PATH_INFO: `/v3/users/765565767c7547e39fefb3947adcd8b7` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:25.461763 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9da15b-b220-4a83-adb6-2757b0352b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=765565767c7547e39fefb3947adcd8b7)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:25.464055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9da15b-b220-4a83-adb6-2757b0352b4d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:25.654941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-6fdce0fc-5e54-4bc4-b180-9491126db33d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65089419af864d2ba23e53f249c609b5'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.655611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-6fdce0fc-5e54-4bc4-b180-9491126db33d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65089419af864d2ba23e53f249c609b5'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.668195 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-6fdce0fc-5e54-4bc4-b180-9491126db33d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65089419af864d2ba23e53f249c609b5'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.700040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6b9da15b-b220-4a83-adb6-2757b0352b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765565767c7547e39fefb3947adcd8b7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.712252 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6b9da15b-b220-4a83-adb6-2757b0352b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765565767c7547e39fefb3947adcd8b7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.800702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-6fdce0fc-5e54-4bc4-b180-9491126db33d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65089419af864d2ba23e53f249c609b5'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.801331 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-6fdce0fc-5e54-4bc4-b180-9491126db33d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65089419af864d2ba23e53f249c609b5'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.813986 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 960/1950] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:25 2022] DELETE /identity/v3/users/65089419af864d2ba23e53f249c609b5 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:25.814781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdce0fc-5e54-4bc4-b180-9491126db33d admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:25.816146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6fdce0fc-5e54-4bc4-b180-9491126db33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:25.886215 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdce0fc-5e54-4bc4-b180-9491126db33d admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:25.886447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6b9da15b-b220-4a83-adb6-2757b0352b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765565767c7547e39fefb3947adcd8b7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.891676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596f5d3-e4d9-4d97-a8e7-87d31101d2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:25.892382 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596f5d3-e4d9-4d97-a8e7-87d31101d2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:25.892665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596f5d3-e4d9-4d97-a8e7-87d31101d2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:25.892942 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596f5d3-e4d9-4d97-a8e7-87d31101d2be admin admin] PATH_INFO: `/v3/projects/daf3e7ac4c6341628baed43e664f4b8c` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:25.894067 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596f5d3-e4d9-4d97-a8e7-87d31101d2be admin admin] RBAC: Authorizing `identity:delete_project(project_id=daf3e7ac4c6341628baed43e664f4b8c)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:25.894249 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6b9da15b-b220-4a83-adb6-2757b0352b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765565767c7547e39fefb3947adcd8b7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.894919 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6b9da15b-b220-4a83-adb6-2757b0352b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765565767c7547e39fefb3947adcd8b7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:25.896098 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596f5d3-e4d9-4d97-a8e7-87d31101d2be admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:25.901069 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 991/1951] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:25 2022] DELETE /identity/v3/users/765565767c7547e39fefb3947adcd8b7 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:25.901888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9da15b-b220-4a83-adb6-2757b0352b4d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:25.903324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6b9da15b-b220-4a83-adb6-2757b0352b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:25.917149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:25.965140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9da15b-b220-4a83-adb6-2757b0352b4d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:25.969314 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1929aaa-05ae-4ce6-aebb-1d0ebf4d08d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:25.969936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1929aaa-05ae-4ce6-aebb-1d0ebf4d08d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:25.970221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1929aaa-05ae-4ce6-aebb-1d0ebf4d08d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:25.970498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1929aaa-05ae-4ce6-aebb-1d0ebf4d08d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:25.972556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b1929aaa-05ae-4ce6-aebb-1d0ebf4d08d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:26.039625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1929aaa-05ae-4ce6-aebb-1d0ebf4d08d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:26.041163 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1929aaa-05ae-4ce6-aebb-1d0ebf4d08d9 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:26.052681 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 992/1952] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:26.053982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e3583-b388-4e1b-97e0-c27d0fe2ae8e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:26.054365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e3583-b388-4e1b-97e0-c27d0fe2ae8e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:26.054793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e3583-b388-4e1b-97e0-c27d0fe2ae8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:26.086966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-221e3583-b388-4e1b-97e0-c27d0fe2ae8e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:26.090132 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-221e3583-b388-4e1b-97e0-c27d0fe2ae8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:26.106791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d596f5d3-e4d9-4d97-a8e7-87d31101d2be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daf3e7ac4c6341628baed43e664f4b8c', 'request_id': 'req-d596f5d3-e4d9-4d97-a8e7-87d31101d2be'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:26.124571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d596f5d3-e4d9-4d97-a8e7-87d31101d2be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daf3e7ac4c6341628baed43e664f4b8c', 'request_id': 'req-d596f5d3-e4d9-4d97-a8e7-87d31101d2be'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:26.216595 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 993/1953] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:26.238623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e3583-b388-4e1b-97e0-c27d0fe2ae8e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:26.281194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d596f5d3-e4d9-4d97-a8e7-87d31101d2be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daf3e7ac4c6341628baed43e664f4b8c', 'request_id': 'req-d596f5d3-e4d9-4d97-a8e7-87d31101d2be'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:26.307546 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d596f5d3-e4d9-4d97-a8e7-87d31101d2be admin admin] The token cache is being invalidate because project daf3e7ac4c6341628baed43e664f4b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:26.307854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d596f5d3-e4d9-4d97-a8e7-87d31101d2be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:26.309056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d596f5d3-e4d9-4d97-a8e7-87d31101d2be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:26.310753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 961/1954] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:25 2022] DELETE /identity/v3/projects/daf3e7ac4c6341628baed43e664f4b8c => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:26.317920 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873048cb-b08c-461a-9eb1-e6c0c287aa09 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:26.318927 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873048cb-b08c-461a-9eb1-e6c0c287aa09 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:26.321472 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873048cb-b08c-461a-9eb1-e6c0c287aa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:26.343094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e3583-b388-4e1b-97e0-c27d0fe2ae8e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:26.347649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdc106-002d-48f0-aacd-8318e2f8fdb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:26.348675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdc106-002d-48f0-aacd-8318e2f8fdb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:26.354318 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdc106-002d-48f0-aacd-8318e2f8fdb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:26.354318 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdc106-002d-48f0-aacd-8318e2f8fdb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:26.354318 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d0cdc106-002d-48f0-aacd-8318e2f8fdb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:26.367843 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-873048cb-b08c-461a-9eb1-e6c0c287aa09 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:26.368184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdc106-002d-48f0-aacd-8318e2f8fdb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:26.370170 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-873048cb-b08c-461a-9eb1-e6c0c287aa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:26.372113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdc106-002d-48f0-aacd-8318e2f8fdb2 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:26.383707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 994/1955] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:07:26.396355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 962/1956] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:26.404994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85c9f6-d04f-46f9-bed7-5c276f279b45 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:26.406006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85c9f6-d04f-46f9-bed7-5c276f279b45 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:26.406510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85c9f6-d04f-46f9-bed7-5c276f279b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:26.436084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-cf85c9f6-d04f-46f9-bed7-5c276f279b45 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:26.436084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-cf85c9f6-d04f-46f9-bed7-5c276f279b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:26.448318 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 995/1957] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:26.454390 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873048cb-b08c-461a-9eb1-e6c0c287aa09 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:26.508636 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873048cb-b08c-461a-9eb1-e6c0c287aa09 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:26.526665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485988e-f89d-4448-b486-b23e25ea4425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:26.527402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485988e-f89d-4448-b486-b23e25ea4425 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:26.527701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485988e-f89d-4448-b486-b23e25ea4425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:26.528046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485988e-f89d-4448-b486-b23e25ea4425 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:26.532406 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485988e-f89d-4448-b486-b23e25ea4425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:26.532406 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485988e-f89d-4448-b486-b23e25ea4425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:26.532406 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485988e-f89d-4448-b486-b23e25ea4425 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:26.542909 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85c9f6-d04f-46f9-bed7-5c276f279b45 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:26.547679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 963/1958] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:07:26.549849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-cf85c9f6-d04f-46f9-bed7-5c276f279b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:26.553179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485988e-f89d-4448-b486-b23e25ea4425 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:26.570252 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485988e-f89d-4448-b486-b23e25ea4425 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:26.591280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fd48e-0c33-4d16-a211-1edccf56e25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:26.593436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85c9f6-d04f-46f9-bed7-5c276f279b45 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:26.593563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fd48e-0c33-4d16-a211-1edccf56e25e admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:26.594139 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fd48e-0c33-4d16-a211-1edccf56e25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:26.595251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fd48e-0c33-4d16-a211-1edccf56e25e admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:26.599717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fd48e-0c33-4d16-a211-1edccf56e25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:26.607379 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fd48e-0c33-4d16-a211-1edccf56e25e admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:26.619692 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27792c6-8944-4f15-bf87-1e5dc03d2f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:26.623009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27792c6-8944-4f15-bf87-1e5dc03d2f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:26.623305 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27792c6-8944-4f15-bf87-1e5dc03d2f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:26.623886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27792c6-8944-4f15-bf87-1e5dc03d2f1c admin admin] PATH_INFO: `/v3/projects/7272742248994d0daf74532e395875f6` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:26.626595 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27792c6-8944-4f15-bf87-1e5dc03d2f1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7272742248994d0daf74532e395875f6)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:26.630294 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27792c6-8944-4f15-bf87-1e5dc03d2f1c admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:26.770397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:26.782778 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 964/1959] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:26 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:26.793284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fd48e-0c33-4d16-a211-1edccf56e25e admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:26.822013 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d27792c6-8944-4f15-bf87-1e5dc03d2f1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7272742248994d0daf74532e395875f6', 'request_id': 'req-d27792c6-8944-4f15-bf87-1e5dc03d2f1c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:26.927254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d27792c6-8944-4f15-bf87-1e5dc03d2f1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7272742248994d0daf74532e395875f6', 'request_id': 'req-d27792c6-8944-4f15-bf87-1e5dc03d2f1c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:26.933497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fd48e-0c33-4d16-a211-1edccf56e25e admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:26.941359 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d27792c6-8944-4f15-bf87-1e5dc03d2f1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7272742248994d0daf74532e395875f6', 'request_id': 'req-d27792c6-8944-4f15-bf87-1e5dc03d2f1c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:26.946296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f12e5-4d00-4902-ad18-c1156ccbc1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:26.947157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f12e5-4d00-4902-ad18-c1156ccbc1af admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:26.947676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f12e5-4d00-4902-ad18-c1156ccbc1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:26.948128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f12e5-4d00-4902-ad18-c1156ccbc1af admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:26.948916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f12e5-4d00-4902-ad18-c1156ccbc1af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:26.951080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f12e5-4d00-4902-ad18-c1156ccbc1af admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:26.956495 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d27792c6-8944-4f15-bf87-1e5dc03d2f1c admin admin] The token cache is being invalidate because project 7272742248994d0daf74532e395875f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:26.956926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d27792c6-8944-4f15-bf87-1e5dc03d2f1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:26.958214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d27792c6-8944-4f15-bf87-1e5dc03d2f1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:26.964867 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 996/1960] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:26 2022] DELETE /identity/v3/projects/7272742248994d0daf74532e395875f6 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:26.966715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04d645-0b9c-4c5d-a1b4-69e6f558d687 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:26.967026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04d645-0b9c-4c5d-a1b4-69e6f558d687 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:26.967311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04d645-0b9c-4c5d-a1b4-69e6f558d687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:26.989488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1c04d645-0b9c-4c5d-a1b4-69e6f558d687 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:26.990852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1c04d645-0b9c-4c5d-a1b4-69e6f558d687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:27.003985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 997/1961] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:27.008169 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4df1f6-4d2e-4aa3-a020-70d215cffee8 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:27.008459 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4df1f6-4d2e-4aa3-a020-70d215cffee8 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:27.008895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4df1f6-4d2e-4aa3-a020-70d215cffee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:27.031736 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-0e4df1f6-4d2e-4aa3-a020-70d215cffee8 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:27.033082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0e4df1f6-4d2e-4aa3-a020-70d215cffee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:27.042788 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 998/1962] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:27.043968 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4df1f6-4d2e-4aa3-a020-70d215cffee8 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:27.048076 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0e4df1f6-4d2e-4aa3-a020-70d215cffee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:27.075746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4df1f6-4d2e-4aa3-a020-70d215cffee8 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:27.091332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 965/1963] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:26 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:27.091332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f12e5-4d00-4902-ad18-c1156ccbc1af admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:27.092130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825636b-f070-440e-b88b-64c6e3139594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:27.103157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825636b-f070-440e-b88b-64c6e3139594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:27.103157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825636b-f070-440e-b88b-64c6e3139594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:27.103157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825636b-f070-440e-b88b-64c6e3139594 admin admin] PATH_INFO: `/v3/projects/c47e5ed616ae4919bbd5f213a1f9077e` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:27.103157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825636b-f070-440e-b88b-64c6e3139594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c47e5ed616ae4919bbd5f213a1f9077e)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:27.103157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825636b-f070-440e-b88b-64c6e3139594 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:27.113661 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f12e5-4d00-4902-ad18-c1156ccbc1af admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:27.122671 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81427d57-9aba-4f50-bd9d-3bb6259a89db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:27.123304 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81427d57-9aba-4f50-bd9d-3bb6259a89db admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:27.123597 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81427d57-9aba-4f50-bd9d-3bb6259a89db admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:27.123853 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81427d57-9aba-4f50-bd9d-3bb6259a89db admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:27.124528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81427d57-9aba-4f50-bd9d-3bb6259a89db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:27.124830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81427d57-9aba-4f50-bd9d-3bb6259a89db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:27.126446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81427d57-9aba-4f50-bd9d-3bb6259a89db admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:27.152151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 966/1964] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:07:27.153354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81427d57-9aba-4f50-bd9d-3bb6259a89db admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:27.156282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-81427d57-9aba-4f50-bd9d-3bb6259a89db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:27.170520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81427d57-9aba-4f50-bd9d-3bb6259a89db admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:27.176352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af6a87-5d7f-443c-bf8e-251334af5fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:27.177022 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af6a87-5d7f-443c-bf8e-251334af5fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:27.178320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af6a87-5d7f-443c-bf8e-251334af5fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:27.178667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af6a87-5d7f-443c-bf8e-251334af5fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:27.179410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af6a87-5d7f-443c-bf8e-251334af5fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:27.181030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af6a87-5d7f-443c-bf8e-251334af5fe1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:27.192229 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 967/1965] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:27.193028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af6a87-5d7f-443c-bf8e-251334af5fe1 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:27.204440 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af6a87-5d7f-443c-bf8e-251334af5fe1 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:27.209736 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8a9eb-b316-478e-8c2d-603dca69fb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:27.210506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8a9eb-b316-478e-8c2d-603dca69fb8b admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:27.211249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8a9eb-b316-478e-8c2d-603dca69fb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:27.211709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8a9eb-b316-478e-8c2d-603dca69fb8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:27.223514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8a9eb-b316-478e-8c2d-603dca69fb8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:27.223514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8a9eb-b316-478e-8c2d-603dca69fb8b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:27.264499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d825636b-f070-440e-b88b-64c6e3139594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c47e5ed616ae4919bbd5f213a1f9077e', 'request_id': 'req-d825636b-f070-440e-b88b-64c6e3139594'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:27.337204 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 968/1966] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:27 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:27.338451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8a9eb-b316-478e-8c2d-603dca69fb8b admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:27.424169 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d825636b-f070-440e-b88b-64c6e3139594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c47e5ed616ae4919bbd5f213a1f9077e', 'request_id': 'req-d825636b-f070-440e-b88b-64c6e3139594'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:27.432695 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d825636b-f070-440e-b88b-64c6e3139594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c47e5ed616ae4919bbd5f213a1f9077e', 'request_id': 'req-d825636b-f070-440e-b88b-64c6e3139594'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:27.438416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8a9eb-b316-478e-8c2d-603dca69fb8b admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:27.450200 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5e2ca-dea9-44aa-9e5e-ce19cfab52e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:27.454973 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d825636b-f070-440e-b88b-64c6e3139594 admin admin] The token cache is being invalidate because project c47e5ed616ae4919bbd5f213a1f9077e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:27.455171 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d825636b-f070-440e-b88b-64c6e3139594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:27.455749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5e2ca-dea9-44aa-9e5e-ce19cfab52e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:27.456226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d825636b-f070-440e-b88b-64c6e3139594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:27.456733 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5e2ca-dea9-44aa-9e5e-ce19cfab52e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:27.457007 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5e2ca-dea9-44aa-9e5e-ce19cfab52e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:27.457748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5e2ca-dea9-44aa-9e5e-ce19cfab52e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:27.459406 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5e2ca-dea9-44aa-9e5e-ce19cfab52e3 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:27.462021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 999/1967] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:27 2022] DELETE /identity/v3/projects/c47e5ed616ae4919bbd5f213a1f9077e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:27.463030 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825636b-f070-440e-b88b-64c6e3139594 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:27.468777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d825636b-f070-440e-b88b-64c6e3139594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:27.482538 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 969/1968] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:27.483758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5e2ca-dea9-44aa-9e5e-ce19cfab52e3 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:27.487536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-24c5e2ca-dea9-44aa-9e5e-ce19cfab52e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:27.502602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5e2ca-dea9-44aa-9e5e-ce19cfab52e3 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:27.507514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9d92c-3ffc-4ce2-8bcb-19fc54d785e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:27.508292 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9d92c-3ffc-4ce2-8bcb-19fc54d785e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:27.508840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9d92c-3ffc-4ce2-8bcb-19fc54d785e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:27.508840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9d92c-3ffc-4ce2-8bcb-19fc54d785e1 admin admin] PATH_INFO: `/v3/users/71ef2adfc0f64fd682224bf6291dd3e3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:27.510699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9d92c-3ffc-4ce2-8bcb-19fc54d785e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ef2adfc0f64fd682224bf6291dd3e3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:27.512681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9d92c-3ffc-4ce2-8bcb-19fc54d785e1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:27.572265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825636b-f070-440e-b88b-64c6e3139594 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:27.583824 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281b22b-3c11-4a4a-83dd-255458e51066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:27.584929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281b22b-3c11-4a4a-83dd-255458e51066 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:27.584929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281b22b-3c11-4a4a-83dd-255458e51066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:27.585298 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281b22b-3c11-4a4a-83dd-255458e51066 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:27.585949 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281b22b-3c11-4a4a-83dd-255458e51066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:27.589468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281b22b-3c11-4a4a-83dd-255458e51066 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:27.856230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1000/1969] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:27 2022] POST /identity/v3/users => generated 284 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:27.856230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281b22b-3c11-4a4a-83dd-255458e51066 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:27.861934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3281b22b-3c11-4a4a-83dd-255458e51066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:27.875148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-21b9d92c-3ffc-4ce2-8bcb-19fc54d785e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ef2adfc0f64fd682224bf6291dd3e3'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:27.875786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-21b9d92c-3ffc-4ce2-8bcb-19fc54d785e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ef2adfc0f64fd682224bf6291dd3e3'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:27.882404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281b22b-3c11-4a4a-83dd-255458e51066 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:27.890292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd091d65-fea0-443f-9a9c-34b34677a5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:27.890292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd091d65-fea0-443f-9a9c-34b34677a5da admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:27.890292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd091d65-fea0-443f-9a9c-34b34677a5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:27.890292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd091d65-fea0-443f-9a9c-34b34677a5da admin admin] PATH_INFO: `/v3/projects/e49db150770040e89de656f57a71a19b/users/284de6ba772d40a0a6ff7098f653aefb/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:27.897808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-21b9d92c-3ffc-4ce2-8bcb-19fc54d785e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ef2adfc0f64fd682224bf6291dd3e3'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:27.917209 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd091d65-fea0-443f-9a9c-34b34677a5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49db150770040e89de656f57a71a19b, user_id=284de6ba772d40a0a6ff7098f653aefb, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:27.917209 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd091d65-fea0-443f-9a9c-34b34677a5da admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:27.983809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-21b9d92c-3ffc-4ce2-8bcb-19fc54d785e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ef2adfc0f64fd682224bf6291dd3e3'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:27.984408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-21b9d92c-3ffc-4ce2-8bcb-19fc54d785e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ef2adfc0f64fd682224bf6291dd3e3'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:27.998656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 970/1970] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:27 2022] DELETE /identity/v3/users/71ef2adfc0f64fd682224bf6291dd3e3 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:27.999517 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9d92c-3ffc-4ce2-8bcb-19fc54d785e1 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:28.000959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-21b9d92c-3ffc-4ce2-8bcb-19fc54d785e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:28.061763 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1001/1971] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:27 2022] PUT /identity/v3/projects/e49db150770040e89de656f57a71a19b/users/284de6ba772d40a0a6ff7098f653aefb/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:28.062898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd091d65-fea0-443f-9a9c-34b34677a5da admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:28.066203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fd091d65-fea0-443f-9a9c-34b34677a5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:28.087129 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9d92c-3ffc-4ce2-8bcb-19fc54d785e1 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:28.163116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd091d65-fea0-443f-9a9c-34b34677a5da admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:28.176292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403be58a-2de2-47b0-87cd-6f2155fab5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:28.176976 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403be58a-2de2-47b0-87cd-6f2155fab5ee admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:28.177266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403be58a-2de2-47b0-87cd-6f2155fab5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:28.177880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403be58a-2de2-47b0-87cd-6f2155fab5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:28.178542 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36405a9f-cfc3-404c-8d85-8f11f4af8939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:28.178962 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403be58a-2de2-47b0-87cd-6f2155fab5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:28.179383 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36405a9f-cfc3-404c-8d85-8f11f4af8939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:28.179757 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36405a9f-cfc3-404c-8d85-8f11f4af8939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:28.180161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36405a9f-cfc3-404c-8d85-8f11f4af8939 admin admin] PATH_INFO: `/v3/projects/c3b587babd2f4231817f56b5433e86c4` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:28.180799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403be58a-2de2-47b0-87cd-6f2155fab5ee admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:28.196449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1002/1972] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:28.196449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679fa86-7284-424b-acd6-5e35e15e20eb None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:28.196449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679fa86-7284-424b-acd6-5e35e15e20eb None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:28.196449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679fa86-7284-424b-acd6-5e35e15e20eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:28.209285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36405a9f-cfc3-404c-8d85-8f11f4af8939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b587babd2f4231817f56b5433e86c4)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:28.212425 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36405a9f-cfc3-404c-8d85-8f11f4af8939 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:28.237346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1679fa86-7284-424b-acd6-5e35e15e20eb None None] MFA Rules not processed for user `284de6ba772d40a0a6ff7098f653aefb`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:28.238640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1679fa86-7284-424b-acd6-5e35e15e20eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:28.323227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1003/1973] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:28.324334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679fa86-7284-424b-acd6-5e35e15e20eb None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:28.345057 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679fa86-7284-424b-acd6-5e35e15e20eb None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:28.360433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-36405a9f-cfc3-404c-8d85-8f11f4af8939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b587babd2f4231817f56b5433e86c4', 'request_id': 'req-36405a9f-cfc3-404c-8d85-8f11f4af8939'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:28.368673 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-36405a9f-cfc3-404c-8d85-8f11f4af8939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b587babd2f4231817f56b5433e86c4', 'request_id': 'req-36405a9f-cfc3-404c-8d85-8f11f4af8939'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:28.412746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17a78e-6159-4091-9c7f-0782a03cd96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:28.413358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17a78e-6159-4091-9c7f-0782a03cd96a admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:28.413638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17a78e-6159-4091-9c7f-0782a03cd96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:28.413914 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17a78e-6159-4091-9c7f-0782a03cd96a admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:28.414564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17a78e-6159-4091-9c7f-0782a03cd96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:28.416360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17a78e-6159-4091-9c7f-0782a03cd96a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:28.427319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1004/1974] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:28.428640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17a78e-6159-4091-9c7f-0782a03cd96a admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:28.436841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0d17a78e-6159-4091-9c7f-0782a03cd96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:28.450648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17a78e-6159-4091-9c7f-0782a03cd96a admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:28.457675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59494f82-96f4-469d-a820-7a0fe87fcf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:28.458544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59494f82-96f4-469d-a820-7a0fe87fcf70 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:28.458666 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59494f82-96f4-469d-a820-7a0fe87fcf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:28.458939 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59494f82-96f4-469d-a820-7a0fe87fcf70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:28.460226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59494f82-96f4-469d-a820-7a0fe87fcf70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:28.462275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59494f82-96f4-469d-a820-7a0fe87fcf70 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:28.465728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-36405a9f-cfc3-404c-8d85-8f11f4af8939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b587babd2f4231817f56b5433e86c4', 'request_id': 'req-36405a9f-cfc3-404c-8d85-8f11f4af8939'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:28.487687 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-36405a9f-cfc3-404c-8d85-8f11f4af8939 admin admin] The token cache is being invalidate because project c3b587babd2f4231817f56b5433e86c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:28.490027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-36405a9f-cfc3-404c-8d85-8f11f4af8939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:28.491781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-36405a9f-cfc3-404c-8d85-8f11f4af8939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:28.493436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 971/1975] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:27 2022] DELETE /identity/v3/projects/c3b587babd2f4231817f56b5433e86c4 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:28.494893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36405a9f-cfc3-404c-8d85-8f11f4af8939 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:28.507072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-36405a9f-cfc3-404c-8d85-8f11f4af8939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:28.520675 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36405a9f-cfc3-404c-8d85-8f11f4af8939 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:28.526329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664a2de-0f1d-4e0c-a726-665fcb584a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:28.527038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664a2de-0f1d-4e0c-a726-665fcb584a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:28.527321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664a2de-0f1d-4e0c-a726-665fcb584a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:28.527598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664a2de-0f1d-4e0c-a726-665fcb584a9c admin admin] PATH_INFO: `/v3/projects/24e8511925f845b09e1d43ea8bf1ec72/users/7b7a91f3ec134108bdac02ac7c0cecc2/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:28.546420 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664a2de-0f1d-4e0c-a726-665fcb584a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e8511925f845b09e1d43ea8bf1ec72, user_id=7b7a91f3ec134108bdac02ac7c0cecc2, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:28.549636 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664a2de-0f1d-4e0c-a726-665fcb584a9c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:28.582367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1005/1976] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:28 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:28.593479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c581725-1aa1-4745-87a6-effd1ae348ee None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:28.594123 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c581725-1aa1-4745-87a6-effd1ae348ee None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:28.594606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c581725-1aa1-4745-87a6-effd1ae348ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:28.625930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-0c581725-1aa1-4745-87a6-effd1ae348ee None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:28.628134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0c581725-1aa1-4745-87a6-effd1ae348ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:28.693227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 972/1977] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:28 2022] PUT /identity/v3/projects/24e8511925f845b09e1d43ea8bf1ec72/users/7b7a91f3ec134108bdac02ac7c0cecc2/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:28.694527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664a2de-0f1d-4e0c-a726-665fcb584a9c admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:28.698493 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f664a2de-0f1d-4e0c-a726-665fcb584a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:28.719945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1006/1978] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:28.719945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419441-bf43-4731-b525-e598bf58c12e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:28.719945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419441-bf43-4731-b525-e598bf58c12e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:28.719945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419441-bf43-4731-b525-e598bf58c12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:28.767847 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-2b419441-bf43-4731-b525-e598bf58c12e None None] MFA Rules not processed for user `7b7a91f3ec134108bdac02ac7c0cecc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:28.769118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2b419441-bf43-4731-b525-e598bf58c12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:28.816838 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664a2de-0f1d-4e0c-a726-665fcb584a9c admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:28.832230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf88ba-701e-427b-b88d-939bebe70c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:28.832854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf88ba-701e-427b-b88d-939bebe70c2d admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:28.833154 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf88ba-701e-427b-b88d-939bebe70c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:28.833390 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf88ba-701e-427b-b88d-939bebe70c2d admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:28.834068 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf88ba-701e-427b-b88d-939bebe70c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:28.836356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf88ba-701e-427b-b88d-939bebe70c2d admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:28.897186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1007/1979] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:28.898855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb843da-031c-435a-853c-1dbbcc2a71f5 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:28.899391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb843da-031c-435a-853c-1dbbcc2a71f5 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:28.899391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb843da-031c-435a-853c-1dbbcc2a71f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:28.926724 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-ddb843da-031c-435a-853c-1dbbcc2a71f5 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:28.928175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ddb843da-031c-435a-853c-1dbbcc2a71f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:28.941802 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1008/1980] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:28.942783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb843da-031c-435a-853c-1dbbcc2a71f5 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:28.956430 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ddb843da-031c-435a-853c-1dbbcc2a71f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:28.959770 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb843da-031c-435a-853c-1dbbcc2a71f5 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:28.986505 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aee28-4dc2-43eb-be15-9808b22f66f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:28.987437 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aee28-4dc2-43eb-be15-9808b22f66f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:28.987798 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aee28-4dc2-43eb-be15-9808b22f66f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:28.990190 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aee28-4dc2-43eb-be15-9808b22f66f0 admin admin] PATH_INFO: `/v3/projects/f1cf2837c00e4b899b998efe241181ce` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:28.990394 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 973/1981] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:28 2022] POST /identity/v3/users => generated 299 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:28.992998 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf88ba-701e-427b-b88d-939bebe70c2d admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:28.994212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794aee28-4dc2-43eb-be15-9808b22f66f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1cf2837c00e4b899b998efe241181ce)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:28.996383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794aee28-4dc2-43eb-be15-9808b22f66f0 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:29.019817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf88ba-701e-427b-b88d-939bebe70c2d admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:29.024868 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda862a-e10a-4346-8ccc-ed189c67ccd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:29.025723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda862a-e10a-4346-8ccc-ed189c67ccd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:29.029603 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda862a-e10a-4346-8ccc-ed189c67ccd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:29.029603 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda862a-e10a-4346-8ccc-ed189c67ccd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:29.029603 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda862a-e10a-4346-8ccc-ed189c67ccd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:29.029603 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda862a-e10a-4346-8ccc-ed189c67ccd9 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:29.141662 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-794aee28-4dc2-43eb-be15-9808b22f66f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1cf2837c00e4b899b998efe241181ce', 'request_id': 'req-794aee28-4dc2-43eb-be15-9808b22f66f0'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:29.208097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 974/1982] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:28 2022] POST /identity/v3/projects => generated 365 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:29.209041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda862a-e10a-4346-8ccc-ed189c67ccd9 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:29.264346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-794aee28-4dc2-43eb-be15-9808b22f66f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1cf2837c00e4b899b998efe241181ce', 'request_id': 'req-794aee28-4dc2-43eb-be15-9808b22f66f0'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:29.275262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-794aee28-4dc2-43eb-be15-9808b22f66f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1cf2837c00e4b899b998efe241181ce', 'request_id': 'req-794aee28-4dc2-43eb-be15-9808b22f66f0'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:29.288598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda862a-e10a-4346-8ccc-ed189c67ccd9 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:29.294473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-794aee28-4dc2-43eb-be15-9808b22f66f0 admin admin] The token cache is being invalidate because project f1cf2837c00e4b899b998efe241181ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:29.294851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-794aee28-4dc2-43eb-be15-9808b22f66f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:29.296015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632670c3-be5b-4c95-8ce8-30da2e360071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:29.296884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632670c3-be5b-4c95-8ce8-30da2e360071 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:29.297307 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632670c3-be5b-4c95-8ce8-30da2e360071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:29.297713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632670c3-be5b-4c95-8ce8-30da2e360071 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:29.298773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632670c3-be5b-4c95-8ce8-30da2e360071 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:29.299463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632670c3-be5b-4c95-8ce8-30da2e360071 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:29.301699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632670c3-be5b-4c95-8ce8-30da2e360071 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:29.303546 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-794aee28-4dc2-43eb-be15-9808b22f66f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:29.305837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1009/1983] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:28 2022] DELETE /identity/v3/projects/f1cf2837c00e4b899b998efe241181ce => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:29.309215 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aee28-4dc2-43eb-be15-9808b22f66f0 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:29.315706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-794aee28-4dc2-43eb-be15-9808b22f66f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:29.331647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 975/1984] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:07:29.332693 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632670c3-be5b-4c95-8ce8-30da2e360071 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:29.334765 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-632670c3-be5b-4c95-8ce8-30da2e360071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:29.350290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632670c3-be5b-4c95-8ce8-30da2e360071 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:29.356034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662f1cf-545a-42dd-b386-2a1f69a855cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:29.356671 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662f1cf-545a-42dd-b386-2a1f69a855cc admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:29.356956 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662f1cf-545a-42dd-b386-2a1f69a855cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:29.357233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662f1cf-545a-42dd-b386-2a1f69a855cc admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:29.357877 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662f1cf-545a-42dd-b386-2a1f69a855cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:29.359973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662f1cf-545a-42dd-b386-2a1f69a855cc admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:29.402329 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aee28-4dc2-43eb-be15-9808b22f66f0 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:29.407447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f19e8-6672-4f71-802b-2f1eb20840b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:29.408258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f19e8-6672-4f71-802b-2f1eb20840b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:29.408642 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f19e8-6672-4f71-802b-2f1eb20840b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:29.409017 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f19e8-6672-4f71-802b-2f1eb20840b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:29.409805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f19e8-6672-4f71-802b-2f1eb20840b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:29.411547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f19e8-6672-4f71-802b-2f1eb20840b7 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:29.423831 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1010/1985] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:29.425663 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c26e5b-68fc-4703-9d41-3701fe5823d1 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:29.426131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c26e5b-68fc-4703-9d41-3701fe5823d1 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:29.426541 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c26e5b-68fc-4703-9d41-3701fe5823d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:29.451988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-20c26e5b-68fc-4703-9d41-3701fe5823d1 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:29.453560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-20c26e5b-68fc-4703-9d41-3701fe5823d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:29.462547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1011/1986] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:29.463887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c26e5b-68fc-4703-9d41-3701fe5823d1 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:29.469336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-20c26e5b-68fc-4703-9d41-3701fe5823d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:29.488971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c26e5b-68fc-4703-9d41-3701fe5823d1 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:29.496447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323423f-6680-4abd-93d6-30417db436ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:29.497799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323423f-6680-4abd-93d6-30417db436ae admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:29.498582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323423f-6680-4abd-93d6-30417db436ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:29.499083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323423f-6680-4abd-93d6-30417db436ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:29.499919 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323423f-6680-4abd-93d6-30417db436ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:29.503357 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323423f-6680-4abd-93d6-30417db436ae admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:29.548156 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 976/1987] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:29 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:29.548369 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662f1cf-545a-42dd-b386-2a1f69a855cc admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:29.561549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:29.562097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662f1cf-545a-42dd-b386-2a1f69a855cc admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:29.567415 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72e66f-594c-4ab7-82f3-bbd58e714a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:29.568198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e66f-594c-4ab7-82f3-bbd58e714a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:29.568579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e66f-594c-4ab7-82f3-bbd58e714a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:29.568953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e66f-594c-4ab7-82f3-bbd58e714a1d admin admin] PATH_INFO: `/v3/projects/62f0e040e51b45be9586660b730ff3a8/users/df4a36376fec4bafb822f1ad3b3ee6f4/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:29.588599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72e66f-594c-4ab7-82f3-bbd58e714a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f0e040e51b45be9586660b730ff3a8, user_id=df4a36376fec4bafb822f1ad3b3ee6f4, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:29.591383 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72e66f-594c-4ab7-82f3-bbd58e714a1d admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:29.786872 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 977/1988] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:29 2022] PUT /identity/v3/projects/62f0e040e51b45be9586660b730ff3a8/users/df4a36376fec4bafb822f1ad3b3ee6f4/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:29.788306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0a434-3476-4ba7-aadb-45c25d122c6c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:29.788575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0a434-3476-4ba7-aadb-45c25d122c6c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:29.788853 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0a434-3476-4ba7-aadb-45c25d122c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:29.794213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1012/1989] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:29 2022] POST /identity/v3/projects => generated 375 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:29.796040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323423f-6680-4abd-93d6-30417db436ae admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:29.813637 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6dd0a434-3476-4ba7-aadb-45c25d122c6c None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:29.814790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6dd0a434-3476-4ba7-aadb-45c25d122c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:29.888898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323423f-6680-4abd-93d6-30417db436ae admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:29.895613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292a02d-5d47-4149-ba78-1da4f739392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:29.895777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292a02d-5d47-4149-ba78-1da4f739392c admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:29.896053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292a02d-5d47-4149-ba78-1da4f739392c admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:29.896336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292a02d-5d47-4149-ba78-1da4f739392c admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:29.897023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292a02d-5d47-4149-ba78-1da4f739392c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:29.898650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292a02d-5d47-4149-ba78-1da4f739392c admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:29.903110 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 978/1990] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:29.904619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0a434-3476-4ba7-aadb-45c25d122c6c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:29.913493 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1013/1991] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:29.913493 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292a02d-5d47-4149-ba78-1da4f739392c admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:29.917281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0a434-3476-4ba7-aadb-45c25d122c6c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:29.926255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15429615-9f7f-45f3-b1e4-af8494d2daa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:29.927344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15429615-9f7f-45f3-b1e4-af8494d2daa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:29.927774 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15429615-9f7f-45f3-b1e4-af8494d2daa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:29.928230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15429615-9f7f-45f3-b1e4-af8494d2daa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:29.929043 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15429615-9f7f-45f3-b1e4-af8494d2daa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:29.929807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292a02d-5d47-4149-ba78-1da4f739392c admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:29.932832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15429615-9f7f-45f3-b1e4-af8494d2daa0 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:29.937139 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d023c3-0f77-4fef-89d5-513b8e1a9e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:29.938299 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d023c3-0f77-4fef-89d5-513b8e1a9e0e admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:29.938685 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d023c3-0f77-4fef-89d5-513b8e1a9e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:29.939061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d023c3-0f77-4fef-89d5-513b8e1a9e0e admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:29.940474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d023c3-0f77-4fef-89d5-513b8e1a9e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:29.957615 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 979/1992] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:29.957615 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15429615-9f7f-45f3-b1e4-af8494d2daa0 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:29.957808 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d023c3-0f77-4fef-89d5-513b8e1a9e0e admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:29.977494 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15429615-9f7f-45f3-b1e4-af8494d2daa0 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:29.982675 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15586aa0-2e07-4deb-89a1-10196b467b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:29.992236 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15586aa0-2e07-4deb-89a1-10196b467b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:29.992906 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15586aa0-2e07-4deb-89a1-10196b467b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:29.993474 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15586aa0-2e07-4deb-89a1-10196b467b59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:29.995225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15586aa0-2e07-4deb-89a1-10196b467b59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:29.995588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15586aa0-2e07-4deb-89a1-10196b467b59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:30.001160 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15586aa0-2e07-4deb-89a1-10196b467b59 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:30.016328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 980/1993] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:07:30.016328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15586aa0-2e07-4deb-89a1-10196b467b59 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:30.028874 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15586aa0-2e07-4deb-89a1-10196b467b59 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:30.037852 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2b62a-7e3b-49f1-99df-ff99deb411ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:30.038701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2b62a-7e3b-49f1-99df-ff99deb411ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:30.039168 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2b62a-7e3b-49f1-99df-ff99deb411ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:30.050458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2b62a-7e3b-49f1-99df-ff99deb411ba admin admin] PATH_INFO: `/v3/projects/334fe19f8a1b46dca033b7b6d7096462/users/740253eacb4a4a85940a8fb117b407b7/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:30.057357 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2b62a-7e3b-49f1-99df-ff99deb411ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=334fe19f8a1b46dca033b7b6d7096462, user_id=740253eacb4a4a85940a8fb117b407b7, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:30.060356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2b62a-7e3b-49f1-99df-ff99deb411ba admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:30.105707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1014/1994] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:29 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:30.107010 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d023c3-0f77-4fef-89d5-513b8e1a9e0e admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:30.129977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d023c3-0f77-4fef-89d5-513b8e1a9e0e admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:30.135294 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d2b3c-4af9-4320-a007-0125faab62ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:30.136213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d2b3c-4af9-4320-a007-0125faab62ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:30.137056 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d2b3c-4af9-4320-a007-0125faab62ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:30.137346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d2b3c-4af9-4320-a007-0125faab62ed admin admin] PATH_INFO: `/v3/projects/62f0e040e51b45be9586660b730ff3a8/users/df4a36376fec4bafb822f1ad3b3ee6f4/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:30.140383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d2b3c-4af9-4320-a007-0125faab62ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f0e040e51b45be9586660b730ff3a8, user_id=df4a36376fec4bafb822f1ad3b3ee6f4, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:30.146370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d2b3c-4af9-4320-a007-0125faab62ed admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:30.146488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 981/1995] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:30 2022] PUT /identity/v3/projects/334fe19f8a1b46dca033b7b6d7096462/users/740253eacb4a4a85940a8fb117b407b7/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:30.146662 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2b62a-7e3b-49f1-99df-ff99deb411ba admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:30.172917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1015/1996] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:30 2022] PUT /identity/v3/projects/62f0e040e51b45be9586660b730ff3a8/users/df4a36376fec4bafb822f1ad3b3ee6f4/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:30.174117 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d2b3c-4af9-4320-a007-0125faab62ed admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:30.250990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2b62a-7e3b-49f1-99df-ff99deb411ba admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:30.257792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285f77-68e0-467a-a591-46a0dd17ade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:30.258621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285f77-68e0-467a-a591-46a0dd17ade5 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:30.259052 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285f77-68e0-467a-a591-46a0dd17ade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:30.259474 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d285f77-68e0-467a-a591-46a0dd17ade5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:30.260825 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d2b3c-4af9-4320-a007-0125faab62ed admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:30.261054 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d285f77-68e0-467a-a591-46a0dd17ade5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:30.264822 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d285f77-68e0-467a-a591-46a0dd17ade5 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:30.268078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325328-e70f-4861-ad0a-8297725696d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:30.268916 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325328-e70f-4861-ad0a-8297725696d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:30.270045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325328-e70f-4861-ad0a-8297725696d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:30.270045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325328-e70f-4861-ad0a-8297725696d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:30.270618 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68325328-e70f-4861-ad0a-8297725696d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:30.272316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68325328-e70f-4861-ad0a-8297725696d1 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:30.293009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1016/1997] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:30.294419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325328-e70f-4861-ad0a-8297725696d1 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:30.305671 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325328-e70f-4861-ad0a-8297725696d1 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:30.311572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb50a2-114e-470f-9c66-6bc3ef7ce33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:30.312466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb50a2-114e-470f-9c66-6bc3ef7ce33a admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:30.312750 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb50a2-114e-470f-9c66-6bc3ef7ce33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:30.313023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb50a2-114e-470f-9c66-6bc3ef7ce33a admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:30.313666 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb50a2-114e-470f-9c66-6bc3ef7ce33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:30.315264 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb50a2-114e-470f-9c66-6bc3ef7ce33a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:30.326146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1017/1998] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:30.327994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef8be0-4e46-48d5-a7eb-81a47560f01a None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:30.327994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef8be0-4e46-48d5-a7eb-81a47560f01a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:30.328174 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef8be0-4e46-48d5-a7eb-81a47560f01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:30.360174 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-56ef8be0-4e46-48d5-a7eb-81a47560f01a None None] MFA Rules not processed for user `df4a36376fec4bafb822f1ad3b3ee6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:30.361457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-56ef8be0-4e46-48d5-a7eb-81a47560f01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:30.420935 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 982/1999] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:30 2022] POST /identity/v3/projects => generated 375 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:30.421197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285f77-68e0-467a-a591-46a0dd17ade5 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:30.462556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1018/2000] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:30.474442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef8be0-4e46-48d5-a7eb-81a47560f01a None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:30.485965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef8be0-4e46-48d5-a7eb-81a47560f01a None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:30.519428 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d285f77-68e0-467a-a591-46a0dd17ade5 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:30.526103 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15c657-9b12-4967-adff-0888d0559495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:30.526812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15c657-9b12-4967-adff-0888d0559495 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:30.527633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15c657-9b12-4967-adff-0888d0559495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:30.528029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15c657-9b12-4967-adff-0888d0559495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:30.528759 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15c657-9b12-4967-adff-0888d0559495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:30.530746 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15c657-9b12-4967-adff-0888d0559495 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:30.542521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 983/2001] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:30.543392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15c657-9b12-4967-adff-0888d0559495 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:30.554045 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15c657-9b12-4967-adff-0888d0559495 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:30.554762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea76032-7b24-49ca-b2d3-44756b22182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:30.555519 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea76032-7b24-49ca-b2d3-44756b22182c admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:30.555894 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea76032-7b24-49ca-b2d3-44756b22182c admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:30.556256 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea76032-7b24-49ca-b2d3-44756b22182c admin admin] PATH_INFO: `/v3/projects/334fe19f8a1b46dca033b7b6d7096462/users/740253eacb4a4a85940a8fb117b407b7/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:30.559232 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea76032-7b24-49ca-b2d3-44756b22182c admin admin] RBAC: Authorizing `identity:create_grant(project_id=334fe19f8a1b46dca033b7b6d7096462, user_id=740253eacb4a4a85940a8fb117b407b7, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:30.560390 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a234ef-37c7-4440-ad77-18ce4f8808bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:30.561121 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a234ef-37c7-4440-ad77-18ce4f8808bc admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:30.561473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a234ef-37c7-4440-ad77-18ce4f8808bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:30.561813 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a234ef-37c7-4440-ad77-18ce4f8808bc admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:30.563078 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a234ef-37c7-4440-ad77-18ce4f8808bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:30.564600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a234ef-37c7-4440-ad77-18ce4f8808bc admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:30.573479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea76032-7b24-49ca-b2d3-44756b22182c admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:30.578940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:30.587530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1019/2002] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:30 2022] PUT /identity/v3/projects/334fe19f8a1b46dca033b7b6d7096462/users/740253eacb4a4a85940a8fb117b407b7/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:30.589003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea76032-7b24-49ca-b2d3-44756b22182c admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:30.599827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fea76032-7b24-49ca-b2d3-44756b22182c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:30.693450 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 984/2003] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:30 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:30.694181 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a234ef-37c7-4440-ad77-18ce4f8808bc admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:30.698219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea76032-7b24-49ca-b2d3-44756b22182c admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:30.705106 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a234ef-37c7-4440-ad77-18ce4f8808bc admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:30.706677 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c71a3-6586-457d-bd1d-8107ac770c86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:30.708412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c71a3-6586-457d-bd1d-8107ac770c86 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:30.709643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c71a3-6586-457d-bd1d-8107ac770c86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:30.710736 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c71a3-6586-457d-bd1d-8107ac770c86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:30.718204 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3e9c71a3-6586-457d-bd1d-8107ac770c86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:30.792100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e8173-e012-4ecb-b28a-151f5f798fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:30.793586 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e8173-e012-4ecb-b28a-151f5f798fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:30.794074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e8173-e012-4ecb-b28a-151f5f798fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:30.794646 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e8173-e012-4ecb-b28a-151f5f798fa7 admin admin] PATH_INFO: `/v3/projects/edcdfc598ffd4c13826d62a16cc0c7a4/users/aa81e6133a874c30b5bc49236c76ce9c/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:30.837768 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e8173-e012-4ecb-b28a-151f5f798fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edcdfc598ffd4c13826d62a16cc0c7a4, user_id=aa81e6133a874c30b5bc49236c76ce9c, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:30.841357 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e8173-e012-4ecb-b28a-151f5f798fa7 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:30.857230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c71a3-6586-457d-bd1d-8107ac770c86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:30.858824 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c71a3-6586-457d-bd1d-8107ac770c86 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:30.871220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1020/2004] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:30.872398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65077f-0fb1-4e68-a4f0-cfa0e75bc984 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:30.872687 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65077f-0fb1-4e68-a4f0-cfa0e75bc984 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:30.872974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65077f-0fb1-4e68-a4f0-cfa0e75bc984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:30.917484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-3a65077f-0fb1-4e68-a4f0-cfa0e75bc984 None None] MFA Rules not processed for user `740253eacb4a4a85940a8fb117b407b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:30.918667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3a65077f-0fb1-4e68-a4f0-cfa0e75bc984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:30.973033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 985/2005] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:30 2022] PUT /identity/v3/projects/edcdfc598ffd4c13826d62a16cc0c7a4/users/aa81e6133a874c30b5bc49236c76ce9c/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:30.973033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e8173-e012-4ecb-b28a-151f5f798fa7 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:31.027727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1021/2006] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:31.028886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac48fbe-4b78-454d-aa10-48aaeb33852c None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:31.029177 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac48fbe-4b78-454d-aa10-48aaeb33852c None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:31.029456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac48fbe-4b78-454d-aa10-48aaeb33852c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:31.096179 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1ac48fbe-4b78-454d-aa10-48aaeb33852c None None] MFA Rules not processed for user `aa81e6133a874c30b5bc49236c76ce9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:31.096179 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1ac48fbe-4b78-454d-aa10-48aaeb33852c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:31.106857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e8173-e012-4ecb-b28a-151f5f798fa7 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:31.120124 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce3ab6-176e-4383-8743-a0da0e974d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:31.120925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce3ab6-176e-4383-8743-a0da0e974d4f admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:31.121205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce3ab6-176e-4383-8743-a0da0e974d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:31.121477 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce3ab6-176e-4383-8743-a0da0e974d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:31.125394 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce3ab6-176e-4383-8743-a0da0e974d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:31.131021 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce3ab6-176e-4383-8743-a0da0e974d4f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:31.153395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 986/2007] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:31.154427 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce3ab6-176e-4383-8743-a0da0e974d4f admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:31.231414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1022/2008] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:31.232366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac48fbe-4b78-454d-aa10-48aaeb33852c None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:31.242907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce3ab6-176e-4383-8743-a0da0e974d4f admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:31.246686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac48fbe-4b78-454d-aa10-48aaeb33852c None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:31.247209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fc97c-8d9f-4b29-8a93-1e041612c8ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:31.253954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fc97c-8d9f-4b29-8a93-1e041612c8ab service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:31.253954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fc97c-8d9f-4b29-8a93-1e041612c8ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:31.253954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fc97c-8d9f-4b29-8a93-1e041612c8ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:31.254651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289eb851-1b1b-4809-8d42-d4df648fb910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:31.254651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289eb851-1b1b-4809-8d42-d4df648fb910 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:31.254651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289eb851-1b1b-4809-8d42-d4df648fb910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:31.254651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289eb851-1b1b-4809-8d42-d4df648fb910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:31.254960 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289eb851-1b1b-4809-8d42-d4df648fb910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:31.255812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289eb851-1b1b-4809-8d42-d4df648fb910 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:31.267240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1023/2009] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:31.268192 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289eb851-1b1b-4809-8d42-d4df648fb910 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:31.280100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289eb851-1b1b-4809-8d42-d4df648fb910 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:31.285522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848e15a-8538-4b88-83ab-6ad59d8091f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:31.286139 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848e15a-8538-4b88-83ab-6ad59d8091f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:31.286449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848e15a-8538-4b88-83ab-6ad59d8091f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:31.286902 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848e15a-8538-4b88-83ab-6ad59d8091f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:31.287529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848e15a-8538-4b88-83ab-6ad59d8091f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:31.289468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848e15a-8538-4b88-83ab-6ad59d8091f0 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:31.317148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fc97c-8d9f-4b29-8a93-1e041612c8ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:31.318718 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fc97c-8d9f-4b29-8a93-1e041612c8ab service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:31.330435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 987/2010] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:31.331459 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fc97c-8d9f-4b29-8a93-1e041612c8ab service cinder] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:31.350790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fc97c-8d9f-4b29-8a93-1e041612c8ab service cinder] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:31.356955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09754b-d027-4647-9982-218252122032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:31.357655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09754b-d027-4647-9982-218252122032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:31.357935 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09754b-d027-4647-9982-218252122032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:31.358208 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09754b-d027-4647-9982-218252122032 admin admin] PATH_INFO: `/v3/projects/67e2353460f7496d93788aee15197f17/users/9c5355757da84e56b37c5cd381dde7ee/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:31.374126 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09754b-d027-4647-9982-218252122032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e2353460f7496d93788aee15197f17, user_id=9c5355757da84e56b37c5cd381dde7ee, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:31.377272 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09754b-d027-4647-9982-218252122032 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:31.454979 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1024/2011] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:31 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:31.459439 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848e15a-8538-4b88-83ab-6ad59d8091f0 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:31.527781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 988/2012] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:31 2022] PUT /identity/v3/projects/67e2353460f7496d93788aee15197f17/users/9c5355757da84e56b37c5cd381dde7ee/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:31.534166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848e15a-8538-4b88-83ab-6ad59d8091f0 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:31.538564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4c3b2-bc39-4acc-9ddf-d864db757678 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:31.538854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4c3b2-bc39-4acc-9ddf-d864db757678 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:31.539130 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4c3b2-bc39-4acc-9ddf-d864db757678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:31.625901 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-edd4c3b2-bc39-4acc-9ddf-d864db757678 None None] MFA Rules not processed for user `9c5355757da84e56b37c5cd381dde7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:31.627620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-edd4c3b2-bc39-4acc-9ddf-d864db757678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:31.653839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704bb30-32a2-4035-81ea-1484b1970b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:31.654586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704bb30-32a2-4035-81ea-1484b1970b1d admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:31.655235 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704bb30-32a2-4035-81ea-1484b1970b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:31.655516 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704bb30-32a2-4035-81ea-1484b1970b1d admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:31.656194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704bb30-32a2-4035-81ea-1484b1970b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:31.659710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704bb30-32a2-4035-81ea-1484b1970b1d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:31.711283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 989/2013] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:07:31.733467 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4c3b2-bc39-4acc-9ddf-d864db757678 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:31.740539 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-edd4c3b2-bc39-4acc-9ddf-d864db757678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:31.864772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1025/2014] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:31 2022] POST /identity/v3/users => generated 288 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:07:31.870908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704bb30-32a2-4035-81ea-1484b1970b1d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:31.949207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4c3b2-bc39-4acc-9ddf-d864db757678 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:31.955020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b530233-016e-4b46-a046-609bda4e21f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f750815038d404d9d39a68bf62db8c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:31.955654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b530233-016e-4b46-a046-609bda4e21f0 service glance] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:31.955971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b530233-016e-4b46-a046-609bda4e21f0 service glance] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:31.956249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b530233-016e-4b46-a046-609bda4e21f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:31.967131 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b530233-016e-4b46-a046-609bda4e21f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:31.968642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b530233-016e-4b46-a046-609bda4e21f0 service glance] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:31.980533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 990/2015] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:31.981461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b530233-016e-4b46-a046-609bda4e21f0 service glance] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:32.006521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b530233-016e-4b46-a046-609bda4e21f0 service glance] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:32.015617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cad0ca-396d-4247-b27a-a4b486a3f593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:32.015617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cad0ca-396d-4247-b27a-a4b486a3f593 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:32.020004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cad0ca-396d-4247-b27a-a4b486a3f593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:32.020004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cad0ca-396d-4247-b27a-a4b486a3f593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:32.020004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cad0ca-396d-4247-b27a-a4b486a3f593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:32.020642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cad0ca-396d-4247-b27a-a4b486a3f593 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:32.030327 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704bb30-32a2-4035-81ea-1484b1970b1d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:32.033840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 991/2016] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:32.035334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde4a5e-828a-457b-a88a-095ba0ffc8a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:32.036077 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde4a5e-828a-457b-a88a-095ba0ffc8a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:32.036360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde4a5e-828a-457b-a88a-095ba0ffc8a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:32.036633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde4a5e-828a-457b-a88a-095ba0ffc8a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:32.038010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cad0ca-396d-4247-b27a-a4b486a3f593 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:32.038485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-7cde4a5e-828a-457b-a88a-095ba0ffc8a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:32.052321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cad0ca-396d-4247-b27a-a4b486a3f593 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:32.059402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c929e-b23e-472c-8468-8fb3a9e243a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:32.060311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c929e-b23e-472c-8468-8fb3a9e243a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:32.060573 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c929e-b23e-472c-8468-8fb3a9e243a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:32.061262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c929e-b23e-472c-8468-8fb3a9e243a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:32.063399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c929e-b23e-472c-8468-8fb3a9e243a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:32.064544 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c929e-b23e-472c-8468-8fb3a9e243a4 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:32.083178 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 992/2017] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:32.089509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c929e-b23e-472c-8468-8fb3a9e243a4 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:32.102962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c929e-b23e-472c-8468-8fb3a9e243a4 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:32.111593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c5dbb-801c-4972-86de-6cd3a2e62a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:32.112697 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c5dbb-801c-4972-86de-6cd3a2e62a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:32.113045 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c5dbb-801c-4972-86de-6cd3a2e62a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:32.113389 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c5dbb-801c-4972-86de-6cd3a2e62a18 admin admin] PATH_INFO: `/v3/projects/4f6c8ba25c8545e2866e671950b1df54/users/7a125a035bba446781529f7e2e831d2b/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:32.122073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde4a5e-828a-457b-a88a-095ba0ffc8a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:32.132813 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde4a5e-828a-457b-a88a-095ba0ffc8a8 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:32.144114 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c5dbb-801c-4972-86de-6cd3a2e62a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6c8ba25c8545e2866e671950b1df54, user_id=7a125a035bba446781529f7e2e831d2b, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:32.147154 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1026/2018] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:32.147311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c5dbb-801c-4972-86de-6cd3a2e62a18 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:32.316821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 993/2019] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:32 2022] PUT /identity/v3/projects/4f6c8ba25c8545e2866e671950b1df54/users/7a125a035bba446781529f7e2e831d2b/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:32.332050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306d6c8-c896-4bc9-ba4b-e62a3ab39d63 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:32.332349 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306d6c8-c896-4bc9-ba4b-e62a3ab39d63 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:32.332597 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306d6c8-c896-4bc9-ba4b-e62a3ab39d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:32.392007 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-9306d6c8-c896-4bc9-ba4b-e62a3ab39d63 None None] MFA Rules not processed for user `7a125a035bba446781529f7e2e831d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:32.393146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-9306d6c8-c896-4bc9-ba4b-e62a3ab39d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:32.513548 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1027/2020] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:32.518391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c5dbb-801c-4972-86de-6cd3a2e62a18 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:32.644110 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c5dbb-801c-4972-86de-6cd3a2e62a18 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:32.649936 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30873af-e6cf-4851-b03e-2dc26128b659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:32.650797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30873af-e6cf-4851-b03e-2dc26128b659 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:32.651079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30873af-e6cf-4851-b03e-2dc26128b659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:32.651353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30873af-e6cf-4851-b03e-2dc26128b659 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:32.652058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30873af-e6cf-4851-b03e-2dc26128b659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:32.657598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30873af-e6cf-4851-b03e-2dc26128b659 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:32.855001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 994/2021] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:32 2022] POST /identity/v3/projects => generated 375 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:07:32.859402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306d6c8-c896-4bc9-ba4b-e62a3ab39d63 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:32.872789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306d6c8-c896-4bc9-ba4b-e62a3ab39d63 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:32.950433 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ec381-0675-422c-904d-d720dd1097c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:32.950954 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ec381-0675-422c-904d-d720dd1097c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:32.951245 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ec381-0675-422c-904d-d720dd1097c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:32.951574 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ec381-0675-422c-904d-d720dd1097c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:32.952391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ec381-0675-422c-904d-d720dd1097c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:32.955031 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ec381-0675-422c-904d-d720dd1097c9 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:33.087636 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30873af-e6cf-4851-b03e-2dc26128b659 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:33.088726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1028/2022] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:32 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:33.099714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30873af-e6cf-4851-b03e-2dc26128b659 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:33.106454 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea905ac8-4f59-4d01-8cff-efa26281112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:33.107432 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea905ac8-4f59-4d01-8cff-efa26281112d admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:33.108022 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea905ac8-4f59-4d01-8cff-efa26281112d admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:33.108453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea905ac8-4f59-4d01-8cff-efa26281112d admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:33.109360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea905ac8-4f59-4d01-8cff-efa26281112d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:33.111173 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea905ac8-4f59-4d01-8cff-efa26281112d admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:33.126686 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 995/2023] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:07:33.131094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ec381-0675-422c-904d-d720dd1097c9 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:33.141645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ec381-0675-422c-904d-d720dd1097c9 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:33.147186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46883ed0-266a-4488-945a-000d3158b597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:33.147736 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46883ed0-266a-4488-945a-000d3158b597 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:33.148077 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46883ed0-266a-4488-945a-000d3158b597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:33.148409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46883ed0-266a-4488-945a-000d3158b597 admin admin] PATH_INFO: `/v3/projects/4015064ba3014abcae87d70771baf20c/users/d3cf93752f1241e0847ab065abaf0d55/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:33.173077 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46883ed0-266a-4488-945a-000d3158b597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4015064ba3014abcae87d70771baf20c, user_id=d3cf93752f1241e0847ab065abaf0d55, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:33.175982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46883ed0-266a-4488-945a-000d3158b597 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:33.311248 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:33.325114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1029/2024] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:33 2022] PUT /identity/v3/projects/4015064ba3014abcae87d70771baf20c/users/d3cf93752f1241e0847ab065abaf0d55/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:33.330130 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea905ac8-4f59-4d01-8cff-efa26281112d admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:33.343914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea905ac8-4f59-4d01-8cff-efa26281112d admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:33.419935 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b4eca-0a4b-44ba-abdc-753f0636ba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:33.420704 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b4eca-0a4b-44ba-abdc-753f0636ba9b admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:33.420867 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b4eca-0a4b-44ba-abdc-753f0636ba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:33.421135 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b4eca-0a4b-44ba-abdc-753f0636ba9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:33.421977 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b4eca-0a4b-44ba-abdc-753f0636ba9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:33.423583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b4eca-0a4b-44ba-abdc-753f0636ba9b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:33.438523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 996/2025] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:33.440975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46883ed0-266a-4488-945a-000d3158b597 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:33.453015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46883ed0-266a-4488-945a-000d3158b597 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:33.459564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843780da-2896-4133-b242-74a4abb08786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:33.460279 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843780da-2896-4133-b242-74a4abb08786 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:33.460559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843780da-2896-4133-b242-74a4abb08786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:33.461195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843780da-2896-4133-b242-74a4abb08786 admin admin] PATH_INFO: `/v3/projects/4015064ba3014abcae87d70771baf20c/users/d3cf93752f1241e0847ab065abaf0d55/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:33.463946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843780da-2896-4133-b242-74a4abb08786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4015064ba3014abcae87d70771baf20c, user_id=d3cf93752f1241e0847ab065abaf0d55, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:33.466759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843780da-2896-4133-b242-74a4abb08786 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:33.481702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1030/2026] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:33 2022] PUT /identity/v3/projects/4015064ba3014abcae87d70771baf20c/users/d3cf93752f1241e0847ab065abaf0d55/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:33.491936 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc1550-8035-4bb3-bcbc-0cf5826bc614 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:33.492228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc1550-8035-4bb3-bcbc-0cf5826bc614 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:33.492506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc1550-8035-4bb3-bcbc-0cf5826bc614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:33.522523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-fbcc1550-8035-4bb3-bcbc-0cf5826bc614 None None] MFA Rules not processed for user `d3cf93752f1241e0847ab065abaf0d55`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:33.523745 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-fbcc1550-8035-4bb3-bcbc-0cf5826bc614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:33.609457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 997/2027] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:33.621293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843780da-2896-4133-b242-74a4abb08786 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:33.677484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843780da-2896-4133-b242-74a4abb08786 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:33.681563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:33.684003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbe029-29ae-44e2-bf73-fd3b1cb9421a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:33.684306 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbe029-29ae-44e2-bf73-fd3b1cb9421a service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:33.684595 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbe029-29ae-44e2-bf73-fd3b1cb9421a service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:33.685078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbe029-29ae-44e2-bf73-fd3b1cb9421a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:33.747752 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbe029-29ae-44e2-bf73-fd3b1cb9421a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:33.749564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbe029-29ae-44e2-bf73-fd3b1cb9421a service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:33.760313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1031/2028] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:35.989452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:36.795353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:36.877708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc1550-8035-4bb3-bcbc-0cf5826bc614 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:36.879459 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-fbcc1550-8035-4bb3-bcbc-0cf5826bc614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:36.894119 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc1550-8035-4bb3-bcbc-0cf5826bc614 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:36.898450 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1578b65-25f2-40f2-9bde-cccfb06ee274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:36.899303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1578b65-25f2-40f2-9bde-cccfb06ee274 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:36.899430 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1578b65-25f2-40f2-9bde-cccfb06ee274 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:36.899647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1578b65-25f2-40f2-9bde-cccfb06ee274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:36.989465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1578b65-25f2-40f2-9bde-cccfb06ee274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:36.990942 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1578b65-25f2-40f2-9bde-cccfb06ee274 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:37.001204 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 998/2029] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:39.030485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:39.178814 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbe029-29ae-44e2-bf73-fd3b1cb9421a service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:39.187937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbe029-29ae-44e2-bf73-fd3b1cb9421a service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:39.191615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca5556-1049-4310-90e2-1b6976c3934c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:39.192325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca5556-1049-4310-90e2-1b6976c3934c service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:39.192610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca5556-1049-4310-90e2-1b6976c3934c service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:39.192892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca5556-1049-4310-90e2-1b6976c3934c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:39.202713 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca5556-1049-4310-90e2-1b6976c3934c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:39.204241 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca5556-1049-4310-90e2-1b6976c3934c service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:39.215366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1032/2030] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:39.835390 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:41.356155 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1578b65-25f2-40f2-9bde-cccfb06ee274 service cinder] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:41.367391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1578b65-25f2-40f2-9bde-cccfb06ee274 service cinder] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:41.372551 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8890e-25e3-4717-a3f9-9b3954187fdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:41.373309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8890e-25e3-4717-a3f9-9b3954187fdf service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:41.373684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8890e-25e3-4717-a3f9-9b3954187fdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:41.374074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8890e-25e3-4717-a3f9-9b3954187fdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:41.446280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8890e-25e3-4717-a3f9-9b3954187fdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:41.448363 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8890e-25e3-4717-a3f9-9b3954187fdf service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:41.461888 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 999/2031] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:42.328402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:42.561695 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:42.765315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca5556-1049-4310-90e2-1b6976c3934c service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:42.834549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca5556-1049-4310-90e2-1b6976c3934c service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:42.839616 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f5bc3-895c-455e-b9f3-dc93d2b8c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:42.840288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f5bc3-895c-455e-b9f3-dc93d2b8c89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:42.840577 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f5bc3-895c-455e-b9f3-dc93d2b8c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:42.840857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f5bc3-895c-455e-b9f3-dc93d2b8c89a admin admin] PATH_INFO: `/v3/users/7b7a91f3ec134108bdac02ac7c0cecc2` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:42.841987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f5bc3-895c-455e-b9f3-dc93d2b8c89a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7a91f3ec134108bdac02ac7c0cecc2)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:42.843958 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f5bc3-895c-455e-b9f3-dc93d2b8c89a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:43.112238 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fd8f5bc3-895c-455e-b9f3-dc93d2b8c89a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7a91f3ec134108bdac02ac7c0cecc2'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:43.124882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fd8f5bc3-895c-455e-b9f3-dc93d2b8c89a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7a91f3ec134108bdac02ac7c0cecc2'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:43.269437 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fd8f5bc3-895c-455e-b9f3-dc93d2b8c89a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7a91f3ec134108bdac02ac7c0cecc2'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:43.277441 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fd8f5bc3-895c-455e-b9f3-dc93d2b8c89a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7a91f3ec134108bdac02ac7c0cecc2'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:43.278185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fd8f5bc3-895c-455e-b9f3-dc93d2b8c89a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7a91f3ec134108bdac02ac7c0cecc2'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:43.284566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1033/2032] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:42 2022] DELETE /identity/v3/users/7b7a91f3ec134108bdac02ac7c0cecc2 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:43.289220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9bfcc-9fdd-4009-aa71-240983e8c6b1 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:43.289745 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9bfcc-9fdd-4009-aa71-240983e8c6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:43.289962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9bfcc-9fdd-4009-aa71-240983e8c6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:43.314716 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b5f9bfcc-9fdd-4009-aa71-240983e8c6b1 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:43.316064 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b5f9bfcc-9fdd-4009-aa71-240983e8c6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:43.381642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1000/2033] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:43.391693 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f5bc3-895c-455e-b9f3-dc93d2b8c89a admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:43.393272 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fd8f5bc3-895c-455e-b9f3-dc93d2b8c89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:43.454553 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f5bc3-895c-455e-b9f3-dc93d2b8c89a admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:43.459061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b224cd-62bd-4477-ad1d-2e3954a86186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:43.461332 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b224cd-62bd-4477-ad1d-2e3954a86186 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:43.461332 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b224cd-62bd-4477-ad1d-2e3954a86186 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:43.461332 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b224cd-62bd-4477-ad1d-2e3954a86186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:43.471345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b224cd-62bd-4477-ad1d-2e3954a86186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:43.472974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b224cd-62bd-4477-ad1d-2e3954a86186 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:43.483408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1034/2034] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:44.146185 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9bfcc-9fdd-4009-aa71-240983e8c6b1 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:44.148418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b5f9bfcc-9fdd-4009-aa71-240983e8c6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:44.179440 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9bfcc-9fdd-4009-aa71-240983e8c6b1 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:44.184959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:44.185734 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:44.186020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:44.186319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298 admin admin] PATH_INFO: `/v3/projects/24e8511925f845b09e1d43ea8bf1ec72` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:44.187768 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e8511925f845b09e1d43ea8bf1ec72)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:44.189985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:44.427791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e8511925f845b09e1d43ea8bf1ec72', 'request_id': 'req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:44.433370 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e8511925f845b09e1d43ea8bf1ec72', 'request_id': 'req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:44.544154 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e8511925f845b09e1d43ea8bf1ec72', 'request_id': 'req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:44.563323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298 admin admin] The token cache is being invalidate because project 24e8511925f845b09e1d43ea8bf1ec72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:44.563673 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:44.564618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:44.566903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1001/2035] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:44 2022] DELETE /identity/v3/projects/24e8511925f845b09e1d43ea8bf1ec72 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:44.570905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b224cd-62bd-4477-ad1d-2e3954a86186 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:44.585082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b224cd-62bd-4477-ad1d-2e3954a86186 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:44.662744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d2b94-64eb-4921-924b-c01b86c13ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:44.664024 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2b94-64eb-4921-924b-c01b86c13ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:44.664399 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2b94-64eb-4921-924b-c01b86c13ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:44.664879 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2b94-64eb-4921-924b-c01b86c13ef1 admin admin] PATH_INFO: `/v3/users/740253eacb4a4a85940a8fb117b407b7` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:44.666354 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d2b94-64eb-4921-924b-c01b86c13ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=740253eacb4a4a85940a8fb117b407b7)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:44.669028 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d2b94-64eb-4921-924b-c01b86c13ef1 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:44.912281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6d3d2b94-64eb-4921-924b-c01b86c13ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740253eacb4a4a85940a8fb117b407b7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:44.923982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6d3d2b94-64eb-4921-924b-c01b86c13ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740253eacb4a4a85940a8fb117b407b7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:45.069756 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6d3d2b94-64eb-4921-924b-c01b86c13ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740253eacb4a4a85940a8fb117b407b7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:45.070104 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:45.080333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6d3d2b94-64eb-4921-924b-c01b86c13ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740253eacb4a4a85940a8fb117b407b7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:45.081265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6d3d2b94-64eb-4921-924b-c01b86c13ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740253eacb4a4a85940a8fb117b407b7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:45.089717 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1035/2036] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:44 2022] DELETE /identity/v3/users/740253eacb4a4a85940a8fb117b407b7 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:45.475784 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:45.713847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:45.715306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:45.729252 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ef5c4-f8e1-4b94-8886-9025cf2f5298 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:45.807438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543511a1-e6d9-471a-b1ee-0ca05c2b4f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:45.808236 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543511a1-e6d9-471a-b1ee-0ca05c2b4f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:45.808555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543511a1-e6d9-471a-b1ee-0ca05c2b4f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:45.808832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543511a1-e6d9-471a-b1ee-0ca05c2b4f64 admin admin] PATH_INFO: `/v3/users/aa81e6133a874c30b5bc49236c76ce9c` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:45.810005 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543511a1-e6d9-471a-b1ee-0ca05c2b4f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa81e6133a874c30b5bc49236c76ce9c)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:45.811993 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543511a1-e6d9-471a-b1ee-0ca05c2b4f64 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:45.979919 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d2b94-64eb-4921-924b-c01b86c13ef1 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:45.981564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6d3d2b94-64eb-4921-924b-c01b86c13ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:46.012191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d2b94-64eb-4921-924b-c01b86c13ef1 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:46.018817 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ddaa0-8b3d-4df8-aa26-714c9cc27d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:46.024804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ddaa0-8b3d-4df8-aa26-714c9cc27d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:46.024804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ddaa0-8b3d-4df8-aa26-714c9cc27d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:46.024804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ddaa0-8b3d-4df8-aa26-714c9cc27d29 admin admin] PATH_INFO: `/v3/projects/334fe19f8a1b46dca033b7b6d7096462` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:46.024804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ddaa0-8b3d-4df8-aa26-714c9cc27d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=334fe19f8a1b46dca033b7b6d7096462)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:46.024804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ddaa0-8b3d-4df8-aa26-714c9cc27d29 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:46.167572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-543511a1-e6d9-471a-b1ee-0ca05c2b4f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa81e6133a874c30b5bc49236c76ce9c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:46.172565 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-543511a1-e6d9-471a-b1ee-0ca05c2b4f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa81e6133a874c30b5bc49236c76ce9c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:46.175313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-264ddaa0-8b3d-4df8-aa26-714c9cc27d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '334fe19f8a1b46dca033b7b6d7096462', 'request_id': 'req-264ddaa0-8b3d-4df8-aa26-714c9cc27d29'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:46.187563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-543511a1-e6d9-471a-b1ee-0ca05c2b4f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa81e6133a874c30b5bc49236c76ce9c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:46.264058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-264ddaa0-8b3d-4df8-aa26-714c9cc27d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '334fe19f8a1b46dca033b7b6d7096462', 'request_id': 'req-264ddaa0-8b3d-4df8-aa26-714c9cc27d29'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:46.272232 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-264ddaa0-8b3d-4df8-aa26-714c9cc27d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '334fe19f8a1b46dca033b7b6d7096462', 'request_id': 'req-264ddaa0-8b3d-4df8-aa26-714c9cc27d29'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:46.284577 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-264ddaa0-8b3d-4df8-aa26-714c9cc27d29 admin admin] The token cache is being invalidate because project 334fe19f8a1b46dca033b7b6d7096462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:46.284885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-264ddaa0-8b3d-4df8-aa26-714c9cc27d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:46.285562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-264ddaa0-8b3d-4df8-aa26-714c9cc27d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:46.287415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1036/2037] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:45 2022] DELETE /identity/v3/projects/334fe19f8a1b46dca033b7b6d7096462 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:46.292437 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c10d27-c3c6-4652-8b9e-f2066a3f9508 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:46.292740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c10d27-c3c6-4652-8b9e-f2066a3f9508 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:46.293026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c10d27-c3c6-4652-8b9e-f2066a3f9508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:46.319499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-57c10d27-c3c6-4652-8b9e-f2066a3f9508 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:46.320797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-57c10d27-c3c6-4652-8b9e-f2066a3f9508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:46.384292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1037/2038] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:07:46.392057 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562784c7-7308-401c-8801-eee504b71e3c None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:46.392354 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562784c7-7308-401c-8801-eee504b71e3c None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:46.392712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562784c7-7308-401c-8801-eee504b71e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:46.395506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-543511a1-e6d9-471a-b1ee-0ca05c2b4f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa81e6133a874c30b5bc49236c76ce9c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:46.396507 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-543511a1-e6d9-471a-b1ee-0ca05c2b4f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa81e6133a874c30b5bc49236c76ce9c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:46.413302 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-562784c7-7308-401c-8801-eee504b71e3c None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:46.414574 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-562784c7-7308-401c-8801-eee504b71e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:46.416975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1002/2039] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:45 2022] DELETE /identity/v3/users/aa81e6133a874c30b5bc49236c76ce9c => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:46.418726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1c334-688b-44a2-906f-610196318202 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:46.419166 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1c334-688b-44a2-906f-610196318202 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:46.419510 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1c334-688b-44a2-906f-610196318202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:46.445020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b5e1c334-688b-44a2-906f-610196318202 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:46.446549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b5e1c334-688b-44a2-906f-610196318202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:46.487499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1038/2040] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:07:46.487499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562784c7-7308-401c-8801-eee504b71e3c None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:46.496339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562784c7-7308-401c-8801-eee504b71e3c None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:46.501439 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac607c-c728-4e9c-94a4-ba67ee26312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:46.505854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac607c-c728-4e9c-94a4-ba67ee26312f admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:46.505854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac607c-c728-4e9c-94a4-ba67ee26312f admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:46.505854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac607c-c728-4e9c-94a4-ba67ee26312f admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:46.505854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac607c-c728-4e9c-94a4-ba67ee26312f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:46.505854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac607c-c728-4e9c-94a4-ba67ee26312f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:46.505854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac607c-c728-4e9c-94a4-ba67ee26312f admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:46.520563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1003/2041] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:46.520764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1039/2042] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:07:46.525542 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1c334-688b-44a2-906f-610196318202 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:46.534318 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac607c-c728-4e9c-94a4-ba67ee26312f admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:46.536283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-32ac607c-c728-4e9c-94a4-ba67ee26312f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:46.537393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1c334-688b-44a2-906f-610196318202 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:46.543039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d519d2-774a-441c-953d-2afd774ee2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:46.543716 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d519d2-774a-441c-953d-2afd774ee2ee admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:46.543982 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d519d2-774a-441c-953d-2afd774ee2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:46.544258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d519d2-774a-441c-953d-2afd774ee2ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:46.544907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d519d2-774a-441c-953d-2afd774ee2ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:46.546900 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d519d2-774a-441c-953d-2afd774ee2ee admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:46.613819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac607c-c728-4e9c-94a4-ba67ee26312f admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:46.618739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb891a5-a175-48c5-ac56-dfdfcd0d8fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:46.620148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb891a5-a175-48c5-ac56-dfdfcd0d8fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:46.620599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb891a5-a175-48c5-ac56-dfdfcd0d8fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:46.620941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb891a5-a175-48c5-ac56-dfdfcd0d8fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:46.632574 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb891a5-a175-48c5-ac56-dfdfcd0d8fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:46.634297 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb891a5-a175-48c5-ac56-dfdfcd0d8fb9 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:46.646077 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1040/2043] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:46.661024 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1004/2044] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:46 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:46.666376 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb891a5-a175-48c5-ac56-dfdfcd0d8fb9 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:46.676973 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb891a5-a175-48c5-ac56-dfdfcd0d8fb9 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:46.745455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94d42f-3a27-4a88-8bed-ded3bddfcce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:46.746105 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94d42f-3a27-4a88-8bed-ded3bddfcce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:46.746394 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94d42f-3a27-4a88-8bed-ded3bddfcce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:46.746669 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94d42f-3a27-4a88-8bed-ded3bddfcce3 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:46.747345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94d42f-3a27-4a88-8bed-ded3bddfcce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:46.750176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94d42f-3a27-4a88-8bed-ded3bddfcce3 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:46.902543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1041/2045] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:46 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:46.904024 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d519d2-774a-441c-953d-2afd774ee2ee admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:46.914644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d519d2-774a-441c-953d-2afd774ee2ee admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:46.920118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af7b28-c244-4efe-94ab-6fbc99cd52a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:46.920731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af7b28-c244-4efe-94ab-6fbc99cd52a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:46.921283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af7b28-c244-4efe-94ab-6fbc99cd52a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:46.921561 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af7b28-c244-4efe-94ab-6fbc99cd52a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:46.922196 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af7b28-c244-4efe-94ab-6fbc99cd52a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:46.923787 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af7b28-c244-4efe-94ab-6fbc99cd52a8 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:46.937929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1005/2046] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:07:46.942689 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94d42f-3a27-4a88-8bed-ded3bddfcce3 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:46.946401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa8666-c3f1-4800-a047-8af92593c407 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:46.946692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa8666-c3f1-4800-a047-8af92593c407 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:46.946965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa8666-c3f1-4800-a047-8af92593c407 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:46.949163 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1006/2047] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 14:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 14:07:46.950984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94d42f-3a27-4a88-8bed-ded3bddfcce3 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:46.956230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c60015-0ca0-481a-a240-64973c3c0c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:46.956843 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c60015-0ca0-481a-a240-64973c3c0c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:46.957131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c60015-0ca0-481a-a240-64973c3c0c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:46.957408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c60015-0ca0-481a-a240-64973c3c0c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:46.958063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c60015-0ca0-481a-a240-64973c3c0c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:46.959749 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c60015-0ca0-481a-a240-64973c3c0c26 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:46.979017 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1042/2048] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:46.979220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa8666-c3f1-4800-a047-8af92593c407 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:46.989133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b40f47-df23-40e4-a7e0-a2c7caae1957 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:46.989133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b40f47-df23-40e4-a7e0-a2c7caae1957 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:46.989133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b40f47-df23-40e4-a7e0-a2c7caae1957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:46.993615 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa8666-c3f1-4800-a047-8af92593c407 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:46.999695 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f6998-ef03-43f1-95a6-b5c7c76fc179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:47.000485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f6998-ef03-43f1-95a6-b5c7c76fc179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:47.000993 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f6998-ef03-43f1-95a6-b5c7c76fc179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:47.001502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f6998-ef03-43f1-95a6-b5c7c76fc179 admin admin] PATH_INFO: `/v3/projects/81e9788d951f4f57acc1f12dd51eca77/users/15928e30479e411db2af397979641041/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:47.015188 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-56b40f47-df23-40e4-a7e0-a2c7caae1957 None None] MFA Rules not processed for user `cec4f437077c41039cae3d505b43b558`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:47.017283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-56b40f47-df23-40e4-a7e0-a2c7caae1957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:47.018402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f6998-ef03-43f1-95a6-b5c7c76fc179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e9788d951f4f57acc1f12dd51eca77, user_id=15928e30479e411db2af397979641041, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:47.024117 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f6998-ef03-43f1-95a6-b5c7c76fc179 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:47.090684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1043/2049] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:47.101372 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b40f47-df23-40e4-a7e0-a2c7caae1957 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:47.102701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-56b40f47-df23-40e4-a7e0-a2c7caae1957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:47.116583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b40f47-df23-40e4-a7e0-a2c7caae1957 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:47.122710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d6007-1353-4cfe-a76d-d91ad6ea25f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec4f437077c41039cae3d505b43b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:47.137528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d6007-1353-4cfe-a76d-d91ad6ea25f3 service placement] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:47.137528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d6007-1353-4cfe-a76d-d91ad6ea25f3 service placement] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:47.137528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d6007-1353-4cfe-a76d-d91ad6ea25f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:47.137528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d6007-1353-4cfe-a76d-d91ad6ea25f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:47.137528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d6007-1353-4cfe-a76d-d91ad6ea25f3 service placement] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:47.144641 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1044/2050] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:47.181579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1007/2051] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:46 2022] PUT /identity/v3/projects/81e9788d951f4f57acc1f12dd51eca77/users/15928e30479e411db2af397979641041/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:07:47.186832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6a8d8-4246-4608-b33e-c1a3d7dbf082 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:47.187148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6a8d8-4246-4608-b33e-c1a3d7dbf082 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:47.187430 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6a8d8-4246-4608-b33e-c1a3d7dbf082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:47.216023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-45c6a8d8-4246-4608-b33e-c1a3d7dbf082 None None] MFA Rules not processed for user `15928e30479e411db2af397979641041`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:47.217253 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-45c6a8d8-4246-4608-b33e-c1a3d7dbf082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:47.279305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f6998-ef03-43f1-95a6-b5c7c76fc179 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:47.290958 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-184f6998-ef03-43f1-95a6-b5c7c76fc179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:47.296314 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1045/2052] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:47.296834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6a8d8-4246-4608-b33e-c1a3d7dbf082 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:47.372386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f6998-ef03-43f1-95a6-b5c7c76fc179 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:47.377586 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b74d85-a7b3-4822-9fed-e48082f2774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:47.378576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b74d85-a7b3-4822-9fed-e48082f2774f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:47.378576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b74d85-a7b3-4822-9fed-e48082f2774f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:47.378791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b74d85-a7b3-4822-9fed-e48082f2774f admin admin] PATH_INFO: `/v3/users/6e998aa9209342ad8cd504c440273c3b` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:47.379935 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b74d85-a7b3-4822-9fed-e48082f2774f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e998aa9209342ad8cd504c440273c3b)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:47.380506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6a8d8-4246-4608-b33e-c1a3d7dbf082 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:47.381878 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b74d85-a7b3-4822-9fed-e48082f2774f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:47.385505 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c20b50-fa07-4f20-893a-122e7b5da31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:47.385991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c20b50-fa07-4f20-893a-122e7b5da31e admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:47.386322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c20b50-fa07-4f20-893a-122e7b5da31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:47.386672 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c20b50-fa07-4f20-893a-122e7b5da31e admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:47.387887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c20b50-fa07-4f20-893a-122e7b5da31e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:47.389533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c20b50-fa07-4f20-893a-122e7b5da31e admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:47.608725 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1046/2053] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:47 2022] POST /identity/v3/projects => generated 381 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:47.608725 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c20b50-fa07-4f20-893a-122e7b5da31e admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:47.608725 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-13c20b50-fa07-4f20-893a-122e7b5da31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:47.678280 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c20b50-fa07-4f20-893a-122e7b5da31e admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:47.682636 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-a1b74d85-a7b3-4822-9fed-e48082f2774f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e998aa9209342ad8cd504c440273c3b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:47.683352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-a1b74d85-a7b3-4822-9fed-e48082f2774f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e998aa9209342ad8cd504c440273c3b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:47.683950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4be105-2357-4064-9f9b-7a9c97da4581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:47.686515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be105-2357-4064-9f9b-7a9c97da4581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:47.687475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be105-2357-4064-9f9b-7a9c97da4581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:47.688265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be105-2357-4064-9f9b-7a9c97da4581 admin admin] PATH_INFO: `/v3/projects/edcdfc598ffd4c13826d62a16cc0c7a4` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:47.690188 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4be105-2357-4064-9f9b-7a9c97da4581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edcdfc598ffd4c13826d62a16cc0c7a4)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:47.692271 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4be105-2357-4064-9f9b-7a9c97da4581 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:47.696865 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-a1b74d85-a7b3-4822-9fed-e48082f2774f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e998aa9209342ad8cd504c440273c3b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:47.785252 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-a1b74d85-a7b3-4822-9fed-e48082f2774f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e998aa9209342ad8cd504c440273c3b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:47.785830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-a1b74d85-a7b3-4822-9fed-e48082f2774f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e998aa9209342ad8cd504c440273c3b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:47.798969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1008/2054] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:47 2022] DELETE /identity/v3/users/6e998aa9209342ad8cd504c440273c3b => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:07:47.799741 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b74d85-a7b3-4822-9fed-e48082f2774f admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:47.801140 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a1b74d85-a7b3-4822-9fed-e48082f2774f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:47.874372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b74d85-a7b3-4822-9fed-e48082f2774f admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:47.880423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da5fee-f193-42f2-8b1d-41cb3667e311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:47.881100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da5fee-f193-42f2-8b1d-41cb3667e311 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:47.881379 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da5fee-f193-42f2-8b1d-41cb3667e311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:47.881647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da5fee-f193-42f2-8b1d-41cb3667e311 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:47.882286 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da5fee-f193-42f2-8b1d-41cb3667e311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:47.884274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da5fee-f193-42f2-8b1d-41cb3667e311 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:47.928176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fa4be105-2357-4064-9f9b-7a9c97da4581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edcdfc598ffd4c13826d62a16cc0c7a4', 'request_id': 'req-fa4be105-2357-4064-9f9b-7a9c97da4581'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:48.036322 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1009/2055] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:47 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:48.040393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da5fee-f193-42f2-8b1d-41cb3667e311 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:48.050784 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da5fee-f193-42f2-8b1d-41cb3667e311 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:48.064212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fa4be105-2357-4064-9f9b-7a9c97da4581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edcdfc598ffd4c13826d62a16cc0c7a4', 'request_id': 'req-fa4be105-2357-4064-9f9b-7a9c97da4581'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:48.072866 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fa4be105-2357-4064-9f9b-7a9c97da4581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edcdfc598ffd4c13826d62a16cc0c7a4', 'request_id': 'req-fa4be105-2357-4064-9f9b-7a9c97da4581'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:48.094282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fa4be105-2357-4064-9f9b-7a9c97da4581 admin admin] The token cache is being invalidate because project edcdfc598ffd4c13826d62a16cc0c7a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:48.094592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fa4be105-2357-4064-9f9b-7a9c97da4581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:48.095225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fa4be105-2357-4064-9f9b-7a9c97da4581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:48.100206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1047/2056] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:47 2022] DELETE /identity/v3/projects/edcdfc598ffd4c13826d62a16cc0c7a4 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:48.101104 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4be105-2357-4064-9f9b-7a9c97da4581 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:48.102594 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fa4be105-2357-4064-9f9b-7a9c97da4581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:48.115701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3debe-5a54-46c3-94a0-ca47ceb7870a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:48.116354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3debe-5a54-46c3-94a0-ca47ceb7870a admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:48.116636 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3debe-5a54-46c3-94a0-ca47ceb7870a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:48.116909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3debe-5a54-46c3-94a0-ca47ceb7870a admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:48.117551 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3debe-5a54-46c3-94a0-ca47ceb7870a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:48.119169 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3debe-5a54-46c3-94a0-ca47ceb7870a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:48.129411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1010/2057] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:07:48.133029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3debe-5a54-46c3-94a0-ca47ceb7870a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:48.135394 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1ed3debe-5a54-46c3-94a0-ca47ceb7870a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:48.147984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3debe-5a54-46c3-94a0-ca47ceb7870a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:48.156678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4596826-6d22-4ca2-b137-e2741474ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:48.157332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4596826-6d22-4ca2-b137-e2741474ba4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:48.157614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4596826-6d22-4ca2-b137-e2741474ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:48.157892 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4596826-6d22-4ca2-b137-e2741474ba4f admin admin] PATH_INFO: `/v3/users/7a125a035bba446781529f7e2e831d2b` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:48.159056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4596826-6d22-4ca2-b137-e2741474ba4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a125a035bba446781529f7e2e831d2b)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:48.161039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4596826-6d22-4ca2-b137-e2741474ba4f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:48.170992 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4be105-2357-4064-9f9b-7a9c97da4581 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:48.182196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf4096-cd01-49f9-9124-0c83fdc75921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:48.182831 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf4096-cd01-49f9-9124-0c83fdc75921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:48.183110 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf4096-cd01-49f9-9124-0c83fdc75921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:48.183381 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf4096-cd01-49f9-9124-0c83fdc75921 admin admin] PATH_INFO: `/v3/projects/5e805ffe19644a489c6a406729062b24` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:48.184638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf4096-cd01-49f9-9124-0c83fdc75921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e805ffe19644a489c6a406729062b24)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:48.186621 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf4096-cd01-49f9-9124-0c83fdc75921 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:48.498154 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-93bf4096-cd01-49f9-9124-0c83fdc75921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e805ffe19644a489c6a406729062b24', 'request_id': 'req-93bf4096-cd01-49f9-9124-0c83fdc75921'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:48.501860 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-a4596826-6d22-4ca2-b137-e2741474ba4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a125a035bba446781529f7e2e831d2b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:48.502991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-a4596826-6d22-4ca2-b137-e2741474ba4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a125a035bba446781529f7e2e831d2b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:48.522352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-a4596826-6d22-4ca2-b137-e2741474ba4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a125a035bba446781529f7e2e831d2b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:48.629517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-93bf4096-cd01-49f9-9124-0c83fdc75921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e805ffe19644a489c6a406729062b24', 'request_id': 'req-93bf4096-cd01-49f9-9124-0c83fdc75921'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:48.636780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-93bf4096-cd01-49f9-9124-0c83fdc75921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e805ffe19644a489c6a406729062b24', 'request_id': 'req-93bf4096-cd01-49f9-9124-0c83fdc75921'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:48.648162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-93bf4096-cd01-49f9-9124-0c83fdc75921 admin admin] The token cache is being invalidate because project 5e805ffe19644a489c6a406729062b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:48.648463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-93bf4096-cd01-49f9-9124-0c83fdc75921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:48.649141 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-93bf4096-cd01-49f9-9124-0c83fdc75921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:48.651180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1048/2058] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:48 2022] DELETE /identity/v3/projects/5e805ffe19644a489c6a406729062b24 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:48.652028 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf4096-cd01-49f9-9124-0c83fdc75921 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:48.653354 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-93bf4096-cd01-49f9-9124-0c83fdc75921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:48.686717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-a4596826-6d22-4ca2-b137-e2741474ba4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a125a035bba446781529f7e2e831d2b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:48.687644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-a4596826-6d22-4ca2-b137-e2741474ba4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a125a035bba446781529f7e2e831d2b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:48.703129 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1011/2059] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:48 2022] DELETE /identity/v3/users/7a125a035bba446781529f7e2e831d2b => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:48.704725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e82e8-e063-486f-92b4-7ec4362d241d None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:48.705423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e82e8-e063-486f-92b4-7ec4362d241d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:48.705423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e82e8-e063-486f-92b4-7ec4362d241d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:48.726831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-326e82e8-e063-486f-92b4-7ec4362d241d None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:48.728173 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-326e82e8-e063-486f-92b4-7ec4362d241d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:48.730436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf4096-cd01-49f9-9124-0c83fdc75921 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:48.760423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:48.796074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa729e-d6e2-4636-b057-aef216899c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:48.796759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa729e-d6e2-4636-b057-aef216899c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:48.797044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa729e-d6e2-4636-b057-aef216899c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:48.797309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa729e-d6e2-4636-b057-aef216899c27 admin admin] PATH_INFO: `/v3/projects/47541cf1f12249bb853a2de2edf9a75d/users/6fb8310a9e0b4b1d8f3e2e70e549e430/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:48.799688 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1012/2060] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:48.812770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1c4a7-875b-4438-a675-3b15d90eb15e None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:48.813093 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1c4a7-875b-4438-a675-3b15d90eb15e None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:48.813352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1c4a7-875b-4438-a675-3b15d90eb15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:48.814621 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa729e-d6e2-4636-b057-aef216899c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47541cf1f12249bb853a2de2edf9a75d, user_id=6fb8310a9e0b4b1d8f3e2e70e549e430, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:48.817391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa729e-d6e2-4636-b057-aef216899c27 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:48.843643 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-a5a1c4a7-875b-4438-a675-3b15d90eb15e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:48.843643 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a5a1c4a7-875b-4438-a675-3b15d90eb15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:48.850922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1013/2061] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:48.857476 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1c4a7-875b-4438-a675-3b15d90eb15e None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:48.878174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1c4a7-875b-4438-a675-3b15d90eb15e None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:48.884063 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab28bf-0cef-40fd-b704-6273adea07d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:48.884709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab28bf-0cef-40fd-b704-6273adea07d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:48.885046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab28bf-0cef-40fd-b704-6273adea07d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:48.885326 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab28bf-0cef-40fd-b704-6273adea07d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:48.885984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab28bf-0cef-40fd-b704-6273adea07d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:48.886291 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab28bf-0cef-40fd-b704-6273adea07d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:48.888082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab28bf-0cef-40fd-b704-6273adea07d9 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:48.910244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1014/2062] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:07:48.911368 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab28bf-0cef-40fd-b704-6273adea07d9 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:48.922348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab28bf-0cef-40fd-b704-6273adea07d9 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:48.927749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310c6fb-6490-4148-a6cd-e8f65f64befb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:48.928425 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310c6fb-6490-4148-a6cd-e8f65f64befb admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:48.928719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310c6fb-6490-4148-a6cd-e8f65f64befb admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:48.928996 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310c6fb-6490-4148-a6cd-e8f65f64befb admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:48.929699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310c6fb-6490-4148-a6cd-e8f65f64befb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:48.931994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310c6fb-6490-4148-a6cd-e8f65f64befb admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:48.953834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1049/2063] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:48 2022] PUT /identity/v3/projects/47541cf1f12249bb853a2de2edf9a75d/users/6fb8310a9e0b4b1d8f3e2e70e549e430/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:48.957788 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa729e-d6e2-4636-b057-aef216899c27 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:48.959460 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-52fa729e-d6e2-4636-b057-aef216899c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:48.972850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:49.030225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa729e-d6e2-4636-b057-aef216899c27 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:49.034999 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964bb0-4220-41b0-a385-b4869f85c540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:49.044499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964bb0-4220-41b0-a385-b4869f85c540 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:49.044499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964bb0-4220-41b0-a385-b4869f85c540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:49.044499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964bb0-4220-41b0-a385-b4869f85c540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:49.044832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1015/2064] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:48 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:49.045322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2964bb0-4220-41b0-a385-b4869f85c540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:49.045442 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310c6fb-6490-4148-a6cd-e8f65f64befb admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:49.045538 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2964bb0-4220-41b0-a385-b4869f85c540 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:49.053172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1050/2065] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:07:49.057644 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964bb0-4220-41b0-a385-b4869f85c540 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:49.067355 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964bb0-4220-41b0-a385-b4869f85c540 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:49.104616 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310c6fb-6490-4148-a6cd-e8f65f64befb admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:49.110193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4eee1-8aad-480f-a108-a5aa505f7da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:49.110825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4eee1-8aad-480f-a108-a5aa505f7da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:49.111113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4eee1-8aad-480f-a108-a5aa505f7da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:49.111390 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4eee1-8aad-480f-a108-a5aa505f7da4 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:49.112061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4eee1-8aad-480f-a108-a5aa505f7da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:49.114227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4eee1-8aad-480f-a108-a5aa505f7da4 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:49.127299 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98defce-b3bd-48dc-babc-eb0915439f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:49.128214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98defce-b3bd-48dc-babc-eb0915439f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:49.128355 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98defce-b3bd-48dc-babc-eb0915439f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:49.128559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98defce-b3bd-48dc-babc-eb0915439f94 admin admin] PATH_INFO: `/v3/projects/47541cf1f12249bb853a2de2edf9a75d/users/6fb8310a9e0b4b1d8f3e2e70e549e430/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:49.130563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98defce-b3bd-48dc-babc-eb0915439f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47541cf1f12249bb853a2de2edf9a75d, user_id=6fb8310a9e0b4b1d8f3e2e70e549e430, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:49.133626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98defce-b3bd-48dc-babc-eb0915439f94 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:49.146154 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1051/2066] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:49 2022] PUT /identity/v3/projects/47541cf1f12249bb853a2de2edf9a75d/users/6fb8310a9e0b4b1d8f3e2e70e549e430/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:07:49.159963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd212c7-833f-4710-8c2f-1c831877ddfe None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:49.160331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd212c7-833f-4710-8c2f-1c831877ddfe None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:49.160530 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd212c7-833f-4710-8c2f-1c831877ddfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:49.197067 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-bbd212c7-833f-4710-8c2f-1c831877ddfe None None] MFA Rules not processed for user `6fb8310a9e0b4b1d8f3e2e70e549e430`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:49.198287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-bbd212c7-833f-4710-8c2f-1c831877ddfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:49.258069 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1016/2067] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:49 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:07:49.259229 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4eee1-8aad-480f-a108-a5aa505f7da4 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:49.269922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4eee1-8aad-480f-a108-a5aa505f7da4 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:49.275634 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1052/2068] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:49.286655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd212c7-833f-4710-8c2f-1c831877ddfe None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:49.288068 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-bbd212c7-833f-4710-8c2f-1c831877ddfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:49.328930 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077e3d6-0c0a-4a79-8380-3fd633b9bad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:49.329558 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077e3d6-0c0a-4a79-8380-3fd633b9bad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:49.329835 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077e3d6-0c0a-4a79-8380-3fd633b9bad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:49.330133 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077e3d6-0c0a-4a79-8380-3fd633b9bad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:49.330780 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077e3d6-0c0a-4a79-8380-3fd633b9bad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:49.332409 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077e3d6-0c0a-4a79-8380-3fd633b9bad3 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:49.343915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1017/2069] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:49.347083 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077e3d6-0c0a-4a79-8380-3fd633b9bad3 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:49.349712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd212c7-833f-4710-8c2f-1c831877ddfe None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:49.354420 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d8797-53cc-4a76-9ffd-0bd40eee45ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:49.354990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d8797-53cc-4a76-9ffd-0bd40eee45ee service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:49.355273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d8797-53cc-4a76-9ffd-0bd40eee45ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:49.360231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d8797-53cc-4a76-9ffd-0bd40eee45ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:49.364904 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077e3d6-0c0a-4a79-8380-3fd633b9bad3 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:49.364904 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b60e2-edc0-418a-9549-1e617952871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:49.364904 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b60e2-edc0-418a-9549-1e617952871a admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:49.364904 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b60e2-edc0-418a-9549-1e617952871a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:49.365271 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b60e2-edc0-418a-9549-1e617952871a admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:49.365271 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b60e2-edc0-418a-9549-1e617952871a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:49.366663 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b60e2-edc0-418a-9549-1e617952871a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:49.369874 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d8797-53cc-4a76-9ffd-0bd40eee45ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:49.371369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d8797-53cc-4a76-9ffd-0bd40eee45ee service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:49.381552 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1018/2070] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:49.381715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1053/2071] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:07:49.382871 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b60e2-edc0-418a-9549-1e617952871a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:49.394296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b60e2-edc0-418a-9549-1e617952871a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:49.399093 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ecc46-1523-47dd-aa80-3fc2449527c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:49.399875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ecc46-1523-47dd-aa80-3fc2449527c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:49.400194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ecc46-1523-47dd-aa80-3fc2449527c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:49.401002 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ecc46-1523-47dd-aa80-3fc2449527c1 admin admin] PATH_INFO: `/v3/projects/985c4362b58c4962ae065ec095d2f1b8/users/002a16d91db244028250b9d7781937df/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:49.415836 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ecc46-1523-47dd-aa80-3fc2449527c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985c4362b58c4962ae065ec095d2f1b8, user_id=002a16d91db244028250b9d7781937df, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:49.419280 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ecc46-1523-47dd-aa80-3fc2449527c1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:49.628828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1019/2072] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:49 2022] PUT /identity/v3/projects/985c4362b58c4962ae065ec095d2f1b8/users/002a16d91db244028250b9d7781937df/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:49.633987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ce33f-e56a-45e0-a28e-c219fa909a1f None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:49.634291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ce33f-e56a-45e0-a28e-c219fa909a1f None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:49.634556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ce33f-e56a-45e0-a28e-c219fa909a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:49.660645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-b79ce33f-e56a-45e0-a28e-c219fa909a1f None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:49.662070 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b79ce33f-e56a-45e0-a28e-c219fa909a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:49.736886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1054/2073] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:49.746602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ecc46-1523-47dd-aa80-3fc2449527c1 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:49.748406 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ed4ecc46-1523-47dd-aa80-3fc2449527c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:49.802924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ce33f-e56a-45e0-a28e-c219fa909a1f None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:49.804588 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b79ce33f-e56a-45e0-a28e-c219fa909a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:49.818431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ce33f-e56a-45e0-a28e-c219fa909a1f None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:49.832512 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe60c5-671a-4026-84f7-70c745e2078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:49.833329 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe60c5-671a-4026-84f7-70c745e2078f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:49.833697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe60c5-671a-4026-84f7-70c745e2078f admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:49.835358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe60c5-671a-4026-84f7-70c745e2078f admin admin] PATH_INFO: `/v3/projects/4f6c8ba25c8545e2866e671950b1df54` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:49.835507 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ecc46-1523-47dd-aa80-3fc2449527c1 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:49.845428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe60c5-671a-4026-84f7-70c745e2078f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6c8ba25c8545e2866e671950b1df54)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:49.845428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe60c5-671a-4026-84f7-70c745e2078f admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:49.855218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36efc88-b124-452f-a16f-3199e922e5bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:49.855218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36efc88-b124-452f-a16f-3199e922e5bb service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:49.855218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36efc88-b124-452f-a16f-3199e922e5bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:49.855218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36efc88-b124-452f-a16f-3199e922e5bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:49.864319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36efc88-b124-452f-a16f-3199e922e5bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:49.865931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36efc88-b124-452f-a16f-3199e922e5bb service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:49.877545 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1020/2074] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:49.932347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36efc88-b124-452f-a16f-3199e922e5bb service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:49.933757 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d36efc88-b124-452f-a16f-3199e922e5bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:49.947084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36efc88-b124-452f-a16f-3199e922e5bb service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:49.952473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179f969-1484-4ff3-9e41-b766d7ad7621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:49.953117 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179f969-1484-4ff3-9e41-b766d7ad7621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:49.953474 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179f969-1484-4ff3-9e41-b766d7ad7621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:49.953758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179f969-1484-4ff3-9e41-b766d7ad7621 admin admin] PATH_INFO: `/v3/users/284de6ba772d40a0a6ff7098f653aefb` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:49.954919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179f969-1484-4ff3-9e41-b766d7ad7621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=284de6ba772d40a0a6ff7098f653aefb)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:49.956901 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179f969-1484-4ff3-9e41-b766d7ad7621 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:50.100097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4dfe60c5-671a-4026-84f7-70c745e2078f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6c8ba25c8545e2866e671950b1df54', 'request_id': 'req-4dfe60c5-671a-4026-84f7-70c745e2078f'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.177928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4dfe60c5-671a-4026-84f7-70c745e2078f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6c8ba25c8545e2866e671950b1df54', 'request_id': 'req-4dfe60c5-671a-4026-84f7-70c745e2078f'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.186300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4dfe60c5-671a-4026-84f7-70c745e2078f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6c8ba25c8545e2866e671950b1df54', 'request_id': 'req-4dfe60c5-671a-4026-84f7-70c745e2078f'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.193451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c179f969-1484-4ff3-9e41-b766d7ad7621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '284de6ba772d40a0a6ff7098f653aefb'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.194180 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c179f969-1484-4ff3-9e41-b766d7ad7621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '284de6ba772d40a0a6ff7098f653aefb'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.200128 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4dfe60c5-671a-4026-84f7-70c745e2078f admin admin] The token cache is being invalidate because project 4f6c8ba25c8545e2866e671950b1df54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:50.200496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4dfe60c5-671a-4026-84f7-70c745e2078f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.201459 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4dfe60c5-671a-4026-84f7-70c745e2078f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.204314 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1055/2075] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:49 2022] DELETE /identity/v3/projects/4f6c8ba25c8545e2866e671950b1df54 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:50.205876 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe60c5-671a-4026-84f7-70c745e2078f admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:50.207723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-4dfe60c5-671a-4026-84f7-70c745e2078f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:50.212516 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c179f969-1484-4ff3-9e41-b766d7ad7621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '284de6ba772d40a0a6ff7098f653aefb'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.274509 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe60c5-671a-4026-84f7-70c745e2078f admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:50.279261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cfdbe-99f9-4d9b-a77e-f2ab61a39722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:50.280034 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cfdbe-99f9-4d9b-a77e-f2ab61a39722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:50.280321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cfdbe-99f9-4d9b-a77e-f2ab61a39722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:50.280599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cfdbe-99f9-4d9b-a77e-f2ab61a39722 admin admin] PATH_INFO: `/v3/users/15928e30479e411db2af397979641041` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:50.281820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1cfdbe-99f9-4d9b-a77e-f2ab61a39722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15928e30479e411db2af397979641041)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:50.283795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1cfdbe-99f9-4d9b-a77e-f2ab61a39722 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:50.344126 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c179f969-1484-4ff3-9e41-b766d7ad7621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '284de6ba772d40a0a6ff7098f653aefb'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.347617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c179f969-1484-4ff3-9e41-b766d7ad7621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '284de6ba772d40a0a6ff7098f653aefb'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.359786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1021/2076] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:49 2022] DELETE /identity/v3/users/284de6ba772d40a0a6ff7098f653aefb => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:07:50.360912 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179f969-1484-4ff3-9e41-b766d7ad7621 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:50.362265 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c179f969-1484-4ff3-9e41-b766d7ad7621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:50.433467 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179f969-1484-4ff3-9e41-b766d7ad7621 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:50.438059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284666f-836b-45c9-9e51-b1e057d90721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:50.438698 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284666f-836b-45c9-9e51-b1e057d90721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:50.438979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284666f-836b-45c9-9e51-b1e057d90721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:50.439257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284666f-836b-45c9-9e51-b1e057d90721 admin admin] PATH_INFO: `/v3/users/d3cf93752f1241e0847ab065abaf0d55` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:50.445223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284666f-836b-45c9-9e51-b1e057d90721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3cf93752f1241e0847ab065abaf0d55)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:50.445223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284666f-836b-45c9-9e51-b1e057d90721 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:50.643280 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-5a1cfdbe-99f9-4d9b-a77e-f2ab61a39722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15928e30479e411db2af397979641041'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.656167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-5a1cfdbe-99f9-4d9b-a77e-f2ab61a39722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15928e30479e411db2af397979641041'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.786092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-3284666f-836b-45c9-9e51-b1e057d90721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3cf93752f1241e0847ab065abaf0d55'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.786755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-3284666f-836b-45c9-9e51-b1e057d90721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3cf93752f1241e0847ab065abaf0d55'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.798791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-3284666f-836b-45c9-9e51-b1e057d90721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3cf93752f1241e0847ab065abaf0d55'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.813092 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-5a1cfdbe-99f9-4d9b-a77e-f2ab61a39722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15928e30479e411db2af397979641041'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.824119 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-5a1cfdbe-99f9-4d9b-a77e-f2ab61a39722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15928e30479e411db2af397979641041'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.824908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-5a1cfdbe-99f9-4d9b-a77e-f2ab61a39722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15928e30479e411db2af397979641041'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.831594 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1056/2077] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:50 2022] DELETE /identity/v3/users/15928e30479e411db2af397979641041 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:50.833009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab257e8-c457-4660-9daf-6f934b407340 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:50.833301 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab257e8-c457-4660-9daf-6f934b407340 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:50.833573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab257e8-c457-4660-9daf-6f934b407340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:50.854695 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-0ab257e8-c457-4660-9daf-6f934b407340 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:50.855920 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0ab257e8-c457-4660-9daf-6f934b407340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:50.912758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1057/2078] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:50.914045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f41f19-5ce2-40c7-a294-e8f146301601 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:50.914334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f41f19-5ce2-40c7-a294-e8f146301601 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:50.914606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f41f19-5ce2-40c7-a294-e8f146301601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:50.934145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-f3f41f19-5ce2-40c7-a294-e8f146301601 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:50.935505 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f3f41f19-5ce2-40c7-a294-e8f146301601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:50.943462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1058/2079] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:50.944462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f41f19-5ce2-40c7-a294-e8f146301601 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:50.945596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f3f41f19-5ce2-40c7-a294-e8f146301601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:50.960884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-3284666f-836b-45c9-9e51-b1e057d90721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3cf93752f1241e0847ab065abaf0d55'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.961581 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-3284666f-836b-45c9-9e51-b1e057d90721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3cf93752f1241e0847ab065abaf0d55'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:50.978126 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1022/2080] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:50 2022] DELETE /identity/v3/users/d3cf93752f1241e0847ab065abaf0d55 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:50.979411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284666f-836b-45c9-9e51-b1e057d90721 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:50.980995 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-3284666f-836b-45c9-9e51-b1e057d90721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:51.014014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f41f19-5ce2-40c7-a294-e8f146301601 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:51.069053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284666f-836b-45c9-9e51-b1e057d90721 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:51.074847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239f09d-1974-4caf-a55a-4f9957d19994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:51.076090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239f09d-1974-4caf-a55a-4f9957d19994 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:51.080502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239f09d-1974-4caf-a55a-4f9957d19994 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:51.080502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239f09d-1974-4caf-a55a-4f9957d19994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:51.080502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-3239f09d-1974-4caf-a55a-4f9957d19994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:51.084931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cc188-cf7b-4585-b195-8edea3495762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:51.085619 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cc188-cf7b-4585-b195-8edea3495762 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:51.085972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cc188-cf7b-4585-b195-8edea3495762 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:51.086337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cc188-cf7b-4585-b195-8edea3495762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:51.089077 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-7e1cc188-cf7b-4585-b195-8edea3495762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:51.162743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239f09d-1974-4caf-a55a-4f9957d19994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:51.164807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239f09d-1974-4caf-a55a-4f9957d19994 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:51.165104 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cc188-cf7b-4585-b195-8edea3495762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:51.167432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cc188-cf7b-4585-b195-8edea3495762 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:51.178402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1059/2081] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:51.180027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1023/2082] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:51.640511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cc188-cf7b-4585-b195-8edea3495762 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:51.646079 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-7e1cc188-cf7b-4585-b195-8edea3495762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:51.665320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cc188-cf7b-4585-b195-8edea3495762 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:51.672988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17756f95-cf8b-41d2-8128-d3f953ba0b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:51.685868 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17756f95-cf8b-41d2-8128-d3f953ba0b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:51.686393 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17756f95-cf8b-41d2-8128-d3f953ba0b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:51.686793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17756f95-cf8b-41d2-8128-d3f953ba0b5a admin admin] PATH_INFO: `/v3/projects/4015064ba3014abcae87d70771baf20c` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:51.689187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17756f95-cf8b-41d2-8128-d3f953ba0b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4015064ba3014abcae87d70771baf20c)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:51.691000 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17756f95-cf8b-41d2-8128-d3f953ba0b5a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:51.728223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:51.853071 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-17756f95-cf8b-41d2-8128-d3f953ba0b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4015064ba3014abcae87d70771baf20c', 'request_id': 'req-17756f95-cf8b-41d2-8128-d3f953ba0b5a'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:51.888858 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239f09d-1974-4caf-a55a-4f9957d19994 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:51.895596 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-3239f09d-1974-4caf-a55a-4f9957d19994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:51.908807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239f09d-1974-4caf-a55a-4f9957d19994 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:51.973434 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a4b84-e746-4e66-95bd-3194f6798ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:51.974116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4b84-e746-4e66-95bd-3194f6798ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:51.974909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4b84-e746-4e66-95bd-3194f6798ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:51.975284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a4b84-e746-4e66-95bd-3194f6798ac7 admin admin] PATH_INFO: `/v3/projects/e49db150770040e89de656f57a71a19b` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:51.976640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a4b84-e746-4e66-95bd-3194f6798ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e49db150770040e89de656f57a71a19b)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:51.979397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a4b84-e746-4e66-95bd-3194f6798ac7 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:52.001908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-17756f95-cf8b-41d2-8128-d3f953ba0b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4015064ba3014abcae87d70771baf20c', 'request_id': 'req-17756f95-cf8b-41d2-8128-d3f953ba0b5a'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.006360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:52.012712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-17756f95-cf8b-41d2-8128-d3f953ba0b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4015064ba3014abcae87d70771baf20c', 'request_id': 'req-17756f95-cf8b-41d2-8128-d3f953ba0b5a'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.024678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-17756f95-cf8b-41d2-8128-d3f953ba0b5a admin admin] The token cache is being invalidate because project 4015064ba3014abcae87d70771baf20c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:52.025218 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-17756f95-cf8b-41d2-8128-d3f953ba0b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.026246 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-17756f95-cf8b-41d2-8128-d3f953ba0b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.027851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1060/2083] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:51 2022] DELETE /identity/v3/projects/4015064ba3014abcae87d70771baf20c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:52.031328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17756f95-cf8b-41d2-8128-d3f953ba0b5a admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:52.031328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-17756f95-cf8b-41d2-8128-d3f953ba0b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:52.043665 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17756f95-cf8b-41d2-8128-d3f953ba0b5a admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:52.049304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77622550-6c1a-41b9-84c2-a122d66dc7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:52.049975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77622550-6c1a-41b9-84c2-a122d66dc7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:52.050258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77622550-6c1a-41b9-84c2-a122d66dc7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:52.050531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77622550-6c1a-41b9-84c2-a122d66dc7be admin admin] PATH_INFO: `/v3/projects/81e9788d951f4f57acc1f12dd51eca77` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:52.051654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77622550-6c1a-41b9-84c2-a122d66dc7be admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e9788d951f4f57acc1f12dd51eca77)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:52.053640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77622550-6c1a-41b9-84c2-a122d66dc7be admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:52.140956 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d45a4b84-e746-4e66-95bd-3194f6798ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e49db150770040e89de656f57a71a19b', 'request_id': 'req-d45a4b84-e746-4e66-95bd-3194f6798ac7'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.146911 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d45a4b84-e746-4e66-95bd-3194f6798ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e49db150770040e89de656f57a71a19b', 'request_id': 'req-d45a4b84-e746-4e66-95bd-3194f6798ac7'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.231263 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-77622550-6c1a-41b9-84c2-a122d66dc7be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e9788d951f4f57acc1f12dd51eca77', 'request_id': 'req-77622550-6c1a-41b9-84c2-a122d66dc7be'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.258585 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d45a4b84-e746-4e66-95bd-3194f6798ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e49db150770040e89de656f57a71a19b', 'request_id': 'req-d45a4b84-e746-4e66-95bd-3194f6798ac7'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.270755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d45a4b84-e746-4e66-95bd-3194f6798ac7 admin admin] The token cache is being invalidate because project e49db150770040e89de656f57a71a19b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:52.272556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d45a4b84-e746-4e66-95bd-3194f6798ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.272556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d45a4b84-e746-4e66-95bd-3194f6798ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.273314 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1024/2084] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:51 2022] DELETE /identity/v3/projects/e49db150770040e89de656f57a71a19b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:07:52.274513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc59155-5129-4884-9fc8-517c279995b7 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:52.274802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc59155-5129-4884-9fc8-517c279995b7 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:52.275079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc59155-5129-4884-9fc8-517c279995b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:52.295708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-4bc59155-5129-4884-9fc8-517c279995b7 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:52.296971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4bc59155-5129-4884-9fc8-517c279995b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:52.357516 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1025/2085] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:52.358403 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc59155-5129-4884-9fc8-517c279995b7 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:52.359777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4bc59155-5129-4884-9fc8-517c279995b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:52.372502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc59155-5129-4884-9fc8-517c279995b7 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:52.377426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bf0c7-2720-4aef-9c08-bfd590eb7798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:52.378072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bf0c7-2720-4aef-9c08-bfd590eb7798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:52.378490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bf0c7-2720-4aef-9c08-bfd590eb7798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:52.378773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bf0c7-2720-4aef-9c08-bfd590eb7798 admin admin] PATH_INFO: `/v3/users/df4a36376fec4bafb822f1ad3b3ee6f4` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:52.379948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bf0c7-2720-4aef-9c08-bfd590eb7798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4a36376fec4bafb822f1ad3b3ee6f4)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:52.381869 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bf0c7-2720-4aef-9c08-bfd590eb7798 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:52.424269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-77622550-6c1a-41b9-84c2-a122d66dc7be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e9788d951f4f57acc1f12dd51eca77', 'request_id': 'req-77622550-6c1a-41b9-84c2-a122d66dc7be'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.431195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-77622550-6c1a-41b9-84c2-a122d66dc7be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e9788d951f4f57acc1f12dd51eca77', 'request_id': 'req-77622550-6c1a-41b9-84c2-a122d66dc7be'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.443273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-77622550-6c1a-41b9-84c2-a122d66dc7be admin admin] The token cache is being invalidate because project 81e9788d951f4f57acc1f12dd51eca77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:52.443614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-77622550-6c1a-41b9-84c2-a122d66dc7be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.444368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-77622550-6c1a-41b9-84c2-a122d66dc7be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.445939 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1061/2086] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:52 2022] DELETE /identity/v3/projects/81e9788d951f4f57acc1f12dd51eca77 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:52.450645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e50fa-3704-46f5-ae36-b83ce068635e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:52.450645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e50fa-3704-46f5-ae36-b83ce068635e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:52.450903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e50fa-3704-46f5-ae36-b83ce068635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:52.473687 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-a30e50fa-3704-46f5-ae36-b83ce068635e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:52.474918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a30e50fa-3704-46f5-ae36-b83ce068635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:52.487507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1062/2087] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:52.488362 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e50fa-3704-46f5-ae36-b83ce068635e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:52.489949 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a30e50fa-3704-46f5-ae36-b83ce068635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:52.502833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e50fa-3704-46f5-ae36-b83ce068635e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:52.507769 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dfe46-0f20-482b-85e6-58f900a4bb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:52.508553 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dfe46-0f20-482b-85e6-58f900a4bb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:52.508897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dfe46-0f20-482b-85e6-58f900a4bb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:52.509257 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dfe46-0f20-482b-85e6-58f900a4bb1d admin admin] PATH_INFO: `/v3/users/6fb8310a9e0b4b1d8f3e2e70e549e430` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:52.510647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dfe46-0f20-482b-85e6-58f900a4bb1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb8310a9e0b4b1d8f3e2e70e549e430)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:52.512727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dfe46-0f20-482b-85e6-58f900a4bb1d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:52.725554 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-462bf0c7-2720-4aef-9c08-bfd590eb7798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4a36376fec4bafb822f1ad3b3ee6f4'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.726348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-462bf0c7-2720-4aef-9c08-bfd590eb7798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4a36376fec4bafb822f1ad3b3ee6f4'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.740970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-462bf0c7-2720-4aef-9c08-bfd590eb7798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4a36376fec4bafb822f1ad3b3ee6f4'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.812399 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fa6dfe46-0f20-482b-85e6-58f900a4bb1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb8310a9e0b4b1d8f3e2e70e549e430'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.856362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-462bf0c7-2720-4aef-9c08-bfd590eb7798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4a36376fec4bafb822f1ad3b3ee6f4'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.856905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-462bf0c7-2720-4aef-9c08-bfd590eb7798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4a36376fec4bafb822f1ad3b3ee6f4'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.862013 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fa6dfe46-0f20-482b-85e6-58f900a4bb1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb8310a9e0b4b1d8f3e2e70e549e430'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.877505 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1026/2088] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:52 2022] DELETE /identity/v3/users/df4a36376fec4bafb822f1ad3b3ee6f4 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:52.880047 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bf0c7-2720-4aef-9c08-bfd590eb7798 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:52.880047 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-462bf0c7-2720-4aef-9c08-bfd590eb7798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:52.933239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fa6dfe46-0f20-482b-85e6-58f900a4bb1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb8310a9e0b4b1d8f3e2e70e549e430'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.944415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fa6dfe46-0f20-482b-85e6-58f900a4bb1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb8310a9e0b4b1d8f3e2e70e549e430'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.945426 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fa6dfe46-0f20-482b-85e6-58f900a4bb1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb8310a9e0b4b1d8f3e2e70e549e430'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:52.977002 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bf0c7-2720-4aef-9c08-bfd590eb7798 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:52.977651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1063/2089] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:07:52 2022] DELETE /identity/v3/users/6fb8310a9e0b4b1d8f3e2e70e549e430 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:53.067089 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59970efb-8ae4-4c88-b7b1-6faecd83cefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:53.068035 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59970efb-8ae4-4c88-b7b1-6faecd83cefa admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:53.069012 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59970efb-8ae4-4c88-b7b1-6faecd83cefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:53.069012 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59970efb-8ae4-4c88-b7b1-6faecd83cefa admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:53.069267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59970efb-8ae4-4c88-b7b1-6faecd83cefa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:53.069585 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59970efb-8ae4-4c88-b7b1-6faecd83cefa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:53.071418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59970efb-8ae4-4c88-b7b1-6faecd83cefa admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:53.086137 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1027/2090] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:07:53.090910 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dfe46-0f20-482b-85e6-58f900a4bb1d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:53.092597 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fa6dfe46-0f20-482b-85e6-58f900a4bb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:53.109820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dfe46-0f20-482b-85e6-58f900a4bb1d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:53.115975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e005f41-fcd8-47ba-a50c-9b6d0a9f8e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:53.116630 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e005f41-fcd8-47ba-a50c-9b6d0a9f8e8f admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:53.116914 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e005f41-fcd8-47ba-a50c-9b6d0a9f8e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:53.117187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e005f41-fcd8-47ba-a50c-9b6d0a9f8e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:53.117831 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e005f41-fcd8-47ba-a50c-9b6d0a9f8e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:53.119797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e005f41-fcd8-47ba-a50c-9b6d0a9f8e8f admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:53.278817 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1064/2091] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:53 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:53.282880 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59970efb-8ae4-4c88-b7b1-6faecd83cefa admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:53.294073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59970efb-8ae4-4c88-b7b1-6faecd83cefa admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:53.391312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db07ac-b617-40e3-aa39-77d5cf398a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:53.391312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db07ac-b617-40e3-aa39-77d5cf398a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:53.391312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db07ac-b617-40e3-aa39-77d5cf398a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:53.391312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db07ac-b617-40e3-aa39-77d5cf398a19 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:53.393037 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db07ac-b617-40e3-aa39-77d5cf398a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:53.398185 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db07ac-b617-40e3-aa39-77d5cf398a19 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:53.538532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1028/2092] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:53 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:07:53.542803 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e005f41-fcd8-47ba-a50c-9b6d0a9f8e8f admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:53.554827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e005f41-fcd8-47ba-a50c-9b6d0a9f8e8f admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:53.560736 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e07c8f-f970-4cfa-b481-21e01c4bbda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:53.561348 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e07c8f-f970-4cfa-b481-21e01c4bbda5 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:53.561791 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e07c8f-f970-4cfa-b481-21e01c4bbda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:53.562063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e07c8f-f970-4cfa-b481-21e01c4bbda5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:53.562707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e07c8f-f970-4cfa-b481-21e01c4bbda5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:53.564486 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e07c8f-f970-4cfa-b481-21e01c4bbda5 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:53.576211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1065/2093] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:53.598151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db07ac-b617-40e3-aa39-77d5cf398a19 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:53.609935 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db07ac-b617-40e3-aa39-77d5cf398a19 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:53.615346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1494695-1edd-4dcb-bf18-5ac0a1591af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:53.616490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1494695-1edd-4dcb-bf18-5ac0a1591af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:53.616490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1494695-1edd-4dcb-bf18-5ac0a1591af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:53.616668 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1494695-1edd-4dcb-bf18-5ac0a1591af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:53.617256 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1494695-1edd-4dcb-bf18-5ac0a1591af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:53.618884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1494695-1edd-4dcb-bf18-5ac0a1591af2 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:53.646739 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1029/2094] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:53.651903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e07c8f-f970-4cfa-b481-21e01c4bbda5 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:53.653210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1494695-1edd-4dcb-bf18-5ac0a1591af2 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:53.655683 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d1494695-1edd-4dcb-bf18-5ac0a1591af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:53.664690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e07c8f-f970-4cfa-b481-21e01c4bbda5 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:53.670003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dc081-41e0-4cad-9d70-415b5e82b78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:53.671071 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dc081-41e0-4cad-9d70-415b5e82b78a admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:53.671567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dc081-41e0-4cad-9d70-415b5e82b78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:53.671954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1494695-1edd-4dcb-bf18-5ac0a1591af2 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:53.672411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dc081-41e0-4cad-9d70-415b5e82b78a admin admin] PATH_INFO: `/v3/projects/f043fbc727b54a61b52cbc25444d0f3e/users/b92f10573502413290c82fbf5e68b71c/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:53.678435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556cad7-26f9-4d3d-b10f-708357086215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:53.679157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556cad7-26f9-4d3d-b10f-708357086215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:53.679977 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556cad7-26f9-4d3d-b10f-708357086215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:53.679977 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556cad7-26f9-4d3d-b10f-708357086215 admin admin] PATH_INFO: `/v3/projects/62f0e040e51b45be9586660b730ff3a8` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:53.681393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556cad7-26f9-4d3d-b10f-708357086215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62f0e040e51b45be9586660b730ff3a8)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:53.688753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556cad7-26f9-4d3d-b10f-708357086215 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:53.719476 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836dc081-41e0-4cad-9d70-415b5e82b78a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f043fbc727b54a61b52cbc25444d0f3e, user_id=b92f10573502413290c82fbf5e68b71c, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:53.722323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836dc081-41e0-4cad-9d70-415b5e82b78a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:53.871100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1066/2095] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:53 2022] PUT /identity/v3/projects/f043fbc727b54a61b52cbc25444d0f3e/users/b92f10573502413290c82fbf5e68b71c/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:53.872700 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dc081-41e0-4cad-9d70-415b5e82b78a admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:53.874686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-836dc081-41e0-4cad-9d70-415b5e82b78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:53.885796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2556cad7-26f9-4d3d-b10f-708357086215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62f0e040e51b45be9586660b730ff3a8', 'request_id': 'req-2556cad7-26f9-4d3d-b10f-708357086215'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:53.891381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2556cad7-26f9-4d3d-b10f-708357086215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62f0e040e51b45be9586660b730ff3a8', 'request_id': 'req-2556cad7-26f9-4d3d-b10f-708357086215'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:53.953827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dc081-41e0-4cad-9d70-415b5e82b78a admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:54.008278 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2556cad7-26f9-4d3d-b10f-708357086215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62f0e040e51b45be9586660b730ff3a8', 'request_id': 'req-2556cad7-26f9-4d3d-b10f-708357086215'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:54.022312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d6be7-2e61-40fb-b07a-c18bf1bdc01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:54.022312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d6be7-2e61-40fb-b07a-c18bf1bdc01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:54.022312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d6be7-2e61-40fb-b07a-c18bf1bdc01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:54.022312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d6be7-2e61-40fb-b07a-c18bf1bdc01c admin admin] PATH_INFO: `/v3/projects/47541cf1f12249bb853a2de2edf9a75d` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:54.023321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d6be7-2e61-40fb-b07a-c18bf1bdc01c admin admin] RBAC: Authorizing `identity:delete_project(project_id=47541cf1f12249bb853a2de2edf9a75d)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:54.026307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d6be7-2e61-40fb-b07a-c18bf1bdc01c admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:54.030629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2556cad7-26f9-4d3d-b10f-708357086215 admin admin] The token cache is being invalidate because project 62f0e040e51b45be9586660b730ff3a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:54.032310 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2556cad7-26f9-4d3d-b10f-708357086215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:54.036958 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2556cad7-26f9-4d3d-b10f-708357086215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:54.042731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1030/2096] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:53 2022] DELETE /identity/v3/projects/62f0e040e51b45be9586660b730ff3a8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:54.044545 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847ecf3-7f90-4097-a1ce-c08d39808e2d None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:54.047541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847ecf3-7f90-4097-a1ce-c08d39808e2d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:54.047943 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847ecf3-7f90-4097-a1ce-c08d39808e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:54.091121 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-9847ecf3-7f90-4097-a1ce-c08d39808e2d None None] MFA Rules not processed for user `b92f10573502413290c82fbf5e68b71c`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:54.092589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-9847ecf3-7f90-4097-a1ce-c08d39808e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:54.179793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1031/2097] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:54.182270 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7a833-a994-4279-b301-d5c22bfc60f2 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:54.182665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7a833-a994-4279-b301-d5c22bfc60f2 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:54.183072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7a833-a994-4279-b301-d5c22bfc60f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:54.192145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-789d6be7-2e61-40fb-b07a-c18bf1bdc01c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47541cf1f12249bb853a2de2edf9a75d', 'request_id': 'req-789d6be7-2e61-40fb-b07a-c18bf1bdc01c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:54.208533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-14a7a833-a994-4279-b301-d5c22bfc60f2 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:54.209935 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-14a7a833-a994-4279-b301-d5c22bfc60f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:54.276840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-789d6be7-2e61-40fb-b07a-c18bf1bdc01c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47541cf1f12249bb853a2de2edf9a75d', 'request_id': 'req-789d6be7-2e61-40fb-b07a-c18bf1bdc01c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:54.289055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-789d6be7-2e61-40fb-b07a-c18bf1bdc01c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47541cf1f12249bb853a2de2edf9a75d', 'request_id': 'req-789d6be7-2e61-40fb-b07a-c18bf1bdc01c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:54.289790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1032/2098] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:54.290598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7a833-a994-4279-b301-d5c22bfc60f2 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:54.292763 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-14a7a833-a994-4279-b301-d5c22bfc60f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:54.304780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-789d6be7-2e61-40fb-b07a-c18bf1bdc01c admin admin] The token cache is being invalidate because project 47541cf1f12249bb853a2de2edf9a75d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:07:54.305305 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-789d6be7-2e61-40fb-b07a-c18bf1bdc01c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:54.306233 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-789d6be7-2e61-40fb-b07a-c18bf1bdc01c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:07:54.308625 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7a833-a994-4279-b301-d5c22bfc60f2 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:54.309006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1067/2099] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:07:53 2022] DELETE /identity/v3/projects/47541cf1f12249bb853a2de2edf9a75d => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:54.310548 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355243d-4f5b-4986-9d78-980d1f281f18 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:54.310838 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355243d-4f5b-4986-9d78-980d1f281f18 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:54.315733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355243d-4f5b-4986-9d78-980d1f281f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:54.315850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d845c-1307-4463-9d9a-a7d9024dd871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:54.315850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d845c-1307-4463-9d9a-a7d9024dd871 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:54.315850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d845c-1307-4463-9d9a-a7d9024dd871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:54.316697 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d845c-1307-4463-9d9a-a7d9024dd871 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:54.317647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d845c-1307-4463-9d9a-a7d9024dd871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:54.320068 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d845c-1307-4463-9d9a-a7d9024dd871 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:54.332594 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-5355243d-4f5b-4986-9d78-980d1f281f18 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:54.333850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-5355243d-4f5b-4986-9d78-980d1f281f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:54.347192 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1068/2100] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:54.348663 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218711d-24cc-41b8-9f35-c97f398c5aad None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:54.348963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218711d-24cc-41b8-9f35-c97f398c5aad None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:54.352646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218711d-24cc-41b8-9f35-c97f398c5aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:54.371253 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-3218711d-24cc-41b8-9f35-c97f398c5aad None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:54.372654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3218711d-24cc-41b8-9f35-c97f398c5aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:54.382716 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1069/2101] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:54.383733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218711d-24cc-41b8-9f35-c97f398c5aad None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:54.401741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218711d-24cc-41b8-9f35-c97f398c5aad None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:54.408622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3ae54-48d6-4745-b753-702081e541ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:54.409287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3ae54-48d6-4745-b753-702081e541ac admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:54.410424 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3ae54-48d6-4745-b753-702081e541ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:54.410424 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3ae54-48d6-4745-b753-702081e541ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:54.410704 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3ae54-48d6-4745-b753-702081e541ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:54.411011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3ae54-48d6-4745-b753-702081e541ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:54.412742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3ae54-48d6-4745-b753-702081e541ac admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:54.433995 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1070/2102] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:07:54.435570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b5824-998e-48b7-b7a4-72945b374d86 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:54.436186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b5824-998e-48b7-b7a4-72945b374d86 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:54.436674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b5824-998e-48b7-b7a4-72945b374d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:54.462908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-875b5824-998e-48b7-b7a4-72945b374d86 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:54.465015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-875b5824-998e-48b7-b7a4-72945b374d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:54.473903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1071/2103] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:54.474397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b5824-998e-48b7-b7a4-72945b374d86 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:54.484905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b5824-998e-48b7-b7a4-72945b374d86 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:54.494674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e6e59-0a1e-4fb7-a39b-946243256f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:54.494674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e6e59-0a1e-4fb7-a39b-946243256f96 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:54.494674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e6e59-0a1e-4fb7-a39b-946243256f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:54.494674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e6e59-0a1e-4fb7-a39b-946243256f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:54.495130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e6e59-0a1e-4fb7-a39b-946243256f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:54.496252 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1033/2104] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:54 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:54.496466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e6e59-0a1e-4fb7-a39b-946243256f96 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:54.497567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d845c-1307-4463-9d9a-a7d9024dd871 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:54.571424 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d845c-1307-4463-9d9a-a7d9024dd871 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:54.576238 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8acd1-8f3e-459b-926b-a693a103d238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:54.576927 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8acd1-8f3e-459b-926b-a693a103d238 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:54.577159 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8acd1-8f3e-459b-926b-a693a103d238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:54.577434 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8acd1-8f3e-459b-926b-a693a103d238 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:54.578197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8acd1-8f3e-459b-926b-a693a103d238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:07:54.578408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8acd1-8f3e-459b-926b-a693a103d238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:54.580452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8acd1-8f3e-459b-926b-a693a103d238 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:54.594313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1034/2105] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:07:54.595248 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8acd1-8f3e-459b-926b-a693a103d238 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:54.598723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-30e8acd1-8f3e-459b-926b-a693a103d238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:54.612971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8acd1-8f3e-459b-926b-a693a103d238 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:54.618367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554658ce-c862-446b-b165-ab937d1745a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:54.619067 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554658ce-c862-446b-b165-ab937d1745a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:54.619854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554658ce-c862-446b-b165-ab937d1745a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:54.620166 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554658ce-c862-446b-b165-ab937d1745a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:54.620868 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554658ce-c862-446b-b165-ab937d1745a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:54.622795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554658ce-c862-446b-b165-ab937d1745a4 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:54.655505 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1072/2106] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:54 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:54.657126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e6e59-0a1e-4fb7-a39b-946243256f96 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:54.739976 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e6e59-0a1e-4fb7-a39b-946243256f96 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:54.747270 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e5e30-5357-4579-9412-94b94df335dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:54.748066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e5e30-5357-4579-9412-94b94df335dd admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:54.748432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e5e30-5357-4579-9412-94b94df335dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:54.749083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e5e30-5357-4579-9412-94b94df335dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:54.749821 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e5e30-5357-4579-9412-94b94df335dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:54.751849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e5e30-5357-4579-9412-94b94df335dd admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:54.776460 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1035/2107] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:54 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:54.779336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554658ce-c862-446b-b165-ab937d1745a4 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:54.796601 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554658ce-c862-446b-b165-ab937d1745a4 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:54.802741 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f4b6d-e50b-4f80-a33f-2bea2baf3744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:54.803829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f4b6d-e50b-4f80-a33f-2bea2baf3744 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:54.804213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f4b6d-e50b-4f80-a33f-2bea2baf3744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:54.804495 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f4b6d-e50b-4f80-a33f-2bea2baf3744 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:54.805474 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f4b6d-e50b-4f80-a33f-2bea2baf3744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:54.807607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f4b6d-e50b-4f80-a33f-2bea2baf3744 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:54.841583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:54.883110 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1073/2108] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:54 2022] POST /identity/v3/projects => generated 373 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:54.887197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e5e30-5357-4579-9412-94b94df335dd admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:54.925569 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1036/2109] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:54 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:54.927150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f4b6d-e50b-4f80-a33f-2bea2baf3744 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:54.941939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f4b6d-e50b-4f80-a33f-2bea2baf3744 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:54.966169 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e5e30-5357-4579-9412-94b94df335dd admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:54.971088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babba50-5f19-432d-aef3-f878ab32c07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:54.971705 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babba50-5f19-432d-aef3-f878ab32c07c admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:54.972199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babba50-5f19-432d-aef3-f878ab32c07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:54.972489 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babba50-5f19-432d-aef3-f878ab32c07c admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:54.973131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babba50-5f19-432d-aef3-f878ab32c07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:54.975699 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babba50-5f19-432d-aef3-f878ab32c07c admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:54.987164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1074/2110] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:54.988085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babba50-5f19-432d-aef3-f878ab32c07c admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:54.999334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babba50-5f19-432d-aef3-f878ab32c07c admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:55.004517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b302f-4dd1-4dd6-a266-bf57bf519337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:55.005575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b302f-4dd1-4dd6-a266-bf57bf519337 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.005694 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b302f-4dd1-4dd6-a266-bf57bf519337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.005988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b302f-4dd1-4dd6-a266-bf57bf519337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.007294 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b302f-4dd1-4dd6-a266-bf57bf519337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:55.008286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b302f-4dd1-4dd6-a266-bf57bf519337 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:55.023502 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1075/2111] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:55.024544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b302f-4dd1-4dd6-a266-bf57bf519337 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:55.027951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a16a4-26f3-4f02-a3ac-809e7035f7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:55.028650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a16a4-26f3-4f02-a3ac-809e7035f7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.029005 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a16a4-26f3-4f02-a3ac-809e7035f7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.029350 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a16a4-26f3-4f02-a3ac-809e7035f7e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.030336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a16a4-26f3-4f02-a3ac-809e7035f7e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:55.032402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a16a4-26f3-4f02-a3ac-809e7035f7e0 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:55.037048 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b302f-4dd1-4dd6-a266-bf57bf519337 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:55.043118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0464e73-5a87-4edb-99e5-eb94806616df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:55.043118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0464e73-5a87-4edb-99e5-eb94806616df admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.044070 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0464e73-5a87-4edb-99e5-eb94806616df admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.044070 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0464e73-5a87-4edb-99e5-eb94806616df admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.044840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0464e73-5a87-4edb-99e5-eb94806616df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:55.046737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0464e73-5a87-4edb-99e5-eb94806616df admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:55.055089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:55.062346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1076/2112] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:55.070945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0464e73-5a87-4edb-99e5-eb94806616df admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:55.079263 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0464e73-5a87-4edb-99e5-eb94806616df admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:55.085503 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55352ffd-c3eb-440d-b2da-f26e6f6562f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:55.086128 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55352ffd-c3eb-440d-b2da-f26e6f6562f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.086409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55352ffd-c3eb-440d-b2da-f26e6f6562f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.086825 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55352ffd-c3eb-440d-b2da-f26e6f6562f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.087471 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55352ffd-c3eb-440d-b2da-f26e6f6562f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:55.090971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55352ffd-c3eb-440d-b2da-f26e6f6562f1 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:55.102893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1077/2113] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:55.104675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55352ffd-c3eb-440d-b2da-f26e6f6562f1 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:55.118397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55352ffd-c3eb-440d-b2da-f26e6f6562f1 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:55.127481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3b90b-0943-4d2a-b8af-615f8d48cd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:55.128436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3b90b-0943-4d2a-b8af-615f8d48cd96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.128866 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3b90b-0943-4d2a-b8af-615f8d48cd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.129290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3b90b-0943-4d2a-b8af-615f8d48cd96 admin admin] PATH_INFO: `/v3/projects/024bb9651a33400397bd06e966bccb57/users/cca6bb2ffa9c48e2849442e33be87e25/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.145185 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1037/2114] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:54 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:55.146617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a16a4-26f3-4f02-a3ac-809e7035f7e0 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:55.147540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3b90b-0943-4d2a-b8af-615f8d48cd96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=024bb9651a33400397bd06e966bccb57, user_id=cca6bb2ffa9c48e2849442e33be87e25, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:55.150620 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3b90b-0943-4d2a-b8af-615f8d48cd96 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:55.158430 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a16a4-26f3-4f02-a3ac-809e7035f7e0 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:55.163472 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aba0d1-035b-424b-8dcb-707a042df84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:55.164743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aba0d1-035b-424b-8dcb-707a042df84b admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.165201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aba0d1-035b-424b-8dcb-707a042df84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.165649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aba0d1-035b-424b-8dcb-707a042df84b admin admin] PATH_INFO: `/v3/projects/3106cec73f7144de80fa942dd3f8a25c/users/54ef2f77ecf54da6aa8dda65e72da09c/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.187777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aba0d1-035b-424b-8dcb-707a042df84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3106cec73f7144de80fa942dd3f8a25c, user_id=54ef2f77ecf54da6aa8dda65e72da09c, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:55.191948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aba0d1-035b-424b-8dcb-707a042df84b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:55.259284 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1078/2115] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:55 2022] PUT /identity/v3/projects/024bb9651a33400397bd06e966bccb57/users/cca6bb2ffa9c48e2849442e33be87e25/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:55.260858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3b90b-0943-4d2a-b8af-615f8d48cd96 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:55.289833 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1038/2116] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:55 2022] PUT /identity/v3/projects/3106cec73f7144de80fa942dd3f8a25c/users/54ef2f77ecf54da6aa8dda65e72da09c/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:55.292179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e227134-79c5-4015-9590-e69fa330e3aa None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.292537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e227134-79c5-4015-9590-e69fa330e3aa None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.292809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e227134-79c5-4015-9590-e69fa330e3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.326242 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6e227134-79c5-4015-9590-e69fa330e3aa None None] MFA Rules not processed for user `cca6bb2ffa9c48e2849442e33be87e25`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:55.328129 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6e227134-79c5-4015-9590-e69fa330e3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:55.341751 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3b90b-0943-4d2a-b8af-615f8d48cd96 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:55.401664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1039/2117] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:55.402796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3f258-357a-4b43-9609-ef80a0f5a7e0 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.403084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3f258-357a-4b43-9609-ef80a0f5a7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.403360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3f258-357a-4b43-9609-ef80a0f5a7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.410618 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611babb-89fa-4dee-a9b9-ba46db5752be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:55.411378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611babb-89fa-4dee-a9b9-ba46db5752be admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.412341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611babb-89fa-4dee-a9b9-ba46db5752be admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.412539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611babb-89fa-4dee-a9b9-ba46db5752be admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.413308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611babb-89fa-4dee-a9b9-ba46db5752be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:55.415056 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611babb-89fa-4dee-a9b9-ba46db5752be admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:55.423373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-71d3f258-357a-4b43-9609-ef80a0f5a7e0 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:55.424611 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-71d3f258-357a-4b43-9609-ef80a0f5a7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:55.426537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1079/2118] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:55.427275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611babb-89fa-4dee-a9b9-ba46db5752be admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:55.432653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1040/2119] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:55.439529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611babb-89fa-4dee-a9b9-ba46db5752be admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:55.442754 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3f258-357a-4b43-9609-ef80a0f5a7e0 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:55.445726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feea29-56a9-4ed3-b0c4-cc850a192102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:55.455723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feea29-56a9-4ed3-b0c4-cc850a192102 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.455723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feea29-56a9-4ed3-b0c4-cc850a192102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.455723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03feea29-56a9-4ed3-b0c4-cc850a192102 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.455723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03feea29-56a9-4ed3-b0c4-cc850a192102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:55.455723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03feea29-56a9-4ed3-b0c4-cc850a192102 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:55.456214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3f258-357a-4b43-9609-ef80a0f5a7e0 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:55.459583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccb3c7-36a9-433b-8408-ddcf09aeaad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:55.460367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccb3c7-36a9-433b-8408-ddcf09aeaad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.460716 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccb3c7-36a9-433b-8408-ddcf09aeaad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.461119 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccb3c7-36a9-433b-8408-ddcf09aeaad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.462131 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccb3c7-36a9-433b-8408-ddcf09aeaad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:55.464893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccb3c7-36a9-433b-8408-ddcf09aeaad3 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:55.476710 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1041/2120] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:55.482819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccb3c7-36a9-433b-8408-ddcf09aeaad3 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:55.482819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c4ccb3c7-36a9-433b-8408-ddcf09aeaad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:55.555755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccb3c7-36a9-433b-8408-ddcf09aeaad3 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:55.559558 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88074cdb-20db-4d63-82b8-d1c9e8031ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:55.560274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88074cdb-20db-4d63-82b8-d1c9e8031ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.560673 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88074cdb-20db-4d63-82b8-d1c9e8031ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.561044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88074cdb-20db-4d63-82b8-d1c9e8031ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.572754 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88074cdb-20db-4d63-82b8-d1c9e8031ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:55.574769 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88074cdb-20db-4d63-82b8-d1c9e8031ba6 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:55.587514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1042/2121] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:55.589249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88074cdb-20db-4d63-82b8-d1c9e8031ba6 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:55.592551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1080/2122] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:55 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:55.596854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feea29-56a9-4ed3-b0c4-cc850a192102 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:55.602858 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88074cdb-20db-4d63-82b8-d1c9e8031ba6 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:55.700772 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0abf44-2559-444f-8e5b-43a71a5c9638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:55.701563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0abf44-2559-444f-8e5b-43a71a5c9638 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.701889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0abf44-2559-444f-8e5b-43a71a5c9638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.703089 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0abf44-2559-444f-8e5b-43a71a5c9638 admin admin] PATH_INFO: `/v3/projects/0077658dfd8f45de8f0fd16fccc486ee/users/5b01968819ec4db0b55b1bb570a6294b/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.727276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03feea29-56a9-4ed3-b0c4-cc850a192102 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:55.727647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0abf44-2559-444f-8e5b-43a71a5c9638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0077658dfd8f45de8f0fd16fccc486ee, user_id=5b01968819ec4db0b55b1bb570a6294b, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:55.730986 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0abf44-2559-444f-8e5b-43a71a5c9638 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:55.756909 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8f5aa-8adf-4291-993d-08a701fac362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:55.758459 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8f5aa-8adf-4291-993d-08a701fac362 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.758820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8f5aa-8adf-4291-993d-08a701fac362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.759170 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8f5aa-8adf-4291-993d-08a701fac362 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.760548 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8f5aa-8adf-4291-993d-08a701fac362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:55.762599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8f5aa-8adf-4291-993d-08a701fac362 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:55.821815 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1043/2123] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:55 2022] PUT /identity/v3/projects/0077658dfd8f45de8f0fd16fccc486ee/users/5b01968819ec4db0b55b1bb570a6294b/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:55.827232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50744e1c-7729-4053-82a1-6d9d704580cf None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.827572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50744e1c-7729-4053-82a1-6d9d704580cf None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.827856 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50744e1c-7729-4053-82a1-6d9d704580cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.854372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-50744e1c-7729-4053-82a1-6d9d704580cf None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:55.857903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-50744e1c-7729-4053-82a1-6d9d704580cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:55.921636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1081/2124] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:55 2022] POST /identity/v3/users => generated 298 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:55.921636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8f5aa-8adf-4291-993d-08a701fac362 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:55.933737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8f5aa-8adf-4291-993d-08a701fac362 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:55.949327 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bc4c1-5880-4c40-9301-95de9781612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:55.951330 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1044/2125] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:55.953485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bc4c1-5880-4c40-9301-95de9781612b admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:55.954313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bc4c1-5880-4c40-9301-95de9781612b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:55.954313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bc4c1-5880-4c40-9301-95de9781612b admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:55.955116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bc4c1-5880-4c40-9301-95de9781612b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:55.956928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bc4c1-5880-4c40-9301-95de9781612b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:55.958990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50744e1c-7729-4053-82a1-6d9d704580cf None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:55.981972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1082/2126] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:55.986253 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bc4c1-5880-4c40-9301-95de9781612b admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:55.998968 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bc4c1-5880-4c40-9301-95de9781612b admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:56.006000 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0521a-6be0-4eb9-9034-ff3278b9395b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:56.006801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0521a-6be0-4eb9-9034-ff3278b9395b admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:56.007160 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0521a-6be0-4eb9-9034-ff3278b9395b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:56.007502 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0521a-6be0-4eb9-9034-ff3278b9395b admin admin] PATH_INFO: `/v3/projects/50f75989559744a2a32d7a024f8daa29/users/dc1a698ddf4f44c5b4b95a634a19aab9/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:56.029669 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0521a-6be0-4eb9-9034-ff3278b9395b admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f75989559744a2a32d7a024f8daa29, user_id=dc1a698ddf4f44c5b4b95a634a19aab9, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:56.037323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0521a-6be0-4eb9-9034-ff3278b9395b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:56.053655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50744e1c-7729-4053-82a1-6d9d704580cf None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:56.058803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1207d-d533-41c3-a758-c5ea359c4761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:56.059487 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1207d-d533-41c3-a758-c5ea359c4761 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:56.064510 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1207d-d533-41c3-a758-c5ea359c4761 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:56.064510 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1207d-d533-41c3-a758-c5ea359c4761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:56.083531 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1207d-d533-41c3-a758-c5ea359c4761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:56.089307 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1207d-d533-41c3-a758-c5ea359c4761 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:56.100397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1045/2127] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:07:56.128326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1083/2128] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:55 2022] PUT /identity/v3/projects/50f75989559744a2a32d7a024f8daa29/users/dc1a698ddf4f44c5b4b95a634a19aab9/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:07:56.132757 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1207d-d533-41c3-a758-c5ea359c4761 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:56.148739 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1207d-d533-41c3-a758-c5ea359c4761 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:56.261807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5b97d-3720-4271-b4b8-22f78af6c5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:56.262482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5b97d-3720-4271-b4b8-22f78af6c5fc admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:56.262766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5b97d-3720-4271-b4b8-22f78af6c5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:56.263042 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5b97d-3720-4271-b4b8-22f78af6c5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:56.263687 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5b97d-3720-4271-b4b8-22f78af6c5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:56.265346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5b97d-3720-4271-b4b8-22f78af6c5fc admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:56.276973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1046/2129] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:56.281056 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0521a-6be0-4eb9-9034-ff3278b9395b admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:56.316290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0521a-6be0-4eb9-9034-ff3278b9395b admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:56.322267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266b14c-4d62-4f18-bf48-13bc37fd32f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:56.323265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266b14c-4d62-4f18-bf48-13bc37fd32f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:56.323815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266b14c-4d62-4f18-bf48-13bc37fd32f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:56.324267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266b14c-4d62-4f18-bf48-13bc37fd32f9 admin admin] PATH_INFO: `/v3/projects/50f75989559744a2a32d7a024f8daa29/users/dc1a698ddf4f44c5b4b95a634a19aab9/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:56.326757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266b14c-4d62-4f18-bf48-13bc37fd32f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f75989559744a2a32d7a024f8daa29, user_id=dc1a698ddf4f44c5b4b95a634a19aab9, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:56.330180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266b14c-4d62-4f18-bf48-13bc37fd32f9 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:56.354920 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1084/2130] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:56 2022] PUT /identity/v3/projects/50f75989559744a2a32d7a024f8daa29/users/dc1a698ddf4f44c5b4b95a634a19aab9/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:56.355934 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d8611-9d99-4d3c-9819-895d3195f987 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:56.359054 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d8611-9d99-4d3c-9819-895d3195f987 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:56.359054 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d8611-9d99-4d3c-9819-895d3195f987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:56.410337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-aa6d8611-9d99-4d3c-9819-895d3195f987 None None] MFA Rules not processed for user `dc1a698ddf4f44c5b4b95a634a19aab9`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:56.415995 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-aa6d8611-9d99-4d3c-9819-895d3195f987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:56.565446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1047/2131] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:56.574109 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266b14c-4d62-4f18-bf48-13bc37fd32f9 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:56.575836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3266b14c-4d62-4f18-bf48-13bc37fd32f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:56.708069 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266b14c-4d62-4f18-bf48-13bc37fd32f9 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:56.715775 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b2a0f-f7f4-4706-a088-d6bca3f4f3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:56.716459 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b2a0f-f7f4-4706-a088-d6bca3f4f3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:56.716744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b2a0f-f7f4-4706-a088-d6bca3f4f3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:56.717022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b2a0f-f7f4-4706-a088-d6bca3f4f3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:56.718910 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-415b2a0f-f7f4-4706-a088-d6bca3f4f3b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:56.848071 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b2a0f-f7f4-4706-a088-d6bca3f4f3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:56.850310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b2a0f-f7f4-4706-a088-d6bca3f4f3b3 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:56.869936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1085/2132] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:56.933245 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:57.067690 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dca27-0aab-4664-b745-48bd2572f593 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:57.068309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dca27-0aab-4664-b745-48bd2572f593 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:57.069232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dca27-0aab-4664-b745-48bd2572f593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:57.106264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-499dca27-0aab-4664-b745-48bd2572f593 None None] MFA Rules not processed for user `002a16d91db244028250b9d7781937df`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:57.107582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-499dca27-0aab-4664-b745-48bd2572f593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:57.222890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b747c4-4c3d-4644-b9b5-8ffaf4f11c3c None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:57.223186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b747c4-4c3d-4644-b9b5-8ffaf4f11c3c None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:57.223561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b747c4-4c3d-4644-b9b5-8ffaf4f11c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:57.227972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1048/2133] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:57.247137 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:57.252827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-f2b747c4-4c3d-4644-b9b5-8ffaf4f11c3c None None] MFA Rules not processed for user `002a16d91db244028250b9d7781937df`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:57.253965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f2b747c4-4c3d-4644-b9b5-8ffaf4f11c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:57.264322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1086/2134] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:07:57.292782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dca27-0aab-4664-b745-48bd2572f593 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:57.293955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-499dca27-0aab-4664-b745-48bd2572f593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:57.377948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dca27-0aab-4664-b745-48bd2572f593 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:57.383594 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41789dc6-7cc4-437e-b0f1-ae659cb46633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:57.384250 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41789dc6-7cc4-437e-b0f1-ae659cb46633 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:57.385050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41789dc6-7cc4-437e-b0f1-ae659cb46633 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:57.385384 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41789dc6-7cc4-437e-b0f1-ae659cb46633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:57.394023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41789dc6-7cc4-437e-b0f1-ae659cb46633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:57.395993 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41789dc6-7cc4-437e-b0f1-ae659cb46633 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:57.407612 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1049/2135] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:57.959424 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff369b1-e6d5-493d-adfa-bd211ed83401 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:57.959961 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff369b1-e6d5-493d-adfa-bd211ed83401 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:57.960115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff369b1-e6d5-493d-adfa-bd211ed83401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:58.002261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-aff369b1-e6d5-493d-adfa-bd211ed83401 None None] MFA Rules not processed for user `54ef2f77ecf54da6aa8dda65e72da09c`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:58.004868 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-aff369b1-e6d5-493d-adfa-bd211ed83401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:58.076799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1087/2136] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:58.086887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41789dc6-7cc4-437e-b0f1-ae659cb46633 service nova] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:58.098176 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41789dc6-7cc4-437e-b0f1-ae659cb46633 service nova] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:58.102140 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cca5d-b702-485e-ba69-c0a424f52454 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:58.102740 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cca5d-b702-485e-ba69-c0a424f52454 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:58.103023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cca5d-b702-485e-ba69-c0a424f52454 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:58.103967 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cca5d-b702-485e-ba69-c0a424f52454 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:58.112978 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cca5d-b702-485e-ba69-c0a424f52454 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:58.114548 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cca5d-b702-485e-ba69-c0a424f52454 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:58.125623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1050/2137] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:07:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:07:58.317432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7ed5e-2040-438c-a8c8-c04eea1ea61c None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:58.318037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7ed5e-2040-438c-a8c8-c04eea1ea61c None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:58.318524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7ed5e-2040-438c-a8c8-c04eea1ea61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:58.365912 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-21d7ed5e-2040-438c-a8c8-c04eea1ea61c None None] MFA Rules not processed for user `5b01968819ec4db0b55b1bb570a6294b`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:58.367268 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-21d7ed5e-2040-438c-a8c8-c04eea1ea61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:58.475919 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1088/2138] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:58.481122 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cca5d-b702-485e-ba69-c0a424f52454 service cinder] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:58.509434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978dad4-2089-4470-92ea-e433ec456f65 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:58.510040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978dad4-2089-4470-92ea-e433ec456f65 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:58.510332 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978dad4-2089-4470-92ea-e433ec456f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:58.550719 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-0978dad4-2089-4470-92ea-e433ec456f65 None None] MFA Rules not processed for user `002a16d91db244028250b9d7781937df`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:07:58.552906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0978dad4-2089-4470-92ea-e433ec456f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:07:58.565468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1089/2139] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:07:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:07:58.607343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cca5d-b702-485e-ba69-c0a424f52454 service cinder] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:58.626206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb482be-2910-4631-b8be-d83f9c5fb20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:58.626890 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb482be-2910-4631-b8be-d83f9c5fb20a admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:58.627168 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb482be-2910-4631-b8be-d83f9c5fb20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:58.627440 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb482be-2910-4631-b8be-d83f9c5fb20a admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:58.629815 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb482be-2910-4631-b8be-d83f9c5fb20a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:58.632735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb482be-2910-4631-b8be-d83f9c5fb20a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:58.883408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1051/2140] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:07:58 2022] POST /identity/v3/projects => generated 371 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:58.888235 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978dad4-2089-4470-92ea-e433ec456f65 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:58.900255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978dad4-2089-4470-92ea-e433ec456f65 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:58.985662 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b1aab-c85a-4f46-8212-e9fc66046a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:58.986439 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b1aab-c85a-4f46-8212-e9fc66046a9f admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:58.986800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b1aab-c85a-4f46-8212-e9fc66046a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:58.987198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b1aab-c85a-4f46-8212-e9fc66046a9f admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:58.988202 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b1aab-c85a-4f46-8212-e9fc66046a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:58.990205 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b1aab-c85a-4f46-8212-e9fc66046a9f admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:59.158295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1090/2141] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:07:58 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:07:59.162950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb482be-2910-4631-b8be-d83f9c5fb20a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:59.174275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb482be-2910-4631-b8be-d83f9c5fb20a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:59.179126 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0d988-5266-4416-a370-5abc212871be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:59.179731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0d988-5266-4416-a370-5abc212871be admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:59.180052 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0d988-5266-4416-a370-5abc212871be admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:59.180328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0d988-5266-4416-a370-5abc212871be admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:59.180972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0d988-5266-4416-a370-5abc212871be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:59.183141 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0d988-5266-4416-a370-5abc212871be admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:59.200961 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1052/2142] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:59.204531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b1aab-c85a-4f46-8212-e9fc66046a9f admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:59.216195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b1aab-c85a-4f46-8212-e9fc66046a9f admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:59.221165 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b2a3f-20ba-4703-91c4-97cad8967930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:59.223410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b2a3f-20ba-4703-91c4-97cad8967930 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:59.223764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b2a3f-20ba-4703-91c4-97cad8967930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:59.224082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b2a3f-20ba-4703-91c4-97cad8967930 admin admin] PATH_INFO: `/v3/projects/62dd59a85c524f9e95922c9aa44b24b7/users/a4bbaccbeb7e4dfe9dae02046591a05e/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:59.252338 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b2a3f-20ba-4703-91c4-97cad8967930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62dd59a85c524f9e95922c9aa44b24b7, user_id=a4bbaccbeb7e4dfe9dae02046591a05e, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:59.256443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b2a3f-20ba-4703-91c4-97cad8967930 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:59.382825 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1091/2143] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:59 2022] PUT /identity/v3/projects/62dd59a85c524f9e95922c9aa44b24b7/users/a4bbaccbeb7e4dfe9dae02046591a05e/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:07:59.386584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0d988-5266-4416-a370-5abc212871be admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:59.401708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0d988-5266-4416-a370-5abc212871be admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:59.480314 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36474e2-7a23-413c-bb4a-8d5d07a608b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:59.481243 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36474e2-7a23-413c-bb4a-8d5d07a608b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:59.481602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36474e2-7a23-413c-bb4a-8d5d07a608b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:59.481940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36474e2-7a23-413c-bb4a-8d5d07a608b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:59.482658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36474e2-7a23-413c-bb4a-8d5d07a608b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:59.484527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36474e2-7a23-413c-bb4a-8d5d07a608b1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:59.495836 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1053/2144] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:07:59.502944 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b2a3f-20ba-4703-91c4-97cad8967930 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:07:59.511049 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b2a3f-20ba-4703-91c4-97cad8967930 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:07:59.515835 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c739e8d-e644-4c13-9334-43f698918b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:07:59.516549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c739e8d-e644-4c13-9334-43f698918b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:07:59.516817 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c739e8d-e644-4c13-9334-43f698918b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:07:59.517091 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c739e8d-e644-4c13-9334-43f698918b1a admin admin] PATH_INFO: `/v3/projects/62dd59a85c524f9e95922c9aa44b24b7/users/a4bbaccbeb7e4dfe9dae02046591a05e/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:07:59.519053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c739e8d-e644-4c13-9334-43f698918b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=62dd59a85c524f9e95922c9aa44b24b7, user_id=a4bbaccbeb7e4dfe9dae02046591a05e, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:07:59.521899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c739e8d-e644-4c13-9334-43f698918b1a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:07:59.533511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1092/2145] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:07:59 2022] PUT /identity/v3/projects/62dd59a85c524f9e95922c9aa44b24b7/users/a4bbaccbeb7e4dfe9dae02046591a05e/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:00.003651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:00.208151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36474e2-7a23-413c-bb4a-8d5d07a608b1 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:00.281391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36474e2-7a23-413c-bb4a-8d5d07a608b1 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:00.342879 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83c1c6-21df-4ba2-8696-1f03f5edcbf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:00.343512 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83c1c6-21df-4ba2-8696-1f03f5edcbf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:00.343798 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83c1c6-21df-4ba2-8696-1f03f5edcbf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:00.344211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83c1c6-21df-4ba2-8696-1f03f5edcbf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:00.439412 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83c1c6-21df-4ba2-8696-1f03f5edcbf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:00.441045 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83c1c6-21df-4ba2-8696-1f03f5edcbf4 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:00.452865 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1054/2146] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:00.734227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:01.379566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ec2db-9583-403f-906a-129c3b0e2f6d None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:01.380287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ec2db-9583-403f-906a-129c3b0e2f6d None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:01.380853 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ec2db-9583-403f-906a-129c3b0e2f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:01.454697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-de0ec2db-9583-403f-906a-129c3b0e2f6d None None] MFA Rules not processed for user `a4bbaccbeb7e4dfe9dae02046591a05e`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:01.456233 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-de0ec2db-9583-403f-906a-129c3b0e2f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:01.506550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecb654-4093-4cb7-b196-e7d74c221c98 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:01.507116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecb654-4093-4cb7-b196-e7d74c221c98 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:01.507214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecb654-4093-4cb7-b196-e7d74c221c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:01.530211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-5aecb654-4093-4cb7-b196-e7d74c221c98 None None] MFA Rules not processed for user `54ef2f77ecf54da6aa8dda65e72da09c`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:01.530956 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-5aecb654-4093-4cb7-b196-e7d74c221c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:01.541717 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1093/2147] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:01.555411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d429c5b-b597-407b-b6ee-2849d6f2177f None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:01.555752 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d429c5b-b597-407b-b6ee-2849d6f2177f None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:01.556123 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d429c5b-b597-407b-b6ee-2849d6f2177f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:01.578693 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-2d429c5b-b597-407b-b6ee-2849d6f2177f None None] MFA Rules not processed for user `5b01968819ec4db0b55b1bb570a6294b`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:01.580393 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2d429c5b-b597-407b-b6ee-2849d6f2177f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:01.613435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1055/2148] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:01.707084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1094/2149] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:01.721951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecb654-4093-4cb7-b196-e7d74c221c98 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:01.723650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-5aecb654-4093-4cb7-b196-e7d74c221c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:01.832118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecb654-4093-4cb7-b196-e7d74c221c98 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:01.835576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69248d35-8613-4979-a051-4ea013b9b38c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:01.836143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69248d35-8613-4979-a051-4ea013b9b38c service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:01.836427 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69248d35-8613-4979-a051-4ea013b9b38c service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:01.836701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69248d35-8613-4979-a051-4ea013b9b38c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:01.848465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69248d35-8613-4979-a051-4ea013b9b38c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:01.850101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69248d35-8613-4979-a051-4ea013b9b38c service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:01.860727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1056/2150] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:02.912157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d429c5b-b597-407b-b6ee-2849d6f2177f None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:02.914126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2d429c5b-b597-407b-b6ee-2849d6f2177f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:02.928580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d429c5b-b597-407b-b6ee-2849d6f2177f None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:02.933852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd71a9-a5c9-4078-bf99-5bef4eb8d71c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:02.934478 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd71a9-a5c9-4078-bf99-5bef4eb8d71c service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:02.934763 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd71a9-a5c9-4078-bf99-5bef4eb8d71c service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:02.935042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd71a9-a5c9-4078-bf99-5bef4eb8d71c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:03.042364 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd71a9-a5c9-4078-bf99-5bef4eb8d71c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:03.043965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd71a9-a5c9-4078-bf99-5bef4eb8d71c service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:03.062769 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1095/2151] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:03.682499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:03.807603 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69248d35-8613-4979-a051-4ea013b9b38c service nova] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:03.809365 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-69248d35-8613-4979-a051-4ea013b9b38c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:03.880607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69248d35-8613-4979-a051-4ea013b9b38c service nova] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:03.889343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426b952-8f5b-498f-9d74-8236ab2d5c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:03.889343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426b952-8f5b-498f-9d74-8236ab2d5c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:03.889343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426b952-8f5b-498f-9d74-8236ab2d5c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:03.889343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426b952-8f5b-498f-9d74-8236ab2d5c89 admin admin] PATH_INFO: `/v3/users/9c5355757da84e56b37c5cd381dde7ee` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:03.890080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426b952-8f5b-498f-9d74-8236ab2d5c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c5355757da84e56b37c5cd381dde7ee)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:03.892227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426b952-8f5b-498f-9d74-8236ab2d5c89 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:04.250439 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4426b952-8f5b-498f-9d74-8236ab2d5c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c5355757da84e56b37c5cd381dde7ee'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:04.251415 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4426b952-8f5b-498f-9d74-8236ab2d5c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c5355757da84e56b37c5cd381dde7ee'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:04.265805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4426b952-8f5b-498f-9d74-8236ab2d5c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c5355757da84e56b37c5cd381dde7ee'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:04.333360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:04.399199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4426b952-8f5b-498f-9d74-8236ab2d5c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c5355757da84e56b37c5cd381dde7ee'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:04.399199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4426b952-8f5b-498f-9d74-8236ab2d5c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c5355757da84e56b37c5cd381dde7ee'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:04.411341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1057/2152] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:08:03 2022] DELETE /identity/v3/users/9c5355757da84e56b37c5cd381dde7ee => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:04.416063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c3678-2ecd-405f-80a8-a085d0a7c3c8 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:04.416365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c3678-2ecd-405f-80a8-a085d0a7c3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:04.416638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c3678-2ecd-405f-80a8-a085d0a7c3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:04.436747 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-768c3678-2ecd-405f-80a8-a085d0a7c3c8 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:04.438127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-768c3678-2ecd-405f-80a8-a085d0a7c3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:04.503015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1096/2153] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:04.513831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426b952-8f5b-498f-9d74-8236ab2d5c89 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:04.515569 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4426b952-8f5b-498f-9d74-8236ab2d5c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:04.598955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426b952-8f5b-498f-9d74-8236ab2d5c89 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:04.604278 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a26d6d-e2d2-4d51-8f74-7a142a91db5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:04.605204 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a26d6d-e2d2-4d51-8f74-7a142a91db5d service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:04.605552 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a26d6d-e2d2-4d51-8f74-7a142a91db5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:04.606185 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a26d6d-e2d2-4d51-8f74-7a142a91db5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:04.620135 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a26d6d-e2d2-4d51-8f74-7a142a91db5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:04.621734 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a26d6d-e2d2-4d51-8f74-7a142a91db5d service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:04.633919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1058/2154] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:05.540362 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c3678-2ecd-405f-80a8-a085d0a7c3c8 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:05.544136 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-768c3678-2ecd-405f-80a8-a085d0a7c3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:05.558163 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c3678-2ecd-405f-80a8-a085d0a7c3c8 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:05.563949 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7c79f-eac0-40df-9d8d-856e1be763ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:05.565405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7c79f-eac0-40df-9d8d-856e1be763ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:05.565835 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7c79f-eac0-40df-9d8d-856e1be763ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:05.566282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7c79f-eac0-40df-9d8d-856e1be763ee admin admin] PATH_INFO: `/v3/projects/67e2353460f7496d93788aee15197f17` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:05.567503 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7c79f-eac0-40df-9d8d-856e1be763ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=67e2353460f7496d93788aee15197f17)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:05.571809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7c79f-eac0-40df-9d8d-856e1be763ee admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:05.755595 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6cf7c79f-eac0-40df-9d8d-856e1be763ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67e2353460f7496d93788aee15197f17', 'request_id': 'req-6cf7c79f-eac0-40df-9d8d-856e1be763ee'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:05.864207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6cf7c79f-eac0-40df-9d8d-856e1be763ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67e2353460f7496d93788aee15197f17', 'request_id': 'req-6cf7c79f-eac0-40df-9d8d-856e1be763ee'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:05.871711 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6cf7c79f-eac0-40df-9d8d-856e1be763ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67e2353460f7496d93788aee15197f17', 'request_id': 'req-6cf7c79f-eac0-40df-9d8d-856e1be763ee'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:05.884190 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6cf7c79f-eac0-40df-9d8d-856e1be763ee admin admin] The token cache is being invalidate because project 67e2353460f7496d93788aee15197f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:08:05.884488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6cf7c79f-eac0-40df-9d8d-856e1be763ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:05.885176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6cf7c79f-eac0-40df-9d8d-856e1be763ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:05.887003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1097/2155] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:08:05 2022] DELETE /identity/v3/projects/67e2353460f7496d93788aee15197f17 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:05.891942 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a6665-639d-4c6f-bc93-105682eaf7c2 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:05.892426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a6665-639d-4c6f-bc93-105682eaf7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:05.892620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a6665-639d-4c6f-bc93-105682eaf7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:05.917328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6d0a6665-639d-4c6f-bc93-105682eaf7c2 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:05.918736 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6d0a6665-639d-4c6f-bc93-105682eaf7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:05.994482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1059/2156] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:06.003467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90480fbf-c445-45c3-a101-ccd525551fc8 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:06.003752 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90480fbf-c445-45c3-a101-ccd525551fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:06.004062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90480fbf-c445-45c3-a101-ccd525551fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:06.029153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-90480fbf-c445-45c3-a101-ccd525551fc8 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:06.030678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-90480fbf-c445-45c3-a101-ccd525551fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:06.042712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1098/2157] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:06.046760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a6665-639d-4c6f-bc93-105682eaf7c2 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:06.057753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a6665-639d-4c6f-bc93-105682eaf7c2 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:06.062688 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08854c60-6c1d-4037-806f-4e83e36c8937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:06.063408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08854c60-6c1d-4037-806f-4e83e36c8937 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:06.063754 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08854c60-6c1d-4037-806f-4e83e36c8937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:06.064132 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08854c60-6c1d-4037-806f-4e83e36c8937 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:06.064795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08854c60-6c1d-4037-806f-4e83e36c8937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:08:06.065104 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08854c60-6c1d-4037-806f-4e83e36c8937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:06.066708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08854c60-6c1d-4037-806f-4e83e36c8937 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:06.079623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1060/2158] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:08:06.083917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90480fbf-c445-45c3-a101-ccd525551fc8 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:06.093637 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90480fbf-c445-45c3-a101-ccd525551fc8 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:06.098366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fe27a-7d82-435c-9370-9666e0d7c338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:06.098992 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fe27a-7d82-435c-9370-9666e0d7c338 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:06.099269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fe27a-7d82-435c-9370-9666e0d7c338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:06.099548 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fe27a-7d82-435c-9370-9666e0d7c338 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:06.100243 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fe27a-7d82-435c-9370-9666e0d7c338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:06.102821 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fe27a-7d82-435c-9370-9666e0d7c338 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:06.231200 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1099/2159] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:08:06 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:06.235562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08854c60-6c1d-4037-806f-4e83e36c8937 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:06.246529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08854c60-6c1d-4037-806f-4e83e36c8937 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:06.313100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194877f4-0631-47b9-be5e-0987d8a5afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:06.313706 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194877f4-0631-47b9-be5e-0987d8a5afd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:06.313984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194877f4-0631-47b9-be5e-0987d8a5afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:06.314255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194877f4-0631-47b9-be5e-0987d8a5afd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:06.315070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194877f4-0631-47b9-be5e-0987d8a5afd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:06.317028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194877f4-0631-47b9-be5e-0987d8a5afd9 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:06.522448 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1061/2160] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:08:06 2022] POST /identity/v3/users => generated 289 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:06.526951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fe27a-7d82-435c-9370-9666e0d7c338 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:06.538735 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fe27a-7d82-435c-9370-9666e0d7c338 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:06.543576 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01b1e5-4522-45a2-94c4-af7241cc9101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:06.544627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01b1e5-4522-45a2-94c4-af7241cc9101 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:06.544627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01b1e5-4522-45a2-94c4-af7241cc9101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:06.544953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01b1e5-4522-45a2-94c4-af7241cc9101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:06.545600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01b1e5-4522-45a2-94c4-af7241cc9101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:06.547204 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01b1e5-4522-45a2-94c4-af7241cc9101 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:06.557790 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1100/2161] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:06.575104 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194877f4-0631-47b9-be5e-0987d8a5afd9 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:06.585633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194877f4-0631-47b9-be5e-0987d8a5afd9 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:06.591582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c97f52-ab49-44dd-a2ba-66af74cd7b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:06.592301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c97f52-ab49-44dd-a2ba-66af74cd7b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:06.592606 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c97f52-ab49-44dd-a2ba-66af74cd7b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:06.592861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c97f52-ab49-44dd-a2ba-66af74cd7b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:06.593614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c97f52-ab49-44dd-a2ba-66af74cd7b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:06.595237 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c97f52-ab49-44dd-a2ba-66af74cd7b53 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:06.606420 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1062/2162] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:06.610662 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01b1e5-4522-45a2-94c4-af7241cc9101 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:06.620510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01b1e5-4522-45a2-94c4-af7241cc9101 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:06.625192 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4da02-cd6c-4a98-a61c-c3f72723e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:06.625837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4da02-cd6c-4a98-a61c-c3f72723e742 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:06.626116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4da02-cd6c-4a98-a61c-c3f72723e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:06.626386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4da02-cd6c-4a98-a61c-c3f72723e742 admin admin] PATH_INFO: `/v3/projects/7b4457f5d6b442c0b6caf75f760baccb/users/8a5aa026fdb44419b7a938acb2cbe980/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:06.643730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4da02-cd6c-4a98-a61c-c3f72723e742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4457f5d6b442c0b6caf75f760baccb, user_id=8a5aa026fdb44419b7a938acb2cbe980, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:06.646471 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4da02-cd6c-4a98-a61c-c3f72723e742 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:06.796706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1101/2163] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:08:06 2022] PUT /identity/v3/projects/7b4457f5d6b442c0b6caf75f760baccb/users/8a5aa026fdb44419b7a938acb2cbe980/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:06.807791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd51664-0360-4bed-9841-04c7d0303e1f None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:06.808118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd51664-0360-4bed-9841-04c7d0303e1f None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:06.808401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd51664-0360-4bed-9841-04c7d0303e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:06.849950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-ffd51664-0360-4bed-9841-04c7d0303e1f None None] MFA Rules not processed for user `8a5aa026fdb44419b7a938acb2cbe980`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:06.851711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ffd51664-0360-4bed-9841-04c7d0303e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:06.932460 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1063/2164] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:06.945179 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4da02-cd6c-4a98-a61c-c3f72723e742 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:06.946942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-abb4da02-cd6c-4a98-a61c-c3f72723e742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:07.028886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4da02-cd6c-4a98-a61c-c3f72723e742 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:07.039852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f7650-f10a-4828-99d2-d0041f7ed12a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:07.041633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f7650-f10a-4828-99d2-d0041f7ed12a service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:07.041633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f7650-f10a-4828-99d2-d0041f7ed12a service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:07.043700 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f7650-f10a-4828-99d2-d0041f7ed12a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:07.069515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f7650-f10a-4828-99d2-d0041f7ed12a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:07.071201 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f7650-f10a-4828-99d2-d0041f7ed12a service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:07.081645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1102/2165] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:08.429906 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:09.651400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd51664-0360-4bed-9841-04c7d0303e1f None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:09.655842 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ffd51664-0360-4bed-9841-04c7d0303e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:09.719472 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd51664-0360-4bed-9841-04c7d0303e1f None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:09.724100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a386-c102-4f39-8a6e-0dd5203ed6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:09.724775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a386-c102-4f39-8a6e-0dd5203ed6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:09.725109 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a386-c102-4f39-8a6e-0dd5203ed6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:09.725388 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08a386-c102-4f39-8a6e-0dd5203ed6a2 admin admin] PATH_INFO: `/v3/users/b92f10573502413290c82fbf5e68b71c` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:09.726553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a386-c102-4f39-8a6e-0dd5203ed6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92f10573502413290c82fbf5e68b71c)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:09.728575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08a386-c102-4f39-8a6e-0dd5203ed6a2 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:09.997243 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9c08a386-c102-4f39-8a6e-0dd5203ed6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92f10573502413290c82fbf5e68b71c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:09.997919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9c08a386-c102-4f39-8a6e-0dd5203ed6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92f10573502413290c82fbf5e68b71c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:10.011558 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9c08a386-c102-4f39-8a6e-0dd5203ed6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92f10573502413290c82fbf5e68b71c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:10.104297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9c08a386-c102-4f39-8a6e-0dd5203ed6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92f10573502413290c82fbf5e68b71c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:10.104935 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9c08a386-c102-4f39-8a6e-0dd5203ed6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92f10573502413290c82fbf5e68b71c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:10.117864 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1064/2166] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:08:09 2022] DELETE /identity/v3/users/b92f10573502413290c82fbf5e68b71c => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:10.123149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c7b7d-3ec0-4125-bd64-fe8929df29c8 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:10.123621 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c7b7d-3ec0-4125-bd64-fe8929df29c8 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:10.123739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c7b7d-3ec0-4125-bd64-fe8929df29c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:10.142677 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-d91c7b7d-3ec0-4125-bd64-fe8929df29c8 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:10.143890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d91c7b7d-3ec0-4125-bd64-fe8929df29c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:10.203816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1103/2167] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:10.213909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a386-c102-4f39-8a6e-0dd5203ed6a2 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:10.215313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-9c08a386-c102-4f39-8a6e-0dd5203ed6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:10.273153 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08a386-c102-4f39-8a6e-0dd5203ed6a2 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:10.276821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5183799-1b40-43fc-9d47-250aef671a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:10.277433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5183799-1b40-43fc-9d47-250aef671a09 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:10.277714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5183799-1b40-43fc-9d47-250aef671a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:10.277986 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5183799-1b40-43fc-9d47-250aef671a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:10.287186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5183799-1b40-43fc-9d47-250aef671a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:10.288642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5183799-1b40-43fc-9d47-250aef671a09 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:10.298626 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1065/2168] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:10.663935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:10.797620 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c7b7d-3ec0-4125-bd64-fe8929df29c8 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:10.799389 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d91c7b7d-3ec0-4125-bd64-fe8929df29c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:10.813452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c7b7d-3ec0-4125-bd64-fe8929df29c8 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:10.818418 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:10.819723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:10.820105 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:10.820560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3 admin admin] PATH_INFO: `/v3/projects/f043fbc727b54a61b52cbc25444d0f3e` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:10.821807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f043fbc727b54a61b52cbc25444d0f3e)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:10.823804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:11.004067 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f043fbc727b54a61b52cbc25444d0f3e', 'request_id': 'req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:11.143454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f043fbc727b54a61b52cbc25444d0f3e', 'request_id': 'req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:11.151077 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f043fbc727b54a61b52cbc25444d0f3e', 'request_id': 'req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:11.161988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3 admin admin] The token cache is being invalidate because project f043fbc727b54a61b52cbc25444d0f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:08:11.162281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:11.162942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:11.165204 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1104/2169] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:08:10 2022] DELETE /identity/v3/projects/f043fbc727b54a61b52cbc25444d0f3e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:11.169146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5183799-1b40-43fc-9d47-250aef671a09 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:11.180042 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5183799-1b40-43fc-9d47-250aef671a09 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:11.257935 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b6e81-a5ab-4683-af39-2ea9ff5eefec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:11.258629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b6e81-a5ab-4683-af39-2ea9ff5eefec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:11.258913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b6e81-a5ab-4683-af39-2ea9ff5eefec admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:11.259190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b6e81-a5ab-4683-af39-2ea9ff5eefec admin admin] PATH_INFO: `/v3/users/cca6bb2ffa9c48e2849442e33be87e25` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:11.260851 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b6e81-a5ab-4683-af39-2ea9ff5eefec admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca6bb2ffa9c48e2849442e33be87e25)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:11.262527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b6e81-a5ab-4683-af39-2ea9ff5eefec admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:11.895134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c11b6e81-a5ab-4683-af39-2ea9ff5eefec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca6bb2ffa9c48e2849442e33be87e25'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:11.895796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c11b6e81-a5ab-4683-af39-2ea9ff5eefec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca6bb2ffa9c48e2849442e33be87e25'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:11.908435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c11b6e81-a5ab-4683-af39-2ea9ff5eefec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca6bb2ffa9c48e2849442e33be87e25'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:12.035193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c11b6e81-a5ab-4683-af39-2ea9ff5eefec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca6bb2ffa9c48e2849442e33be87e25'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:12.035830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c11b6e81-a5ab-4683-af39-2ea9ff5eefec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca6bb2ffa9c48e2849442e33be87e25'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:12.049685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1066/2170] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:08:11 2022] DELETE /identity/v3/users/cca6bb2ffa9c48e2849442e33be87e25 => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:12.069970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:12.521663 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:12.528785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:12.530273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:12.543264 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a339e6-5849-4bf2-9dd6-52c0b124eaa3 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:12.600261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411a756-da6c-4b1a-aabd-1411fb504df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:12.600937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411a756-da6c-4b1a-aabd-1411fb504df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:12.601222 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411a756-da6c-4b1a-aabd-1411fb504df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:12.601499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411a756-da6c-4b1a-aabd-1411fb504df6 admin admin] PATH_INFO: `/v3/projects/024bb9651a33400397bd06e966bccb57` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:12.602635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411a756-da6c-4b1a-aabd-1411fb504df6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=024bb9651a33400397bd06e966bccb57)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:12.604679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6411a756-da6c-4b1a-aabd-1411fb504df6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:12.881254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6411a756-da6c-4b1a-aabd-1411fb504df6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024bb9651a33400397bd06e966bccb57', 'request_id': 'req-6411a756-da6c-4b1a-aabd-1411fb504df6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:12.995013 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6411a756-da6c-4b1a-aabd-1411fb504df6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024bb9651a33400397bd06e966bccb57', 'request_id': 'req-6411a756-da6c-4b1a-aabd-1411fb504df6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:13.002489 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6411a756-da6c-4b1a-aabd-1411fb504df6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024bb9651a33400397bd06e966bccb57', 'request_id': 'req-6411a756-da6c-4b1a-aabd-1411fb504df6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:13.014061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6411a756-da6c-4b1a-aabd-1411fb504df6 admin admin] The token cache is being invalidate because project 024bb9651a33400397bd06e966bccb57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:08:13.014378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6411a756-da6c-4b1a-aabd-1411fb504df6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:13.015048 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6411a756-da6c-4b1a-aabd-1411fb504df6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:13.017337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1105/2171] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:08:12 2022] DELETE /identity/v3/projects/024bb9651a33400397bd06e966bccb57 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:13.021118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b6e81-a5ab-4683-af39-2ea9ff5eefec admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:13.025858 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c11b6e81-a5ab-4683-af39-2ea9ff5eefec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:13.041878 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b6e81-a5ab-4683-af39-2ea9ff5eefec admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:13.101061 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cf16f-70e0-4ad9-94f8-b6407cf1896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:13.101709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cf16f-70e0-4ad9-94f8-b6407cf1896c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:13.101996 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cf16f-70e0-4ad9-94f8-b6407cf1896c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:13.102268 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cf16f-70e0-4ad9-94f8-b6407cf1896c admin admin] PATH_INFO: `/v3/users/dc1a698ddf4f44c5b4b95a634a19aab9` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:13.103420 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cf16f-70e0-4ad9-94f8-b6407cf1896c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc1a698ddf4f44c5b4b95a634a19aab9)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:13.105393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cf16f-70e0-4ad9-94f8-b6407cf1896c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:13.349134 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7f9cf16f-70e0-4ad9-94f8-b6407cf1896c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc1a698ddf4f44c5b4b95a634a19aab9'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:13.350208 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7f9cf16f-70e0-4ad9-94f8-b6407cf1896c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc1a698ddf4f44c5b4b95a634a19aab9'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:13.367342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7f9cf16f-70e0-4ad9-94f8-b6407cf1896c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc1a698ddf4f44c5b4b95a634a19aab9'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:13.464314 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7f9cf16f-70e0-4ad9-94f8-b6407cf1896c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc1a698ddf4f44c5b4b95a634a19aab9'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:13.464976 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7f9cf16f-70e0-4ad9-94f8-b6407cf1896c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc1a698ddf4f44c5b4b95a634a19aab9'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:13.484068 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1067/2172] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:08:13 2022] DELETE /identity/v3/users/dc1a698ddf4f44c5b4b95a634a19aab9 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:13.762113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:14.056060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411a756-da6c-4b1a-aabd-1411fb504df6 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:14.056060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6411a756-da6c-4b1a-aabd-1411fb504df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:14.074141 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411a756-da6c-4b1a-aabd-1411fb504df6 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:14.136844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a9c37-848a-46d3-bc4f-177dfdc945c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:14.137399 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a9c37-848a-46d3-bc4f-177dfdc945c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:14.137678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a9c37-848a-46d3-bc4f-177dfdc945c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:14.137950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a9c37-848a-46d3-bc4f-177dfdc945c9 admin admin] PATH_INFO: `/v3/projects/50f75989559744a2a32d7a024f8daa29` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:14.139095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a9c37-848a-46d3-bc4f-177dfdc945c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f75989559744a2a32d7a024f8daa29)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:14.141055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a9c37-848a-46d3-bc4f-177dfdc945c9 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:14.272547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e02a9c37-848a-46d3-bc4f-177dfdc945c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f75989559744a2a32d7a024f8daa29', 'request_id': 'req-e02a9c37-848a-46d3-bc4f-177dfdc945c9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:14.367536 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e02a9c37-848a-46d3-bc4f-177dfdc945c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f75989559744a2a32d7a024f8daa29', 'request_id': 'req-e02a9c37-848a-46d3-bc4f-177dfdc945c9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:14.376289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e02a9c37-848a-46d3-bc4f-177dfdc945c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f75989559744a2a32d7a024f8daa29', 'request_id': 'req-e02a9c37-848a-46d3-bc4f-177dfdc945c9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:14.388506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e02a9c37-848a-46d3-bc4f-177dfdc945c9 admin admin] The token cache is being invalidate because project 50f75989559744a2a32d7a024f8daa29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:08:14.388761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e02a9c37-848a-46d3-bc4f-177dfdc945c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:14.389387 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e02a9c37-848a-46d3-bc4f-177dfdc945c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:14.391783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1106/2173] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:08:14 2022] DELETE /identity/v3/projects/50f75989559744a2a32d7a024f8daa29 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:14.396638 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca078be-029d-4b1b-8341-89a9bc2e900c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:14.397150 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca078be-029d-4b1b-8341-89a9bc2e900c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:14.397259 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca078be-029d-4b1b-8341-89a9bc2e900c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:14.419521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-aca078be-029d-4b1b-8341-89a9bc2e900c None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:14.422339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-aca078be-029d-4b1b-8341-89a9bc2e900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:14.495385 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1068/2174] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:14.503307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd226848-d580-4681-8e37-9f99ec510271 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:14.503978 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd226848-d580-4681-8e37-9f99ec510271 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:14.504326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd226848-d580-4681-8e37-9f99ec510271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:14.528167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-cd226848-d580-4681-8e37-9f99ec510271 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:14.529401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-cd226848-d580-4681-8e37-9f99ec510271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:14.538183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1107/2175] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:14.542664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca078be-029d-4b1b-8341-89a9bc2e900c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:14.553479 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca078be-029d-4b1b-8341-89a9bc2e900c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:14.558771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5a2fa-fb5e-41e5-9993-637c13ca6018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:14.559482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5a2fa-fb5e-41e5-9993-637c13ca6018 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:14.559770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5a2fa-fb5e-41e5-9993-637c13ca6018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:14.560082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5a2fa-fb5e-41e5-9993-637c13ca6018 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:14.560994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5a2fa-fb5e-41e5-9993-637c13ca6018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:08:14.561136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5a2fa-fb5e-41e5-9993-637c13ca6018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:14.562701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5a2fa-fb5e-41e5-9993-637c13ca6018 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:14.596276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1069/2176] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:08:14.607521 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd226848-d580-4681-8e37-9f99ec510271 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:14.620193 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd226848-d580-4681-8e37-9f99ec510271 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:14.625237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa85c85-3b6c-4454-94fb-6cd14b4c4d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:14.626434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa85c85-3b6c-4454-94fb-6cd14b4c4d4a admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:14.626434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa85c85-3b6c-4454-94fb-6cd14b4c4d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:14.626668 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa85c85-3b6c-4454-94fb-6cd14b4c4d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:14.627204 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa85c85-3b6c-4454-94fb-6cd14b4c4d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:14.629231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa85c85-3b6c-4454-94fb-6cd14b4c4d4a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:14.797895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1108/2177] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:08:14 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:14.799193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5a2fa-fb5e-41e5-9993-637c13ca6018 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:14.810702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5a2fa-fb5e-41e5-9993-637c13ca6018 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:14.868276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:14.919434 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0534ce-22b3-4d29-bab9-611e8e74ee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:14.920094 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0534ce-22b3-4d29-bab9-611e8e74ee0f admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:14.920378 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0534ce-22b3-4d29-bab9-611e8e74ee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:14.920650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0534ce-22b3-4d29-bab9-611e8e74ee0f admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:14.921301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0534ce-22b3-4d29-bab9-611e8e74ee0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:14.923219 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0534ce-22b3-4d29-bab9-611e8e74ee0f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:15.036941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1070/2178] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:08:14 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:15.042077 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa85c85-3b6c-4454-94fb-6cd14b4c4d4a admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:15.053570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa85c85-3b6c-4454-94fb-6cd14b4c4d4a admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:15.058743 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfec27e-7949-43df-af02-40de2c135ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:15.059562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfec27e-7949-43df-af02-40de2c135ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:15.060106 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfec27e-7949-43df-af02-40de2c135ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:15.060382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfec27e-7949-43df-af02-40de2c135ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:15.061188 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfec27e-7949-43df-af02-40de2c135ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:15.062952 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfec27e-7949-43df-af02-40de2c135ae8 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:15.076219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1109/2179] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:15.080826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0534ce-22b3-4d29-bab9-611e8e74ee0f admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:15.092216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0534ce-22b3-4d29-bab9-611e8e74ee0f admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:15.099146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f674819-521c-4a1f-b97d-0334f89eee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:15.099146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f674819-521c-4a1f-b97d-0334f89eee3f admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:15.099146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f674819-521c-4a1f-b97d-0334f89eee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:15.099146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f674819-521c-4a1f-b97d-0334f89eee3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:15.100046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f674819-521c-4a1f-b97d-0334f89eee3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:15.101824 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f674819-521c-4a1f-b97d-0334f89eee3f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:15.120325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1071/2180] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:15.122948 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfec27e-7949-43df-af02-40de2c135ae8 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:15.134772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfec27e-7949-43df-af02-40de2c135ae8 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:15.141729 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ec7d8-3f2f-4535-8528-9027256734d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:15.142843 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ec7d8-3f2f-4535-8528-9027256734d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:15.143296 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ec7d8-3f2f-4535-8528-9027256734d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:15.143733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ec7d8-3f2f-4535-8528-9027256734d7 admin admin] PATH_INFO: `/v3/projects/8a1d1a6e0e5d4ac794b28b13ad85127f/users/ad496f2db4a0461fb997585dc8a0e4d8/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:15.167733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ec7d8-3f2f-4535-8528-9027256734d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1d1a6e0e5d4ac794b28b13ad85127f, user_id=ad496f2db4a0461fb997585dc8a0e4d8, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:15.171291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ec7d8-3f2f-4535-8528-9027256734d7 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:15.270891 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1110/2181] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:08:15 2022] PUT /identity/v3/projects/8a1d1a6e0e5d4ac794b28b13ad85127f/users/ad496f2db4a0461fb997585dc8a0e4d8/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:15.282902 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba6d6a-4f83-44cc-99f5-8ae8c6e64f65 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:15.283594 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba6d6a-4f83-44cc-99f5-8ae8c6e64f65 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:15.284116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba6d6a-4f83-44cc-99f5-8ae8c6e64f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:15.325360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-2dba6d6a-4f83-44cc-99f5-8ae8c6e64f65 None None] MFA Rules not processed for user `ad496f2db4a0461fb997585dc8a0e4d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:15.328380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2dba6d6a-4f83-44cc-99f5-8ae8c6e64f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:15.412216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1072/2182] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:15.428907 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ec7d8-3f2f-4535-8528-9027256734d7 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:15.431229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e91ec7d8-3f2f-4535-8528-9027256734d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:15.554617 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ec7d8-3f2f-4535-8528-9027256734d7 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:15.558763 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0961472-ea8f-4210-a3ce-f63b1d7b4d63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:15.559647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0961472-ea8f-4210-a3ce-f63b1d7b4d63 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:15.560011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0961472-ea8f-4210-a3ce-f63b1d7b4d63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:15.560391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0961472-ea8f-4210-a3ce-f63b1d7b4d63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:15.575953 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0961472-ea8f-4210-a3ce-f63b1d7b4d63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:15.578633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0961472-ea8f-4210-a3ce-f63b1d7b4d63 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:15.611796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1111/2183] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:15.635287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba6d6a-4f83-44cc-99f5-8ae8c6e64f65 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:15.734064 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba6d6a-4f83-44cc-99f5-8ae8c6e64f65 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:15.739275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b373b13-3e77-4cc4-ab25-59d7adc13101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:15.740177 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b373b13-3e77-4cc4-ab25-59d7adc13101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:15.740717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b373b13-3e77-4cc4-ab25-59d7adc13101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:15.741139 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b373b13-3e77-4cc4-ab25-59d7adc13101 admin admin] PATH_INFO: `/v3/users/ad496f2db4a0461fb997585dc8a0e4d8` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:15.742609 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b373b13-3e77-4cc4-ab25-59d7adc13101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad496f2db4a0461fb997585dc8a0e4d8)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:15.745664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b373b13-3e77-4cc4-ab25-59d7adc13101 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:16.035376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7b373b13-3e77-4cc4-ab25-59d7adc13101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad496f2db4a0461fb997585dc8a0e4d8'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:16.036597 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7b373b13-3e77-4cc4-ab25-59d7adc13101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad496f2db4a0461fb997585dc8a0e4d8'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:16.052088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7b373b13-3e77-4cc4-ab25-59d7adc13101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad496f2db4a0461fb997585dc8a0e4d8'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:16.162517 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7b373b13-3e77-4cc4-ab25-59d7adc13101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad496f2db4a0461fb997585dc8a0e4d8'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:16.163733 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7b373b13-3e77-4cc4-ab25-59d7adc13101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad496f2db4a0461fb997585dc8a0e4d8'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:16.191811 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1073/2184] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:08:15 2022] DELETE /identity/v3/users/ad496f2db4a0461fb997585dc8a0e4d8 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:16.196677 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f6a2d-e301-48c6-b881-8fc70899626e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:16.197691 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f6a2d-e301-48c6-b881-8fc70899626e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:16.198180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f6a2d-e301-48c6-b881-8fc70899626e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:16.227048 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-b52f6a2d-e301-48c6-b881-8fc70899626e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:16.229504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b52f6a2d-e301-48c6-b881-8fc70899626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:16.312235 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1112/2185] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:08:16.342256 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b373b13-3e77-4cc4-ab25-59d7adc13101 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:16.343890 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7b373b13-3e77-4cc4-ab25-59d7adc13101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:16.411856 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b373b13-3e77-4cc4-ab25-59d7adc13101 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:16.419126 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3eb495-80e4-42a1-a8ae-0b21331241c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:16.419922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eb495-80e4-42a1-a8ae-0b21331241c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:16.420175 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eb495-80e4-42a1-a8ae-0b21331241c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:16.420448 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eb495-80e4-42a1-a8ae-0b21331241c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:16.432188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3eb495-80e4-42a1-a8ae-0b21331241c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:16.434395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3eb495-80e4-42a1-a8ae-0b21331241c0 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:16.450710 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1074/2186] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:17.214317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f6a2d-e301-48c6-b881-8fc70899626e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:17.215822 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b52f6a2d-e301-48c6-b881-8fc70899626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:17.231119 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f6a2d-e301-48c6-b881-8fc70899626e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:17.236558 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14671f1c-3ead-4f18-91b1-36125cb1db38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:17.237137 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14671f1c-3ead-4f18-91b1-36125cb1db38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:17.237417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14671f1c-3ead-4f18-91b1-36125cb1db38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:17.237685 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14671f1c-3ead-4f18-91b1-36125cb1db38 admin admin] PATH_INFO: `/v3/projects/8a1d1a6e0e5d4ac794b28b13ad85127f` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:17.239043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14671f1c-3ead-4f18-91b1-36125cb1db38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a1d1a6e0e5d4ac794b28b13ad85127f)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:17.241294 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14671f1c-3ead-4f18-91b1-36125cb1db38 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:17.418240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-14671f1c-3ead-4f18-91b1-36125cb1db38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1d1a6e0e5d4ac794b28b13ad85127f', 'request_id': 'req-14671f1c-3ead-4f18-91b1-36125cb1db38'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:17.464366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:17.522745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-14671f1c-3ead-4f18-91b1-36125cb1db38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1d1a6e0e5d4ac794b28b13ad85127f', 'request_id': 'req-14671f1c-3ead-4f18-91b1-36125cb1db38'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:17.529607 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-14671f1c-3ead-4f18-91b1-36125cb1db38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1d1a6e0e5d4ac794b28b13ad85127f', 'request_id': 'req-14671f1c-3ead-4f18-91b1-36125cb1db38'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:17.540114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-14671f1c-3ead-4f18-91b1-36125cb1db38 admin admin] The token cache is being invalidate because project 8a1d1a6e0e5d4ac794b28b13ad85127f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:08:17.540406 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-14671f1c-3ead-4f18-91b1-36125cb1db38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:17.541588 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-14671f1c-3ead-4f18-91b1-36125cb1db38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:17.543353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1113/2187] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:08:17 2022] DELETE /identity/v3/projects/8a1d1a6e0e5d4ac794b28b13ad85127f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:19.328511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:20.686667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:21.778663 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:22.024595 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:23.441347 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:24.047378 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:25.058731 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:25.921307 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:26.847290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:28.060944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:29.075641 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:30.195377 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:30.269934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:31.607156 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:32.327467 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:33.543990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:33.625042 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3eb495-80e4-42a1-a8ae-0b21331241c0 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:33.626442 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4f3eb495-80e4-42a1-a8ae-0b21331241c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:33.641650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3eb495-80e4-42a1-a8ae-0b21331241c0 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:33.700536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df09c8b-186e-4edb-8075-230565101446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:33.701172 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df09c8b-186e-4edb-8075-230565101446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:33.701455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df09c8b-186e-4edb-8075-230565101446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:33.701730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df09c8b-186e-4edb-8075-230565101446 admin admin] PATH_INFO: `/v3/users/8a5aa026fdb44419b7a938acb2cbe980` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:33.702846 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df09c8b-186e-4edb-8075-230565101446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5aa026fdb44419b7a938acb2cbe980)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:33.704798 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df09c8b-186e-4edb-8075-230565101446 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:33.784034 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:34.021807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7df09c8b-186e-4edb-8075-230565101446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5aa026fdb44419b7a938acb2cbe980'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:34.022447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7df09c8b-186e-4edb-8075-230565101446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5aa026fdb44419b7a938acb2cbe980'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:34.034275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7df09c8b-186e-4edb-8075-230565101446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5aa026fdb44419b7a938acb2cbe980'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:34.189411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7df09c8b-186e-4edb-8075-230565101446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5aa026fdb44419b7a938acb2cbe980'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:34.190070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7df09c8b-186e-4edb-8075-230565101446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5aa026fdb44419b7a938acb2cbe980'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:34.205646 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1075/2188] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:08:33 2022] DELETE /identity/v3/users/8a5aa026fdb44419b7a938acb2cbe980 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:34.210382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75447739-5eba-4118-9e71-bb140bd76ed7 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:34.210671 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75447739-5eba-4118-9e71-bb140bd76ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:34.210951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75447739-5eba-4118-9e71-bb140bd76ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:34.231629 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-75447739-5eba-4118-9e71-bb140bd76ed7 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:34.232990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-75447739-5eba-4118-9e71-bb140bd76ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:34.298947 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1114/2189] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:34.309538 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df09c8b-186e-4edb-8075-230565101446 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:34.311108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7df09c8b-186e-4edb-8075-230565101446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:34.377841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df09c8b-186e-4edb-8075-230565101446 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:34.387933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d8b9e-41fc-4377-b601-079602c3a38f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:34.400533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d8b9e-41fc-4377-b601-079602c3a38f service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:34.400533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d8b9e-41fc-4377-b601-079602c3a38f service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:34.400533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d8b9e-41fc-4377-b601-079602c3a38f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:34.400533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d8b9e-41fc-4377-b601-079602c3a38f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:34.401907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d8b9e-41fc-4377-b601-079602c3a38f service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:34.412440 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1076/2190] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:34.441348 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:34.964015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75447739-5eba-4118-9e71-bb140bd76ed7 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:34.966071 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-75447739-5eba-4118-9e71-bb140bd76ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:34.982312 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75447739-5eba-4118-9e71-bb140bd76ed7 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:34.987645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc228a-00db-4c15-be7e-4a7f842f41d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:34.988373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc228a-00db-4c15-be7e-4a7f842f41d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:34.988647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc228a-00db-4c15-be7e-4a7f842f41d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:34.988925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc228a-00db-4c15-be7e-4a7f842f41d1 admin admin] PATH_INFO: `/v3/projects/7b4457f5d6b442c0b6caf75f760baccb` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:34.990078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc228a-00db-4c15-be7e-4a7f842f41d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4457f5d6b442c0b6caf75f760baccb)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:34.992040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc228a-00db-4c15-be7e-4a7f842f41d1 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:35.145714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-62dc228a-00db-4c15-be7e-4a7f842f41d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4457f5d6b442c0b6caf75f760baccb', 'request_id': 'req-62dc228a-00db-4c15-be7e-4a7f842f41d1'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:35.309511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-62dc228a-00db-4c15-be7e-4a7f842f41d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4457f5d6b442c0b6caf75f760baccb', 'request_id': 'req-62dc228a-00db-4c15-be7e-4a7f842f41d1'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:35.316440 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-62dc228a-00db-4c15-be7e-4a7f842f41d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4457f5d6b442c0b6caf75f760baccb', 'request_id': 'req-62dc228a-00db-4c15-be7e-4a7f842f41d1'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:35.327624 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-62dc228a-00db-4c15-be7e-4a7f842f41d1 admin admin] The token cache is being invalidate because project 7b4457f5d6b442c0b6caf75f760baccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:08:35.327945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-62dc228a-00db-4c15-be7e-4a7f842f41d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:35.328596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-62dc228a-00db-4c15-be7e-4a7f842f41d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:08:35.330073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1115/2191] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:08:34 2022] DELETE /identity/v3/projects/7b4457f5d6b442c0b6caf75f760baccb => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:08:35.334984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb74c3f-2cd6-48d8-94a5-17c60e13a840 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:35.335468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb74c3f-2cd6-48d8-94a5-17c60e13a840 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:35.335579 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb74c3f-2cd6-48d8-94a5-17c60e13a840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:35.355646 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-1cb74c3f-2cd6-48d8-94a5-17c60e13a840 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:35.357020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1cb74c3f-2cd6-48d8-94a5-17c60e13a840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:35.413613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:35.421267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1077/2192] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:35.430458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd0e7f-7a75-4a94-96a4-eadd7a4b1cb4 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:35.430739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd0e7f-7a75-4a94-96a4-eadd7a4b1cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:35.431511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd0e7f-7a75-4a94-96a4-eadd7a4b1cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:35.453373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1edd0e7f-7a75-4a94-96a4-eadd7a4b1cb4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:35.454647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1edd0e7f-7a75-4a94-96a4-eadd7a4b1cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:35.462949 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1116/2193] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:35.467505 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb74c3f-2cd6-48d8-94a5-17c60e13a840 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:35.477489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb74c3f-2cd6-48d8-94a5-17c60e13a840 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:35.482526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b846a03-2fc2-4513-96c9-72b47b54c076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:35.483168 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b846a03-2fc2-4513-96c9-72b47b54c076 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:35.483442 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b846a03-2fc2-4513-96c9-72b47b54c076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:35.483741 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b846a03-2fc2-4513-96c9-72b47b54c076 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:35.484503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b846a03-2fc2-4513-96c9-72b47b54c076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:08:35.484830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b846a03-2fc2-4513-96c9-72b47b54c076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:35.487417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b846a03-2fc2-4513-96c9-72b47b54c076 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:35.503196 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1078/2194] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:08:35.506433 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd0e7f-7a75-4a94-96a4-eadd7a4b1cb4 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:35.526425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd0e7f-7a75-4a94-96a4-eadd7a4b1cb4 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:35.534112 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12734b3e-9d7e-4c71-9b5d-13feee2afc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:35.534779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12734b3e-9d7e-4c71-9b5d-13feee2afc80 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:35.535060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12734b3e-9d7e-4c71-9b5d-13feee2afc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:35.535829 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12734b3e-9d7e-4c71-9b5d-13feee2afc80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:35.536084 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12734b3e-9d7e-4c71-9b5d-13feee2afc80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:35.538272 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12734b3e-9d7e-4c71-9b5d-13feee2afc80 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:35.654698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1117/2195] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:08:35 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:35.659301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b846a03-2fc2-4513-96c9-72b47b54c076 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:35.669828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b846a03-2fc2-4513-96c9-72b47b54c076 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:35.732455 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2269e5-7f81-4990-9db7-801ce033082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:35.733841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2269e5-7f81-4990-9db7-801ce033082c admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:35.733841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2269e5-7f81-4990-9db7-801ce033082c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:35.733841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2269e5-7f81-4990-9db7-801ce033082c admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:35.734271 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2269e5-7f81-4990-9db7-801ce033082c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:35.736321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2269e5-7f81-4990-9db7-801ce033082c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:35.897389 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1079/2196] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:08:35 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:08:35.898963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12734b3e-9d7e-4c71-9b5d-13feee2afc80 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:35.910626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12734b3e-9d7e-4c71-9b5d-13feee2afc80 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:35.915288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2be447-ed0a-4027-953a-0f013c0b6b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:35.915929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2be447-ed0a-4027-953a-0f013c0b6b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:35.916222 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2be447-ed0a-4027-953a-0f013c0b6b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:35.916504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2be447-ed0a-4027-953a-0f013c0b6b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:35.917150 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2be447-ed0a-4027-953a-0f013c0b6b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:35.918760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2be447-ed0a-4027-953a-0f013c0b6b2b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:35.932942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1118/2197] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:35.940508 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2269e5-7f81-4990-9db7-801ce033082c admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:35.951334 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2269e5-7f81-4990-9db7-801ce033082c admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:35.956101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f02068-00a0-47ae-b527-f29d670e3b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:35.956714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02068-00a0-47ae-b527-f29d670e3b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:35.956999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02068-00a0-47ae-b527-f29d670e3b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:35.957274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02068-00a0-47ae-b527-f29d670e3b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:35.957918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f02068-00a0-47ae-b527-f29d670e3b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:35.959547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f02068-00a0-47ae-b527-f29d670e3b4c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:35.971152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1080/2198] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:08:35.975391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2be447-ed0a-4027-953a-0f013c0b6b2b admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:35.985966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2be447-ed0a-4027-953a-0f013c0b6b2b admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:35.990563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5674bc-2c09-435c-8580-28bcd623bea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:35.991208 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5674bc-2c09-435c-8580-28bcd623bea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:35.991490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5674bc-2c09-435c-8580-28bcd623bea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:35.991762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5674bc-2c09-435c-8580-28bcd623bea4 admin admin] PATH_INFO: `/v3/projects/9b6bd42da594408282a1ca16bb4458ec/users/31cf7fd1e75b4276a0daa603226df084/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:36.003181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:36.008293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5674bc-2c09-435c-8580-28bcd623bea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6bd42da594408282a1ca16bb4458ec, user_id=31cf7fd1e75b4276a0daa603226df084, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:36.011152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5674bc-2c09-435c-8580-28bcd623bea4 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:36.167839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1119/2199] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:08:35 2022] PUT /identity/v3/projects/9b6bd42da594408282a1ca16bb4458ec/users/31cf7fd1e75b4276a0daa603226df084/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:08:36.173296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebdb3a-fd8e-4357-807a-05c1e19766ec None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:36.173717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebdb3a-fd8e-4357-807a-05c1e19766ec None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:36.174003 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebdb3a-fd8e-4357-807a-05c1e19766ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:36.197164 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-77ebdb3a-fd8e-4357-807a-05c1e19766ec None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:36.201473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-77ebdb3a-fd8e-4357-807a-05c1e19766ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:36.264281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1081/2200] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:08:36.274574 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5674bc-2c09-435c-8580-28bcd623bea4 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:36.276362 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-de5674bc-2c09-435c-8580-28bcd623bea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:36.340026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5674bc-2c09-435c-8580-28bcd623bea4 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:36.343791 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0d4d0-f815-434c-9a01-eb4315affa86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:36.344429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0d4d0-f815-434c-9a01-eb4315affa86 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:36.344714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0d4d0-f815-434c-9a01-eb4315affa86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:36.344989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0d4d0-f815-434c-9a01-eb4315affa86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:36.354976 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0d4d0-f815-434c-9a01-eb4315affa86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:36.356455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0d4d0-f815-434c-9a01-eb4315affa86 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:36.370446 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1120/2201] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:36.676170 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:37.378561 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:38.195901 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e765-7fd2-4d18-94c3-8cdec690c566 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:38.196520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e765-7fd2-4d18-94c3-8cdec690c566 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:38.197296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623e765-7fd2-4d18-94c3-8cdec690c566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:38.226238 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b623e765-7fd2-4d18-94c3-8cdec690c566 None None] MFA Rules not processed for user `31cf7fd1e75b4276a0daa603226df084`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:38.227568 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b623e765-7fd2-4d18-94c3-8cdec690c566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:38.303639 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1082/2202] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:38.334410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0d4d0-f815-434c-9a01-eb4315affa86 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:38.334410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2da0d4d0-f815-434c-9a01-eb4315affa86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:38.373087 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0d4d0-f815-434c-9a01-eb4315affa86 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:38.377116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b088e2-d060-4693-8db4-0cba32ff71b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:38.377722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b088e2-d060-4693-8db4-0cba32ff71b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:38.378007 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b088e2-d060-4693-8db4-0cba32ff71b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:38.378294 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b088e2-d060-4693-8db4-0cba32ff71b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:38.387134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b088e2-d060-4693-8db4-0cba32ff71b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:38.388646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b088e2-d060-4693-8db4-0cba32ff71b9 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:38.397284 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1121/2203] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:39.426150 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:39.595591 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623e765-7fd2-4d18-94c3-8cdec690c566 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:08:39.606060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623e765-7fd2-4d18-94c3-8cdec690c566 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:08:39.609809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830bc7ad-0518-462d-9f6a-ab6ca8b8b08f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:08:39.610396 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bc7ad-0518-462d-9f6a-ab6ca8b8b08f service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:39.610723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bc7ad-0518-462d-9f6a-ab6ca8b8b08f service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:39.610960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bc7ad-0518-462d-9f6a-ab6ca8b8b08f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:39.612863 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-830bc7ad-0518-462d-9f6a-ab6ca8b8b08f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:39.677145 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830bc7ad-0518-462d-9f6a-ab6ca8b8b08f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:08:39.678498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830bc7ad-0518-462d-9f6a-ab6ca8b8b08f service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:08:39.689188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1083/2204] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:08:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:08:39.751092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:40.304324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:41.501617 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc123a3-3169-427c-9bdd-3188af738d37 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:08:41.502151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc123a3-3169-427c-9bdd-3188af738d37 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:08:41.502229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc123a3-3169-427c-9bdd-3188af738d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:08:41.529150 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-2fc123a3-3169-427c-9bdd-3188af738d37 None None] MFA Rules not processed for user `31cf7fd1e75b4276a0daa603226df084`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:08:41.530371 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2fc123a3-3169-427c-9bdd-3188af738d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:08:41.537977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1122/2205] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:08:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:08:41.727241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:42.041394 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:43.236076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:44.264142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:45.152345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:45.573289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:45.926956 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:47.115756 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:47.675573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:49.007268 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:49.207285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:50.150206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:50.647445 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:51.407279 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:51.972725 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:52.081251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:52.555214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:52.824086 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:52.972768 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:53.447797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:53.864270 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:54.081762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:54.853379 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:55.315445 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:56.207237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:56.298860 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:57.058413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:57.978458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:59.400292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:00.389972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:00.573461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:02.167432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:02.287451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:03.492927 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:03.807742 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:05.213581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:05.304037 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:05.400165 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e864ae8-75f2-426d-970e-08a217e3a9d4 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:05.400549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e864ae8-75f2-426d-970e-08a217e3a9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:05.400899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e864ae8-75f2-426d-970e-08a217e3a9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:05.420961 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-3e864ae8-75f2-426d-970e-08a217e3a9d4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:05.422179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-3e864ae8-75f2-426d-970e-08a217e3a9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:05.431024 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1084/2206] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Sep 1 14:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:05.451698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc123a3-3169-427c-9bdd-3188af738d37 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:05.453225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2fc123a3-3169-427c-9bdd-3188af738d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:05.546928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc123a3-3169-427c-9bdd-3188af738d37 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:05.552599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa6123-9c48-4321-a1e9-e3014b8b7545 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:05.553216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa6123-9c48-4321-a1e9-e3014b8b7545 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:05.553502 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa6123-9c48-4321-a1e9-e3014b8b7545 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:05.553784 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa6123-9c48-4321-a1e9-e3014b8b7545 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:05.562761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa6123-9c48-4321-a1e9-e3014b8b7545 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:05.564340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa6123-9c48-4321-a1e9-e3014b8b7545 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:05.576990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1123/2207] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:05.659494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:05.966862 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:06.218746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:06.544604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:06.618840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:06.818864 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:06.846789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:06.989721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:07.023938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:07.064042 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:07.195491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:07.253030 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:07.315548 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:08.041243 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:08.081642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:08.276044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:08.355776 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:08.658755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:08.773207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:09.487335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:10.155743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:10.486910 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:10.619100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:12.424731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd40d9-7287-4a30-8ce3-fe221c32fc07 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:12.425432 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd40d9-7287-4a30-8ce3-fe221c32fc07 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:12.425432 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd40d9-7287-4a30-8ce3-fe221c32fc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:12.448610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-27cd40d9-7287-4a30-8ce3-fe221c32fc07 None None] MFA Rules not processed for user `31cf7fd1e75b4276a0daa603226df084`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:12.450468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-27cd40d9-7287-4a30-8ce3-fe221c32fc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:12.458367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1085/2208] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:14.137809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa6123-9c48-4321-a1e9-e3014b8b7545 service nova] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:14.139788 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-72fa6123-9c48-4321-a1e9-e3014b8b7545 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:14.153274 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa6123-9c48-4321-a1e9-e3014b8b7545 service nova] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:14.158109 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed24cb-715a-491d-84b0-fc455ef9e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:14.158745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed24cb-715a-491d-84b0-fc455ef9e24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:14.159031 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed24cb-715a-491d-84b0-fc455ef9e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:14.159344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed24cb-715a-491d-84b0-fc455ef9e24d admin admin] PATH_INFO: `/v3/users/5b01968819ec4db0b55b1bb570a6294b` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:14.160480 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed24cb-715a-491d-84b0-fc455ef9e24d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b01968819ec4db0b55b1bb570a6294b)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:14.162415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed24cb-715a-491d-84b0-fc455ef9e24d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:14.501199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1fed24cb-715a-491d-84b0-fc455ef9e24d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b01968819ec4db0b55b1bb570a6294b'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:14.513622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1fed24cb-715a-491d-84b0-fc455ef9e24d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b01968819ec4db0b55b1bb570a6294b'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:14.755758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1fed24cb-715a-491d-84b0-fc455ef9e24d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b01968819ec4db0b55b1bb570a6294b'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:14.769313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1fed24cb-715a-491d-84b0-fc455ef9e24d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b01968819ec4db0b55b1bb570a6294b'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:14.769313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1fed24cb-715a-491d-84b0-fc455ef9e24d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b01968819ec4db0b55b1bb570a6294b'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:14.771181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1124/2209] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:09:14 2022] DELETE /identity/v3/users/5b01968819ec4db0b55b1bb570a6294b => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:09:14.905464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fd0a4-833f-4e31-919b-5225e794e0b0 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:14.906006 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fd0a4-833f-4e31-919b-5225e794e0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:14.906006 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fd0a4-833f-4e31-919b-5225e794e0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:14.927158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-5b0fd0a4-833f-4e31-919b-5225e794e0b0 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:14.928394 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-5b0fd0a4-833f-4e31-919b-5225e794e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:14.941796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:14.993204 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1086/2210] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Sep 1 14:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:15.015482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed24cb-715a-491d-84b0-fc455ef9e24d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:15.016961 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1fed24cb-715a-491d-84b0-fc455ef9e24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:15.055850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fd0a4-833f-4e31-919b-5225e794e0b0 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:15.062274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-5b0fd0a4-833f-4e31-919b-5225e794e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:15.080055 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fd0a4-833f-4e31-919b-5225e794e0b0 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:15.091347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e69195-eee6-47bd-94c8-94087789bbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:15.092054 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e69195-eee6-47bd-94c8-94087789bbc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:15.092345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e69195-eee6-47bd-94c8-94087789bbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:15.092626 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e69195-eee6-47bd-94c8-94087789bbc5 admin admin] PATH_INFO: `/v3/projects/0077658dfd8f45de8f0fd16fccc486ee` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:15.093767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e69195-eee6-47bd-94c8-94087789bbc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0077658dfd8f45de8f0fd16fccc486ee)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:15.097638 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e69195-eee6-47bd-94c8-94087789bbc5 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:15.132712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed24cb-715a-491d-84b0-fc455ef9e24d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:15.138240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a0132-cccf-4c01-b9e3-7814e507d8d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:15.138894 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a0132-cccf-4c01-b9e3-7814e507d8d5 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:15.139173 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a0132-cccf-4c01-b9e3-7814e507d8d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:15.139442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a0132-cccf-4c01-b9e3-7814e507d8d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:15.148443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a0132-cccf-4c01-b9e3-7814e507d8d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:15.150764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a0132-cccf-4c01-b9e3-7814e507d8d5 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:15.160999 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1125/2211] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:15.249380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-37e69195-eee6-47bd-94c8-94087789bbc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0077658dfd8f45de8f0fd16fccc486ee', 'request_id': 'req-37e69195-eee6-47bd-94c8-94087789bbc5'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:15.256234 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-37e69195-eee6-47bd-94c8-94087789bbc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0077658dfd8f45de8f0fd16fccc486ee', 'request_id': 'req-37e69195-eee6-47bd-94c8-94087789bbc5'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:15.384424 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-37e69195-eee6-47bd-94c8-94087789bbc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0077658dfd8f45de8f0fd16fccc486ee', 'request_id': 'req-37e69195-eee6-47bd-94c8-94087789bbc5'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:15.396966 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-37e69195-eee6-47bd-94c8-94087789bbc5 admin admin] The token cache is being invalidate because project 0077658dfd8f45de8f0fd16fccc486ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:09:15.401974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-37e69195-eee6-47bd-94c8-94087789bbc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:15.401974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-37e69195-eee6-47bd-94c8-94087789bbc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:15.401974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1087/2212] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:09:15 2022] DELETE /identity/v3/projects/0077658dfd8f45de8f0fd16fccc486ee => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:09:15.404326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a0132-cccf-4c01-b9e3-7814e507d8d5 service nova] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:15.414496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a0132-cccf-4c01-b9e3-7814e507d8d5 service nova] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:15.459768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:15.478020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014886b-21e4-4923-8e91-a70cb195dc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:15.482273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014886b-21e4-4923-8e91-a70cb195dc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:15.482273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014886b-21e4-4923-8e91-a70cb195dc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:15.482273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014886b-21e4-4923-8e91-a70cb195dc4d admin admin] PATH_INFO: `/v3/users/a4bbaccbeb7e4dfe9dae02046591a05e` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:15.482273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014886b-21e4-4923-8e91-a70cb195dc4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4bbaccbeb7e4dfe9dae02046591a05e)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:15.482640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014886b-21e4-4923-8e91-a70cb195dc4d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:15.746428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1014886b-21e4-4923-8e91-a70cb195dc4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4bbaccbeb7e4dfe9dae02046591a05e'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:15.758229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1014886b-21e4-4923-8e91-a70cb195dc4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4bbaccbeb7e4dfe9dae02046591a05e'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:15.892334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1014886b-21e4-4923-8e91-a70cb195dc4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4bbaccbeb7e4dfe9dae02046591a05e'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:15.900412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1014886b-21e4-4923-8e91-a70cb195dc4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4bbaccbeb7e4dfe9dae02046591a05e'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:15.905188 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1014886b-21e4-4923-8e91-a70cb195dc4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4bbaccbeb7e4dfe9dae02046591a05e'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:15.907181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1126/2213] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:09:15 2022] DELETE /identity/v3/users/a4bbaccbeb7e4dfe9dae02046591a05e => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:09:16.207829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e69195-eee6-47bd-94c8-94087789bbc5 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:16.207829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-37e69195-eee6-47bd-94c8-94087789bbc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:16.218252 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e69195-eee6-47bd-94c8-94087789bbc5 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:16.276636 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b4b15-7645-4333-8dd1-07d2733effac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:16.277197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b4b15-7645-4333-8dd1-07d2733effac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:16.277480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b4b15-7645-4333-8dd1-07d2733effac admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:16.277753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b4b15-7645-4333-8dd1-07d2733effac admin admin] PATH_INFO: `/v3/projects/62dd59a85c524f9e95922c9aa44b24b7` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:16.278867 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b4b15-7645-4333-8dd1-07d2733effac admin admin] RBAC: Authorizing `identity:delete_project(project_id=62dd59a85c524f9e95922c9aa44b24b7)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:16.280817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b4b15-7645-4333-8dd1-07d2733effac admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:16.450727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:16.454663 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2d6b4b15-7645-4333-8dd1-07d2733effac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62dd59a85c524f9e95922c9aa44b24b7', 'request_id': 'req-2d6b4b15-7645-4333-8dd1-07d2733effac'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:16.460137 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2d6b4b15-7645-4333-8dd1-07d2733effac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62dd59a85c524f9e95922c9aa44b24b7', 'request_id': 'req-2d6b4b15-7645-4333-8dd1-07d2733effac'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:16.572574 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2d6b4b15-7645-4333-8dd1-07d2733effac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62dd59a85c524f9e95922c9aa44b24b7', 'request_id': 'req-2d6b4b15-7645-4333-8dd1-07d2733effac'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:16.585104 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2d6b4b15-7645-4333-8dd1-07d2733effac admin admin] The token cache is being invalidate because project 62dd59a85c524f9e95922c9aa44b24b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:09:16.585405 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2d6b4b15-7645-4333-8dd1-07d2733effac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:16.586075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2d6b4b15-7645-4333-8dd1-07d2733effac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:16.588388 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1088/2214] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:09:16 2022] DELETE /identity/v3/projects/62dd59a85c524f9e95922c9aa44b24b7 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:09:16.593521 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef40c1-c6ca-4085-88a4-d70280380587 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:16.594029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef40c1-c6ca-4085-88a4-d70280380587 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:16.594245 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef40c1-c6ca-4085-88a4-d70280380587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:16.614925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-07ef40c1-c6ca-4085-88a4-d70280380587 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:16.616228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-07ef40c1-c6ca-4085-88a4-d70280380587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:16.706482 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1127/2215] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:16.709669 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ffa1d-574c-428f-b214-94db3097bc25 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:16.710225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ffa1d-574c-428f-b214-94db3097bc25 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:16.710976 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ffa1d-574c-428f-b214-94db3097bc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:16.735921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-0b6ffa1d-574c-428f-b214-94db3097bc25 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:16.737222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-0b6ffa1d-574c-428f-b214-94db3097bc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:16.745624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1089/2216] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:16.749886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef40c1-c6ca-4085-88a4-d70280380587 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:16.764851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef40c1-c6ca-4085-88a4-d70280380587 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:16.774882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d5e57-e4b8-4079-9d90-17037048ffe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:16.774882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d5e57-e4b8-4079-9d90-17037048ffe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:16.774882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d5e57-e4b8-4079-9d90-17037048ffe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:16.774882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d5e57-e4b8-4079-9d90-17037048ffe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:16.775284 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d5e57-e4b8-4079-9d90-17037048ffe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:09:16.775284 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d5e57-e4b8-4079-9d90-17037048ffe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:16.777083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d5e57-e4b8-4079-9d90-17037048ffe1 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:16.794762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1128/2217] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:09:16.799526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ffa1d-574c-428f-b214-94db3097bc25 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:16.809675 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ffa1d-574c-428f-b214-94db3097bc25 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:16.814488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecfe84-df69-4c6d-a127-213d92721059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:16.815104 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecfe84-df69-4c6d-a127-213d92721059 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:16.815388 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecfe84-df69-4c6d-a127-213d92721059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:16.815662 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecfe84-df69-4c6d-a127-213d92721059 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:16.816327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecfe84-df69-4c6d-a127-213d92721059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:16.818435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ecfe84-df69-4c6d-a127-213d92721059 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:17.015241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1090/2218] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:09:16 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:09:17.026535 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d5e57-e4b8-4079-9d90-17037048ffe1 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:17.036782 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d5e57-e4b8-4079-9d90-17037048ffe1 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:17.081071 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:17.093349 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318973a-458d-4a25-aaf7-180e6cb4b004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:17.093962 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318973a-458d-4a25-aaf7-180e6cb4b004 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:17.094248 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318973a-458d-4a25-aaf7-180e6cb4b004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:17.094527 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318973a-458d-4a25-aaf7-180e6cb4b004 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:17.095170 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318973a-458d-4a25-aaf7-180e6cb4b004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:17.097149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318973a-458d-4a25-aaf7-180e6cb4b004 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:17.178668 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1129/2219] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:09:17 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:09:17.183301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecfe84-df69-4c6d-a127-213d92721059 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:17.194739 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ecfe84-df69-4c6d-a127-213d92721059 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:17.199571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94a02f-abf9-4366-b931-866aa2bf4c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:17.200388 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94a02f-abf9-4366-b931-866aa2bf4c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:17.200598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94a02f-abf9-4366-b931-866aa2bf4c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:17.200873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94a02f-abf9-4366-b931-866aa2bf4c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:17.201510 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94a02f-abf9-4366-b931-866aa2bf4c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:17.203135 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94a02f-abf9-4366-b931-866aa2bf4c8a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:17.214230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1091/2220] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:09:17.218287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318973a-458d-4a25-aaf7-180e6cb4b004 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:17.228304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318973a-458d-4a25-aaf7-180e6cb4b004 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:17.232866 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9da57-e221-47fe-982d-170eb01f4adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:17.233455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9da57-e221-47fe-982d-170eb01f4adb admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:17.233794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9da57-e221-47fe-982d-170eb01f4adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:17.234077 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9da57-e221-47fe-982d-170eb01f4adb admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:17.234721 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9da57-e221-47fe-982d-170eb01f4adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:17.236382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9da57-e221-47fe-982d-170eb01f4adb admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:17.247818 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1130/2221] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:09:17.251821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94a02f-abf9-4366-b931-866aa2bf4c8a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:17.261863 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94a02f-abf9-4366-b931-866aa2bf4c8a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:17.266982 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ea676-11ff-4cbb-962e-4c8cf834f5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:17.267637 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ea676-11ff-4cbb-962e-4c8cf834f5e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:17.267950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ea676-11ff-4cbb-962e-4c8cf834f5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:17.268224 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ea676-11ff-4cbb-962e-4c8cf834f5e1 admin admin] PATH_INFO: `/v3/projects/ead365b804ec47eeb4a76b10ae6610ef/users/6cadd26d0fe740a5b7ce7020a26ff27e/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:17.284096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ea676-11ff-4cbb-962e-4c8cf834f5e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead365b804ec47eeb4a76b10ae6610ef, user_id=6cadd26d0fe740a5b7ce7020a26ff27e, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:17.286737 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ea676-11ff-4cbb-962e-4c8cf834f5e1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:17.374053 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1092/2222] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:09:17 2022] PUT /identity/v3/projects/ead365b804ec47eeb4a76b10ae6610ef/users/6cadd26d0fe740a5b7ce7020a26ff27e/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:09:17.385340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a204f-8ec8-4f6a-88ed-50bb35f07cf6 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:17.385635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a204f-8ec8-4f6a-88ed-50bb35f07cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:17.385943 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a204f-8ec8-4f6a-88ed-50bb35f07cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:17.419400 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-0c0a204f-8ec8-4f6a-88ed-50bb35f07cf6 None None] MFA Rules not processed for user `6cadd26d0fe740a5b7ce7020a26ff27e`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:17.420749 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0c0a204f-8ec8-4f6a-88ed-50bb35f07cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:17.488382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1131/2223] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:09:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:17.499110 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ea676-11ff-4cbb-962e-4c8cf834f5e1 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:17.508751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a09ea676-11ff-4cbb-962e-4c8cf834f5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:17.559531 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ea676-11ff-4cbb-962e-4c8cf834f5e1 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:17.563170 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd35c6-a028-49a5-8a51-8f7e95306b5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:17.563773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd35c6-a028-49a5-8a51-8f7e95306b5b service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:17.564098 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd35c6-a028-49a5-8a51-8f7e95306b5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:17.564370 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd35c6-a028-49a5-8a51-8f7e95306b5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:17.572950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd35c6-a028-49a5-8a51-8f7e95306b5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:17.574381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd35c6-a028-49a5-8a51-8f7e95306b5b service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:17.583078 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1093/2224] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:20.333001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10355193-4d40-4d30-8f58-a5c699368f55 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:20.333921 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10355193-4d40-4d30-8f58-a5c699368f55 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:20.334366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10355193-4d40-4d30-8f58-a5c699368f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:20.355943 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-10355193-4d40-4d30-8f58-a5c699368f55 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:20.357462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-10355193-4d40-4d30-8f58-a5c699368f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:20.436443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1132/2225] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Sep 1 14:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:20.539063 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd35c6-a028-49a5-8a51-8f7e95306b5b service cinder] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:20.541070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f1dd35c6-a028-49a5-8a51-8f7e95306b5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:20.627080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd35c6-a028-49a5-8a51-8f7e95306b5b service cinder] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:20.632995 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050202db-6c83-4a40-a2e5-7e9aa5f6ec60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:20.633625 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050202db-6c83-4a40-a2e5-7e9aa5f6ec60 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:20.633905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050202db-6c83-4a40-a2e5-7e9aa5f6ec60 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:20.634181 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050202db-6c83-4a40-a2e5-7e9aa5f6ec60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:20.640837 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:20.643310 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050202db-6c83-4a40-a2e5-7e9aa5f6ec60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:20.645091 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050202db-6c83-4a40-a2e5-7e9aa5f6ec60 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:20.654805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1094/2226] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:25.284578 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415af077-9911-4747-9b3f-82117409e8e2 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:25.286728 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415af077-9911-4747-9b3f-82117409e8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:25.286728 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415af077-9911-4747-9b3f-82117409e8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:25.311147 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-415af077-9911-4747-9b3f-82117409e8e2 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:25.319097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-415af077-9911-4747-9b3f-82117409e8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:25.327537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1133/2227] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Sep 1 14:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:25.503920 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050202db-6c83-4a40-a2e5-7e9aa5f6ec60 service nova] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:25.503920 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-050202db-6c83-4a40-a2e5-7e9aa5f6ec60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:25.520631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050202db-6c83-4a40-a2e5-7e9aa5f6ec60 service nova] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:25.526755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498481d9-e561-4688-82ee-3603e3d88d2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:25.527361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498481d9-e561-4688-82ee-3603e3d88d2f service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:25.527643 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498481d9-e561-4688-82ee-3603e3d88d2f service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:25.527973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498481d9-e561-4688-82ee-3603e3d88d2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:25.542412 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498481d9-e561-4688-82ee-3603e3d88d2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:25.544049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498481d9-e561-4688-82ee-3603e3d88d2f service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:25.554187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1095/2228] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:26.020618 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415af077-9911-4747-9b3f-82117409e8e2 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:26.030945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415af077-9911-4747-9b3f-82117409e8e2 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:26.035543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd87eb6-5177-4bfd-b9db-a23336875583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:26.037384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd87eb6-5177-4bfd-b9db-a23336875583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:26.037680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd87eb6-5177-4bfd-b9db-a23336875583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:26.037964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd87eb6-5177-4bfd-b9db-a23336875583 admin admin] PATH_INFO: `/v3/users/6cadd26d0fe740a5b7ce7020a26ff27e` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:26.039292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd87eb6-5177-4bfd-b9db-a23336875583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cadd26d0fe740a5b7ce7020a26ff27e)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:26.042093 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd87eb6-5177-4bfd-b9db-a23336875583 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:26.429667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:26.431317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3dd87eb6-5177-4bfd-b9db-a23336875583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cadd26d0fe740a5b7ce7020a26ff27e'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:26.443141 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3dd87eb6-5177-4bfd-b9db-a23336875583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cadd26d0fe740a5b7ce7020a26ff27e'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:26.727199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3dd87eb6-5177-4bfd-b9db-a23336875583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cadd26d0fe740a5b7ce7020a26ff27e'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:26.735601 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3dd87eb6-5177-4bfd-b9db-a23336875583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cadd26d0fe740a5b7ce7020a26ff27e'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:26.736499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3dd87eb6-5177-4bfd-b9db-a23336875583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cadd26d0fe740a5b7ce7020a26ff27e'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:26.749888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1134/2229] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:09:26 2022] DELETE /identity/v3/users/6cadd26d0fe740a5b7ce7020a26ff27e => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:09:26.754599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4368e1-3082-46bc-89f0-fb5a70b0de43 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:26.755105 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4368e1-3082-46bc-89f0-fb5a70b0de43 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:26.755201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4368e1-3082-46bc-89f0-fb5a70b0de43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:26.775614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-5a4368e1-3082-46bc-89f0-fb5a70b0de43 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:26.776862 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-5a4368e1-3082-46bc-89f0-fb5a70b0de43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:26.839468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1096/2230] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:26.849440 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd87eb6-5177-4bfd-b9db-a23336875583 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:26.850873 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3dd87eb6-5177-4bfd-b9db-a23336875583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:26.909829 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd87eb6-5177-4bfd-b9db-a23336875583 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:26.913520 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886d56b-7585-4055-8039-084bfe211a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:26.914145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886d56b-7585-4055-8039-084bfe211a7e service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:26.914434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886d56b-7585-4055-8039-084bfe211a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:26.914708 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886d56b-7585-4055-8039-084bfe211a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:26.923642 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886d56b-7585-4055-8039-084bfe211a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:26.925126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886d56b-7585-4055-8039-084bfe211a7e service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:26.935134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1135/2231] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:27.523559 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4368e1-3082-46bc-89f0-fb5a70b0de43 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:27.523559 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-5a4368e1-3082-46bc-89f0-fb5a70b0de43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:27.532887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4368e1-3082-46bc-89f0-fb5a70b0de43 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:27.538420 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee234571-83b9-4763-b9ed-96e975945740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:27.539081 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee234571-83b9-4763-b9ed-96e975945740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:27.539351 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee234571-83b9-4763-b9ed-96e975945740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:27.539627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee234571-83b9-4763-b9ed-96e975945740 admin admin] PATH_INFO: `/v3/projects/ead365b804ec47eeb4a76b10ae6610ef` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:27.540790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee234571-83b9-4763-b9ed-96e975945740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ead365b804ec47eeb4a76b10ae6610ef)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:27.542705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee234571-83b9-4763-b9ed-96e975945740 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:27.729908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ee234571-83b9-4763-b9ed-96e975945740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ead365b804ec47eeb4a76b10ae6610ef', 'request_id': 'req-ee234571-83b9-4763-b9ed-96e975945740'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:27.735771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ee234571-83b9-4763-b9ed-96e975945740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ead365b804ec47eeb4a76b10ae6610ef', 'request_id': 'req-ee234571-83b9-4763-b9ed-96e975945740'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:27.869652 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ee234571-83b9-4763-b9ed-96e975945740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ead365b804ec47eeb4a76b10ae6610ef', 'request_id': 'req-ee234571-83b9-4763-b9ed-96e975945740'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:27.886158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ee234571-83b9-4763-b9ed-96e975945740 admin admin] The token cache is being invalidate because project ead365b804ec47eeb4a76b10ae6610ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:09:27.886458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ee234571-83b9-4763-b9ed-96e975945740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:27.887493 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ee234571-83b9-4763-b9ed-96e975945740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:27.889323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1097/2232] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:09:27 2022] DELETE /identity/v3/projects/ead365b804ec47eeb4a76b10ae6610ef => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:09:27.894247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ab57f-5355-407e-9817-2588c6500cee None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:27.894714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ab57f-5355-407e-9817-2588c6500cee None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:27.894824 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ab57f-5355-407e-9817-2588c6500cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:27.927395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-e58ab57f-5355-407e-9817-2588c6500cee None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:27.928737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e58ab57f-5355-407e-9817-2588c6500cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:28.006853 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1136/2233] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:28.015332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186f4c5-cef9-4e3a-ad76-f1c2780fec49 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:28.015564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186f4c5-cef9-4e3a-ad76-f1c2780fec49 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:28.015908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186f4c5-cef9-4e3a-ad76-f1c2780fec49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:28.035849 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-a186f4c5-cef9-4e3a-ad76-f1c2780fec49 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:28.037093 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a186f4c5-cef9-4e3a-ad76-f1c2780fec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:28.045714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1098/2234] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:28.049920 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ab57f-5355-407e-9817-2588c6500cee None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:28.060227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ab57f-5355-407e-9817-2588c6500cee None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:28.064864 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65acd9-641c-4cbc-8de7-a18a60b6c2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:28.065464 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65acd9-641c-4cbc-8de7-a18a60b6c2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:28.065750 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65acd9-641c-4cbc-8de7-a18a60b6c2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:28.066025 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65acd9-641c-4cbc-8de7-a18a60b6c2b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:28.066669 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65acd9-641c-4cbc-8de7-a18a60b6c2b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:09:28.066976 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65acd9-641c-4cbc-8de7-a18a60b6c2b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:28.068613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65acd9-641c-4cbc-8de7-a18a60b6c2b1 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:28.080485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1137/2235] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:09:28.084749 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186f4c5-cef9-4e3a-ad76-f1c2780fec49 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:28.094371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186f4c5-cef9-4e3a-ad76-f1c2780fec49 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:28.099083 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ba1e2-3257-4d9f-9e33-f60575fc44f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:28.099681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ba1e2-3257-4d9f-9e33-f60575fc44f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:28.099999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ba1e2-3257-4d9f-9e33-f60575fc44f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:28.100273 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ba1e2-3257-4d9f-9e33-f60575fc44f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:28.100908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ba1e2-3257-4d9f-9e33-f60575fc44f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:28.103365 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ba1e2-3257-4d9f-9e33-f60575fc44f1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:28.204438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1099/2236] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:09:28 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:09:28.208317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65acd9-641c-4cbc-8de7-a18a60b6c2b1 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:28.219612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65acd9-641c-4cbc-8de7-a18a60b6c2b1 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:28.287044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:28.297933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7f2e2-22c9-4e3f-a693-6485c8c8f7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:28.298572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7f2e2-22c9-4e3f-a693-6485c8c8f7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:28.298853 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7f2e2-22c9-4e3f-a693-6485c8c8f7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:28.299125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7f2e2-22c9-4e3f-a693-6485c8c8f7f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:28.299774 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7f2e2-22c9-4e3f-a693-6485c8c8f7f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:28.301785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7f2e2-22c9-4e3f-a693-6485c8c8f7f4 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:28.465652 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1138/2237] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:09:28 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:09:28.469023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ba1e2-3257-4d9f-9e33-f60575fc44f1 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:28.480273 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ba1e2-3257-4d9f-9e33-f60575fc44f1 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:28.485037 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188daba-ac51-442b-adbe-165962f50861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:28.485853 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188daba-ac51-442b-adbe-165962f50861 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:28.485989 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188daba-ac51-442b-adbe-165962f50861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:28.486262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188daba-ac51-442b-adbe-165962f50861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:28.486915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188daba-ac51-442b-adbe-165962f50861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:28.488567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188daba-ac51-442b-adbe-165962f50861 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:28.499214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1100/2238] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:09:28.503019 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7f2e2-22c9-4e3f-a693-6485c8c8f7f4 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:28.513766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7f2e2-22c9-4e3f-a693-6485c8c8f7f4 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:28.519325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6baefc-4380-458a-998e-0d2e9972d4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:28.520009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6baefc-4380-458a-998e-0d2e9972d4ad admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:28.520296 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6baefc-4380-458a-998e-0d2e9972d4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:28.520646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6baefc-4380-458a-998e-0d2e9972d4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:28.521356 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6baefc-4380-458a-998e-0d2e9972d4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:28.523074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6baefc-4380-458a-998e-0d2e9972d4ad admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:28.534566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1139/2239] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:09:28.538878 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188daba-ac51-442b-adbe-165962f50861 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:28.551495 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188daba-ac51-442b-adbe-165962f50861 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:28.556283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9097488-a9ad-4f92-aacc-a889b7692304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:28.556942 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9097488-a9ad-4f92-aacc-a889b7692304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:28.557223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9097488-a9ad-4f92-aacc-a889b7692304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:28.557524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9097488-a9ad-4f92-aacc-a889b7692304 admin admin] PATH_INFO: `/v3/projects/274c404a51864a32bd9557f439175cc6/users/d1f8c3717d9648a1b2aaba69412fb59d/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:28.572994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9097488-a9ad-4f92-aacc-a889b7692304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=274c404a51864a32bd9557f439175cc6, user_id=d1f8c3717d9648a1b2aaba69412fb59d, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:28.575708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9097488-a9ad-4f92-aacc-a889b7692304 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:28.676179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1101/2240] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:09:28 2022] PUT /identity/v3/projects/274c404a51864a32bd9557f439175cc6/users/d1f8c3717d9648a1b2aaba69412fb59d/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:09:28.753272 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63336509-ddd6-4e20-93ad-db92a0521f1b None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:28.753582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63336509-ddd6-4e20-93ad-db92a0521f1b None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:28.753846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63336509-ddd6-4e20-93ad-db92a0521f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:28.788324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-63336509-ddd6-4e20-93ad-db92a0521f1b None None] MFA Rules not processed for user `d1f8c3717d9648a1b2aaba69412fb59d`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:28.789651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-63336509-ddd6-4e20-93ad-db92a0521f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:28.854206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1140/2241] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:09:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:28.865098 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9097488-a9ad-4f92-aacc-a889b7692304 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:28.866923 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b9097488-a9ad-4f92-aacc-a889b7692304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:28.873170 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:28.926440 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9097488-a9ad-4f92-aacc-a889b7692304 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:28.930146 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8961b6-ba2a-49d4-8553-6a0c9969a5ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:28.930757 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8961b6-ba2a-49d4-8553-6a0c9969a5ca service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:28.931044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8961b6-ba2a-49d4-8553-6a0c9969a5ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:28.931321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8961b6-ba2a-49d4-8553-6a0c9969a5ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:28.940516 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8961b6-ba2a-49d4-8553-6a0c9969a5ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:28.941972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8961b6-ba2a-49d4-8553-6a0c9969a5ca service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:28.951754 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1102/2242] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:31.006184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7d8bb-46e6-43da-9291-741dcc4f3219 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:31.006664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7d8bb-46e6-43da-9291-741dcc4f3219 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:31.006777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7d8bb-46e6-43da-9291-741dcc4f3219 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:31.009906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1141/2243] 10.222.0.64 () {54 vars in 961 bytes} [Thu Sep 1 14:09:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:09:31.015788 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d9920-0f8a-4115-a38c-9019865bf750 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:31.016305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d9920-0f8a-4115-a38c-9019865bf750 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:31.016305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d9920-0f8a-4115-a38c-9019865bf750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:31.042702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-f46d9920-0f8a-4115-a38c-9019865bf750 None None] MFA Rules not processed for user `cec4f437077c41039cae3d505b43b558`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:31.044480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f46d9920-0f8a-4115-a38c-9019865bf750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:31.112392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1103/2244] 10.222.0.64 () {58 vars in 1058 bytes} [Thu Sep 1 14:09:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:31.120423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7d8bb-46e6-43da-9291-741dcc4f3219 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:31.134510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7d8bb-46e6-43da-9291-741dcc4f3219 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:31.139818 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c43dc-28f7-4918-b151-f54131a39ce3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec4f437077c41039cae3d505b43b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:31.140486 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c43dc-28f7-4918-b151-f54131a39ce3 service placement] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:31.140808 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c43dc-28f7-4918-b151-f54131a39ce3 service placement] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:31.141049 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c43dc-28f7-4918-b151-f54131a39ce3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:31.142780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-dc3c43dc-28f7-4918-b151-f54131a39ce3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:31.155893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c43dc-28f7-4918-b151-f54131a39ce3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:31.157517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c43dc-28f7-4918-b151-f54131a39ce3 service placement] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:31.167606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1142/2245] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:34.189867 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432d6b2-a1e4-4e56-a240-580b3e14799c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:34.190386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432d6b2-a1e4-4e56-a240-580b3e14799c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:34.190482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432d6b2-a1e4-4e56-a240-580b3e14799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:34.211095 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-c432d6b2-a1e4-4e56-a240-580b3e14799c None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:34.212338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c432d6b2-a1e4-4e56-a240-580b3e14799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:34.287627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1104/2246] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Sep 1 14:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:34.334637 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c43dc-28f7-4918-b151-f54131a39ce3 service placement] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:34.336009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-dc3c43dc-28f7-4918-b151-f54131a39ce3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:34.412055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c43dc-28f7-4918-b151-f54131a39ce3 service placement] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:34.418114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78781aab-55e7-4b72-95f6-390bd231e401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:34.418724 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78781aab-55e7-4b72-95f6-390bd231e401 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:34.419010 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78781aab-55e7-4b72-95f6-390bd231e401 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:34.419289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78781aab-55e7-4b72-95f6-390bd231e401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:34.427771 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78781aab-55e7-4b72-95f6-390bd231e401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:34.429402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78781aab-55e7-4b72-95f6-390bd231e401 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:34.438937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1143/2247] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:35.701856 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432d6b2-a1e4-4e56-a240-580b3e14799c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:35.731447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432d6b2-a1e4-4e56-a240-580b3e14799c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:35.731447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b7d87-0918-443e-9b7a-ac9fe4e6381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:35.731447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b7d87-0918-443e-9b7a-ac9fe4e6381a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:35.731447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b7d87-0918-443e-9b7a-ac9fe4e6381a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:35.732186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b7d87-0918-443e-9b7a-ac9fe4e6381a admin admin] PATH_INFO: `/v3/users/d1f8c3717d9648a1b2aaba69412fb59d` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:35.732186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b7d87-0918-443e-9b7a-ac9fe4e6381a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f8c3717d9648a1b2aaba69412fb59d)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:35.732186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b7d87-0918-443e-9b7a-ac9fe4e6381a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:36.035405 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:36.043580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-bf7b7d87-0918-443e-9b7a-ac9fe4e6381a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f8c3717d9648a1b2aaba69412fb59d'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:36.044263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-bf7b7d87-0918-443e-9b7a-ac9fe4e6381a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f8c3717d9648a1b2aaba69412fb59d'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:36.057302 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-bf7b7d87-0918-443e-9b7a-ac9fe4e6381a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f8c3717d9648a1b2aaba69412fb59d'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:36.156789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-bf7b7d87-0918-443e-9b7a-ac9fe4e6381a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f8c3717d9648a1b2aaba69412fb59d'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:36.157304 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-bf7b7d87-0918-443e-9b7a-ac9fe4e6381a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f8c3717d9648a1b2aaba69412fb59d'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:36.172605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1105/2248] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:09:35 2022] DELETE /identity/v3/users/d1f8c3717d9648a1b2aaba69412fb59d => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:09:36.177149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e59dc-69a2-41de-94db-12204007bc76 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:36.177559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e59dc-69a2-41de-94db-12204007bc76 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:36.177710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e59dc-69a2-41de-94db-12204007bc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:36.198126 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-243e59dc-69a2-41de-94db-12204007bc76 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:36.199330 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-243e59dc-69a2-41de-94db-12204007bc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:36.229315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:36.264445 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1144/2249] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:36.270215 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b7d87-0918-443e-9b7a-ac9fe4e6381a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:36.271720 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bf7b7d87-0918-443e-9b7a-ac9fe4e6381a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:36.333804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b7d87-0918-443e-9b7a-ac9fe4e6381a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:36.337510 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe0e17-2847-47c6-b1b3-9e7b7c1caabc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:36.338384 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe0e17-2847-47c6-b1b3-9e7b7c1caabc service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:36.338667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe0e17-2847-47c6-b1b3-9e7b7c1caabc service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:36.338969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe0e17-2847-47c6-b1b3-9e7b7c1caabc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:36.348218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe0e17-2847-47c6-b1b3-9e7b7c1caabc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:36.354658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe0e17-2847-47c6-b1b3-9e7b7c1caabc service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:36.359804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1106/2250] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:09:36.866450 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e59dc-69a2-41de-94db-12204007bc76 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:36.868547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-243e59dc-69a2-41de-94db-12204007bc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:36.881754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e59dc-69a2-41de-94db-12204007bc76 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:36.902288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd2953-3e89-49a0-aabe-72d7b6c54bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:36.902956 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd2953-3e89-49a0-aabe-72d7b6c54bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:36.903244 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd2953-3e89-49a0-aabe-72d7b6c54bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:36.903591 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd2953-3e89-49a0-aabe-72d7b6c54bd8 admin admin] PATH_INFO: `/v3/projects/274c404a51864a32bd9557f439175cc6` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:36.904931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd2953-3e89-49a0-aabe-72d7b6c54bd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=274c404a51864a32bd9557f439175cc6)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:36.907769 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd2953-3e89-49a0-aabe-72d7b6c54bd8 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:37.060605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-77cd2953-3e89-49a0-aabe-72d7b6c54bd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '274c404a51864a32bd9557f439175cc6', 'request_id': 'req-77cd2953-3e89-49a0-aabe-72d7b6c54bd8'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:37.223718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-77cd2953-3e89-49a0-aabe-72d7b6c54bd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '274c404a51864a32bd9557f439175cc6', 'request_id': 'req-77cd2953-3e89-49a0-aabe-72d7b6c54bd8'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:37.231207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-77cd2953-3e89-49a0-aabe-72d7b6c54bd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '274c404a51864a32bd9557f439175cc6', 'request_id': 'req-77cd2953-3e89-49a0-aabe-72d7b6c54bd8'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:37.241690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-77cd2953-3e89-49a0-aabe-72d7b6c54bd8 admin admin] The token cache is being invalidate because project 274c404a51864a32bd9557f439175cc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:09:37.241982 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-77cd2953-3e89-49a0-aabe-72d7b6c54bd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:37.243244 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-77cd2953-3e89-49a0-aabe-72d7b6c54bd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:37.244806 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1145/2251] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:09:36 2022] DELETE /identity/v3/projects/274c404a51864a32bd9557f439175cc6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:09:37.249688 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9dbc-e8be-40cd-8ace-bd27db5bfbff None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:37.250129 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9dbc-e8be-40cd-8ace-bd27db5bfbff None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:37.250239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9dbc-e8be-40cd-8ace-bd27db5bfbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:37.269976 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-371f9dbc-e8be-40cd-8ace-bd27db5bfbff None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:37.271185 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-371f9dbc-e8be-40cd-8ace-bd27db5bfbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:37.331248 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1107/2252] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:37.339837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8829c63-ae67-4e59-90d0-017006fce742 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:37.340180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8829c63-ae67-4e59-90d0-017006fce742 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:37.340463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8829c63-ae67-4e59-90d0-017006fce742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:37.362586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-d8829c63-ae67-4e59-90d0-017006fce742 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:37.363838 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d8829c63-ae67-4e59-90d0-017006fce742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:37.371902 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1146/2253] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:37.376213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f9dbc-e8be-40cd-8ace-bd27db5bfbff None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:37.386625 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f9dbc-e8be-40cd-8ace-bd27db5bfbff None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:37.391906 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0382d-caf6-4c3c-8a34-0eadc54447e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:37.392574 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0382d-caf6-4c3c-8a34-0eadc54447e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:37.402468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0382d-caf6-4c3c-8a34-0eadc54447e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:37.402468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0382d-caf6-4c3c-8a34-0eadc54447e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:37.402468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0382d-caf6-4c3c-8a34-0eadc54447e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:09:37.402468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0382d-caf6-4c3c-8a34-0eadc54447e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:37.402468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0382d-caf6-4c3c-8a34-0eadc54447e6 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:37.412543 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1108/2254] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:09:37.413775 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8829c63-ae67-4e59-90d0-017006fce742 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:37.423684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8829c63-ae67-4e59-90d0-017006fce742 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:37.428412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780fbd8-68cc-45c2-a7f3-e8035471018b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:37.429022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780fbd8-68cc-45c2-a7f3-e8035471018b admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:37.432531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780fbd8-68cc-45c2-a7f3-e8035471018b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:37.432531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780fbd8-68cc-45c2-a7f3-e8035471018b admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:37.432531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780fbd8-68cc-45c2-a7f3-e8035471018b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:37.432995 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780fbd8-68cc-45c2-a7f3-e8035471018b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:37.536744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1147/2255] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:09:37 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:09:37.541088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0382d-caf6-4c3c-8a34-0eadc54447e6 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:37.551296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0382d-caf6-4c3c-8a34-0eadc54447e6 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:37.593944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:37.609698 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1003de-f468-48c3-a6ee-387e7fa66b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:37.610317 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1003de-f468-48c3-a6ee-387e7fa66b6f admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:37.610603 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1003de-f468-48c3-a6ee-387e7fa66b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:37.610879 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1003de-f468-48c3-a6ee-387e7fa66b6f admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:37.611522 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1003de-f468-48c3-a6ee-387e7fa66b6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:37.613498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1003de-f468-48c3-a6ee-387e7fa66b6f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:37.727235 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1109/2256] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:09:37 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:09:37.731677 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780fbd8-68cc-45c2-a7f3-e8035471018b admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:37.742918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780fbd8-68cc-45c2-a7f3-e8035471018b admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:37.747615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485b24a-9441-4b6f-bdd5-d5a0bfefde2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:37.748296 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485b24a-9441-4b6f-bdd5-d5a0bfefde2c admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:37.748608 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485b24a-9441-4b6f-bdd5-d5a0bfefde2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:37.748913 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485b24a-9441-4b6f-bdd5-d5a0bfefde2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:37.749555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485b24a-9441-4b6f-bdd5-d5a0bfefde2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:37.751148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485b24a-9441-4b6f-bdd5-d5a0bfefde2c admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:37.762326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1148/2257] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:09:37.773011 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1003de-f468-48c3-a6ee-387e7fa66b6f admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:37.783246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1003de-f468-48c3-a6ee-387e7fa66b6f admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:37.787836 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea55081-0d4c-434e-8f21-a08000977db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:37.788509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea55081-0d4c-434e-8f21-a08000977db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:37.788784 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea55081-0d4c-434e-8f21-a08000977db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:37.789608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea55081-0d4c-434e-8f21-a08000977db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:37.790255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea55081-0d4c-434e-8f21-a08000977db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:37.792011 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea55081-0d4c-434e-8f21-a08000977db4 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:37.802469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1110/2258] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:09:37.807302 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485b24a-9441-4b6f-bdd5-d5a0bfefde2c admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:37.817633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485b24a-9441-4b6f-bdd5-d5a0bfefde2c admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:37.822319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48ac8e-e430-4531-96c6-3b475a943f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:37.822943 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ac8e-e430-4531-96c6-3b475a943f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:37.823241 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ac8e-e430-4531-96c6-3b475a943f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:37.823485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ac8e-e430-4531-96c6-3b475a943f26 admin admin] PATH_INFO: `/v3/projects/a0e2a7f89b6f4895a06c2607356ee508/users/a2f7e6a9719c47f995586ecae46a844d/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:37.839197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48ac8e-e430-4531-96c6-3b475a943f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e2a7f89b6f4895a06c2607356ee508, user_id=a2f7e6a9719c47f995586ecae46a844d, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:37.841887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48ac8e-e430-4531-96c6-3b475a943f26 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:37.961821 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1149/2259] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:09:37 2022] PUT /identity/v3/projects/a0e2a7f89b6f4895a06c2607356ee508/users/a2f7e6a9719c47f995586ecae46a844d/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:09:37.972714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cf416-bc40-4386-b3a4-6b1f8aa95b2c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:37.973005 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cf416-bc40-4386-b3a4-6b1f8aa95b2c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:37.973290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cf416-bc40-4386-b3a4-6b1f8aa95b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:38.008489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-c05cf416-bc40-4386-b3a4-6b1f8aa95b2c None None] MFA Rules not processed for user `a2f7e6a9719c47f995586ecae46a844d`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:38.009776 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c05cf416-bc40-4386-b3a4-6b1f8aa95b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:38.104634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1111/2260] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:09:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:38.115479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48ac8e-e430-4531-96c6-3b475a943f26 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:38.117314 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fd48ac8e-e430-4531-96c6-3b475a943f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:38.180518 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48ac8e-e430-4531-96c6-3b475a943f26 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:38.184311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c00ba-c22f-491f-9ed7-8d8eda12366d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:38.184918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c00ba-c22f-491f-9ed7-8d8eda12366d service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:38.185225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c00ba-c22f-491f-9ed7-8d8eda12366d service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:38.185497 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c00ba-c22f-491f-9ed7-8d8eda12366d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:38.191894 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:38.193825 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c00ba-c22f-491f-9ed7-8d8eda12366d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:38.195324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c00ba-c22f-491f-9ed7-8d8eda12366d service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:38.204160 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1150/2261] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:41.341770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be23db-c1c7-4bf5-9b10-f615a7dcdb02 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:41.342326 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be23db-c1c7-4bf5-9b10-f615a7dcdb02 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:41.342434 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be23db-c1c7-4bf5-9b10-f615a7dcdb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:41.367286 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-75be23db-c1c7-4bf5-9b10-f615a7dcdb02 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:41.368589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-75be23db-c1c7-4bf5-9b10-f615a7dcdb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:41.443929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1112/2262] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Sep 1 14:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:41.464976 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c00ba-c22f-491f-9ed7-8d8eda12366d service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:41.466480 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a52c00ba-c22f-491f-9ed7-8d8eda12366d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:41.556950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c00ba-c22f-491f-9ed7-8d8eda12366d service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:41.573490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21881fed-f438-4f4f-93ec-d9a105ab0797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:41.576764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881fed-f438-4f4f-93ec-d9a105ab0797 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:41.581293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881fed-f438-4f4f-93ec-d9a105ab0797 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:41.581293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881fed-f438-4f4f-93ec-d9a105ab0797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:41.588793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21881fed-f438-4f4f-93ec-d9a105ab0797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:41.590602 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21881fed-f438-4f4f-93ec-d9a105ab0797 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:41.602089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1151/2263] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:48.786653 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b9780-e9f9-4461-88f0-914badaf78d5 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:48.787203 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b9780-e9f9-4461-88f0-914badaf78d5 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:48.787399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b9780-e9f9-4461-88f0-914badaf78d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:48.807661 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e25b9780-e9f9-4461-88f0-914badaf78d5 None None] MFA Rules not processed for user `9b6dee114b0b4db3ac98075847d613c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:48.809323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e25b9780-e9f9-4461-88f0-914badaf78d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:48.872693 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:48.883917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1113/2264] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:09:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:49.647287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c94d8-c8eb-4184-8b71-a0e80ae93285 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:49.658263 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c94d8-c8eb-4184-8b71-a0e80ae93285 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:49.658263 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c94d8-c8eb-4184-8b71-a0e80ae93285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:49.676622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-a53c94d8-c8eb-4184-8b71-a0e80ae93285 None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:49.677840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a53c94d8-c8eb-4184-8b71-a0e80ae93285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:49.736611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1152/2265] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 14:09:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:49.830111 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b9780-e9f9-4461-88f0-914badaf78d5 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:49.831785 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e25b9780-e9f9-4461-88f0-914badaf78d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:49.945508 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b9780-e9f9-4461-88f0-914badaf78d5 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:49.952827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9499e-e3b2-4249-847e-25670f39642a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:49.953805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9499e-e3b2-4249-847e-25670f39642a service swift] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:49.954248 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9499e-e3b2-4249-847e-25670f39642a service swift] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:49.954798 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9499e-e3b2-4249-847e-25670f39642a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:49.965369 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9499e-e3b2-4249-847e-25670f39642a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:49.970865 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9499e-e3b2-4249-847e-25670f39642a service swift] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:49.984096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1114/2266] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:09:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:09:56.688964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c94d8-c8eb-4184-8b71-a0e80ae93285 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:56.700229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c94d8-c8eb-4184-8b71-a0e80ae93285 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:56.705014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5357e9-ccc5-4518-8382-ef380b3aebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:56.705829 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5357e9-ccc5-4518-8382-ef380b3aebc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:56.705977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5357e9-ccc5-4518-8382-ef380b3aebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:56.706255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5357e9-ccc5-4518-8382-ef380b3aebc5 admin admin] PATH_INFO: `/v3/users/a2f7e6a9719c47f995586ecae46a844d` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:56.707431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5357e9-ccc5-4518-8382-ef380b3aebc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f7e6a9719c47f995586ecae46a844d)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:56.709454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5357e9-ccc5-4518-8382-ef380b3aebc5 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:56.947013 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fb5357e9-ccc5-4518-8382-ef380b3aebc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f7e6a9719c47f995586ecae46a844d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:56.961869 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fb5357e9-ccc5-4518-8382-ef380b3aebc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f7e6a9719c47f995586ecae46a844d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:57.035120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fb5357e9-ccc5-4518-8382-ef380b3aebc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f7e6a9719c47f995586ecae46a844d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:57.044110 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fb5357e9-ccc5-4518-8382-ef380b3aebc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f7e6a9719c47f995586ecae46a844d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:57.045104 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-fb5357e9-ccc5-4518-8382-ef380b3aebc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f7e6a9719c47f995586ecae46a844d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:57.046989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:57.053245 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1153/2267] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:09:56 2022] DELETE /identity/v3/users/a2f7e6a9719c47f995586ecae46a844d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:09:57.057968 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8898e72-2049-4e94-bb14-34ed089bca3c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:57.058506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8898e72-2049-4e94-bb14-34ed089bca3c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:57.058506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8898e72-2049-4e94-bb14-34ed089bca3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:57.079980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-f8898e72-2049-4e94-bb14-34ed089bca3c None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:09:57.081229 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f8898e72-2049-4e94-bb14-34ed089bca3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:57.207404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1115/2268] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:09:57.215643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5357e9-ccc5-4518-8382-ef380b3aebc5 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:57.217360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fb5357e9-ccc5-4518-8382-ef380b3aebc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:57.311067 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5357e9-ccc5-4518-8382-ef380b3aebc5 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:57.318497 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73bc04-e52c-4b6a-a551-edb26162e996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:57.320675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73bc04-e52c-4b6a-a551-edb26162e996 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:57.321131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73bc04-e52c-4b6a-a551-edb26162e996 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:57.321582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73bc04-e52c-4b6a-a551-edb26162e996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:57.334886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73bc04-e52c-4b6a-a551-edb26162e996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:57.337140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73bc04-e52c-4b6a-a551-edb26162e996 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:57.349748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1154/2269] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:09:57.977866 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8898e72-2049-4e94-bb14-34ed089bca3c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:09:57.980397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f8898e72-2049-4e94-bb14-34ed089bca3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:09:57.995537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8898e72-2049-4e94-bb14-34ed089bca3c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:09:58.000665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efda28-90d2-43cb-a7cc-d3eb450daa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:09:58.001682 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efda28-90d2-43cb-a7cc-d3eb450daa2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:09:58.002195 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efda28-90d2-43cb-a7cc-d3eb450daa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:09:58.002706 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efda28-90d2-43cb-a7cc-d3eb450daa2e admin admin] PATH_INFO: `/v3/projects/a0e2a7f89b6f4895a06c2607356ee508` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:09:58.004173 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efda28-90d2-43cb-a7cc-d3eb450daa2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e2a7f89b6f4895a06c2607356ee508)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:09:58.006548 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efda28-90d2-43cb-a7cc-d3eb450daa2e admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:09:58.177937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-97efda28-90d2-43cb-a7cc-d3eb450daa2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e2a7f89b6f4895a06c2607356ee508', 'request_id': 'req-97efda28-90d2-43cb-a7cc-d3eb450daa2e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:58.185321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-97efda28-90d2-43cb-a7cc-d3eb450daa2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e2a7f89b6f4895a06c2607356ee508', 'request_id': 'req-97efda28-90d2-43cb-a7cc-d3eb450daa2e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:58.327023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-97efda28-90d2-43cb-a7cc-d3eb450daa2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e2a7f89b6f4895a06c2607356ee508', 'request_id': 'req-97efda28-90d2-43cb-a7cc-d3eb450daa2e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:58.340657 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-97efda28-90d2-43cb-a7cc-d3eb450daa2e admin admin] The token cache is being invalidate because project a0e2a7f89b6f4895a06c2607356ee508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:09:58.341264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-97efda28-90d2-43cb-a7cc-d3eb450daa2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:58.341941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-97efda28-90d2-43cb-a7cc-d3eb450daa2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:09:58.343677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1116/2270] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:09:57 2022] DELETE /identity/v3/projects/a0e2a7f89b6f4895a06c2607356ee508 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:10:04.177741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71600e30-5511-4312-b39f-cdb4c8feeb33 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:04.178299 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71600e30-5511-4312-b39f-cdb4c8feeb33 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:04.178299 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71600e30-5511-4312-b39f-cdb4c8feeb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:04.203142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-71600e30-5511-4312-b39f-cdb4c8feeb33 None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:10:04.204504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-71600e30-5511-4312-b39f-cdb4c8feeb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:10:04.274190 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1155/2271] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 14:10:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:10:04.289874 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efda28-90d2-43cb-a7cc-d3eb450daa2e admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:10:04.296958 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-97efda28-90d2-43cb-a7cc-d3eb450daa2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:10:04.318613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:04.445965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efda28-90d2-43cb-a7cc-d3eb450daa2e admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:10:04.452244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b4fb2-5759-4662-b4ef-53715089dccc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:10:04.453262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b4fb2-5759-4662-b4ef-53715089dccc service swift] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:04.453764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b4fb2-5759-4662-b4ef-53715089dccc service swift] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:04.454174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b4fb2-5759-4662-b4ef-53715089dccc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:04.464699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b4fb2-5759-4662-b4ef-53715089dccc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:10:04.466543 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b4fb2-5759-4662-b4ef-53715089dccc service swift] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:10:04.479136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1117/2272] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:10:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 14:10:12.962649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81297f96-f92a-43c5-83d5-f7ab666e2f69 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:12.963809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81297f96-f92a-43c5-83d5-f7ab666e2f69 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:12.964311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81297f96-f92a-43c5-83d5-f7ab666e2f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:12.985407 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-81297f96-f92a-43c5-83d5-f7ab666e2f69 None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:10:12.986941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-81297f96-f92a-43c5-83d5-f7ab666e2f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:10:12.995973 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1156/2273] 10.222.0.64 () {58 vars in 967 bytes} [Thu Sep 1 14:10:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:10:13.014321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b4fb2-5759-4662-b4ef-53715089dccc service swift] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:10:13.031768 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b4fb2-5759-4662-b4ef-53715089dccc service swift] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:10:13.037322 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689eaad-93d7-48bb-88ce-c6db9946e33d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:10:13.038041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689eaad-93d7-48bb-88ce-c6db9946e33d service swift] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:13.038616 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689eaad-93d7-48bb-88ce-c6db9946e33d service swift] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:13.039068 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689eaad-93d7-48bb-88ce-c6db9946e33d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:13.048635 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689eaad-93d7-48bb-88ce-c6db9946e33d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:10:13.050551 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689eaad-93d7-48bb-88ce-c6db9946e33d service swift] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:10:13.060304 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1118/2274] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:10:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:10:13.210936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516343a-0153-47cf-8db0-42212c4e5806 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:13.211540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516343a-0153-47cf-8db0-42212c4e5806 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:13.211842 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516343a-0153-47cf-8db0-42212c4e5806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:13.234782 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-e516343a-0153-47cf-8db0-42212c4e5806 None None] MFA Rules not processed for user `002a16d91db244028250b9d7781937df`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:10:13.236201 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e516343a-0153-47cf-8db0-42212c4e5806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:10:13.321130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1157/2275] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:10:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:10:13.685551 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf785e6-f3f6-4888-ba1d-87995ae2f08a None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:13.685950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf785e6-f3f6-4888-ba1d-87995ae2f08a None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:13.686319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf785e6-f3f6-4888-ba1d-87995ae2f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:13.721289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-aaf785e6-f3f6-4888-ba1d-87995ae2f08a None None] MFA Rules not processed for user `54ef2f77ecf54da6aa8dda65e72da09c`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:10:13.722700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-aaf785e6-f3f6-4888-ba1d-87995ae2f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:10:13.804975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1119/2276] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:10:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:10:19.665620 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516343a-0153-47cf-8db0-42212c4e5806 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:10:19.667360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e516343a-0153-47cf-8db0-42212c4e5806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:10:19.719756 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:19.739192 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516343a-0153-47cf-8db0-42212c4e5806 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:10:19.744741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c71de-b3cf-4972-9af2-9327f39a621e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:10:19.745364 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c71de-b3cf-4972-9af2-9327f39a621e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:19.745650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c71de-b3cf-4972-9af2-9327f39a621e admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:19.745965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c71de-b3cf-4972-9af2-9327f39a621e admin admin] PATH_INFO: `/v3/users/31cf7fd1e75b4276a0daa603226df084` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:19.747113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c71de-b3cf-4972-9af2-9327f39a621e admin admin] RBAC: Authorizing `identity:delete_user(user_id=31cf7fd1e75b4276a0daa603226df084)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:10:19.749080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c71de-b3cf-4972-9af2-9327f39a621e admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:10:20.377824 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-052c71de-b3cf-4972-9af2-9327f39a621e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31cf7fd1e75b4276a0daa603226df084'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:10:20.392551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-052c71de-b3cf-4972-9af2-9327f39a621e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31cf7fd1e75b4276a0daa603226df084'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:10:20.606168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-052c71de-b3cf-4972-9af2-9327f39a621e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31cf7fd1e75b4276a0daa603226df084'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:10:20.614532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-052c71de-b3cf-4972-9af2-9327f39a621e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31cf7fd1e75b4276a0daa603226df084'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:10:20.615230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-052c71de-b3cf-4972-9af2-9327f39a621e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31cf7fd1e75b4276a0daa603226df084'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:10:20.621875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1158/2277] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:10:19 2022] DELETE /identity/v3/users/31cf7fd1e75b4276a0daa603226df084 => generated 0 bytes in 957 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:10:21.060701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf785e6-f3f6-4888-ba1d-87995ae2f08a None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:10:21.073845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf785e6-f3f6-4888-ba1d-87995ae2f08a None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:10:21.152359 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fc462-d352-4e52-9e5a-0649ec19690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:10:21.153315 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fc462-d352-4e52-9e5a-0649ec19690b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:21.153771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fc462-d352-4e52-9e5a-0649ec19690b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:21.154049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fc462-d352-4e52-9e5a-0649ec19690b admin admin] PATH_INFO: `/v3/projects/9b6bd42da594408282a1ca16bb4458ec` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:21.155804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fc462-d352-4e52-9e5a-0649ec19690b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6bd42da594408282a1ca16bb4458ec)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:10:21.157760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fc462-d352-4e52-9e5a-0649ec19690b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:10:21.723015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:21.735726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2c7fc462-d352-4e52-9e5a-0649ec19690b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6bd42da594408282a1ca16bb4458ec', 'request_id': 'req-2c7fc462-d352-4e52-9e5a-0649ec19690b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:10:21.741750 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2c7fc462-d352-4e52-9e5a-0649ec19690b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6bd42da594408282a1ca16bb4458ec', 'request_id': 'req-2c7fc462-d352-4e52-9e5a-0649ec19690b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:10:21.964873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2c7fc462-d352-4e52-9e5a-0649ec19690b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6bd42da594408282a1ca16bb4458ec', 'request_id': 'req-2c7fc462-d352-4e52-9e5a-0649ec19690b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:10:21.978497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2c7fc462-d352-4e52-9e5a-0649ec19690b admin admin] The token cache is being invalidate because project 9b6bd42da594408282a1ca16bb4458ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:10:21.978853 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2c7fc462-d352-4e52-9e5a-0649ec19690b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:10:21.979556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2c7fc462-d352-4e52-9e5a-0649ec19690b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:10:21.983491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1120/2278] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:10:21 2022] DELETE /identity/v3/projects/9b6bd42da594408282a1ca16bb4458ec => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:10:29.360466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27664340-f460-42dd-bc1e-564915f0f101 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:29.361073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27664340-f460-42dd-bc1e-564915f0f101 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:29.361175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27664340-f460-42dd-bc1e-564915f0f101 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:29.362498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1159/2279] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 14:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:10:29.368928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943162f-85c4-4e01-a21f-127aedb1e39e None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:29.369432 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943162f-85c4-4e01-a21f-127aedb1e39e None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:29.369647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943162f-85c4-4e01-a21f-127aedb1e39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:29.389999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-4943162f-85c4-4e01-a21f-127aedb1e39e None None] MFA Rules not processed for user `4b3c8a90b97246a98612b627b5f8da80`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:10:29.391208 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4943162f-85c4-4e01-a21f-127aedb1e39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:10:29.457457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1121/2280] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 14:10:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:10:29.468883 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27664340-f460-42dd-bc1e-564915f0f101 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:10:29.470607 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-27664340-f460-42dd-bc1e-564915f0f101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:10:29.536361 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27664340-f460-42dd-bc1e-564915f0f101 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:10:29.540687 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6d82f-cfb8-4fe9-9dde-8b3f0812ef5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f750815038d404d9d39a68bf62db8c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:10:29.541288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6d82f-cfb8-4fe9-9dde-8b3f0812ef5a service glance] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:29.541562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6d82f-cfb8-4fe9-9dde-8b3f0812ef5a service glance] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:29.541837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6d82f-cfb8-4fe9-9dde-8b3f0812ef5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:29.552906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6d82f-cfb8-4fe9-9dde-8b3f0812ef5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:10:29.554991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6d82f-cfb8-4fe9-9dde-8b3f0812ef5a service glance] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:10:29.566220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1160/2281] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:10:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:10:29.848598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83354336-73a5-49b7-a065-82e98e8d309e None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:29.848811 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83354336-73a5-49b7-a065-82e98e8d309e None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:29.849079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83354336-73a5-49b7-a065-82e98e8d309e None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:29.851062 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1122/2282] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 14:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:10:29.856286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca3b6e-4783-490b-a3e3-a6a83f61376a None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:29.856686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca3b6e-4783-490b-a3e3-a6a83f61376a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:29.857050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca3b6e-4783-490b-a3e3-a6a83f61376a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:29.876651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-49ca3b6e-4783-490b-a3e3-a6a83f61376a None None] MFA Rules not processed for user `4a9703db64624bbeb392d693ca60c6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:10:29.877947 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-49ca3b6e-4783-490b-a3e3-a6a83f61376a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:10:29.946984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1161/2283] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 14:10:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:10:29.959019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83354336-73a5-49b7-a065-82e98e8d309e None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:10:29.961337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-83354336-73a5-49b7-a065-82e98e8d309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:10:29.975080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83354336-73a5-49b7-a065-82e98e8d309e None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:10:29.979177 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcda7b-4e0e-4831-85ea-e745a83f5a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:10:29.979773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcda7b-4e0e-4831-85ea-e745a83f5a58 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:29.980222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcda7b-4e0e-4831-85ea-e745a83f5a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:29.980499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcda7b-4e0e-4831-85ea-e745a83f5a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:29.987972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcda7b-4e0e-4831-85ea-e745a83f5a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:10:29.989427 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcda7b-4e0e-4831-85ea-e745a83f5a58 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:10:29.997318 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1123/2284] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:10:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:10:30.078755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3a593-f460-4f8d-b427-1ece04fac0e1 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:30.079046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3a593-f460-4f8d-b427-1ece04fac0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:30.079321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3a593-f460-4f8d-b427-1ece04fac0e1 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:30.080696 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1162/2285] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 14:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:10:30.086005 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4152f-e905-463c-9f70-92c45a86a8b5 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:30.086296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4152f-e905-463c-9f70-92c45a86a8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:30.086577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4152f-e905-463c-9f70-92c45a86a8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:30.107812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-49d4152f-e905-463c-9f70-92c45a86a8b5 None None] MFA Rules not processed for user `4b3c8a90b97246a98612b627b5f8da80`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:10:30.109054 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-49d4152f-e905-463c-9f70-92c45a86a8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:10:30.121872 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1124/2286] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 14:10:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:10:30.129541 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3a593-f460-4f8d-b427-1ece04fac0e1 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:10:30.141190 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3a593-f460-4f8d-b427-1ece04fac0e1 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:10:30.144769 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99204a-7962-4c5e-9758-a600ce25f8e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:10:30.145366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99204a-7962-4c5e-9758-a600ce25f8e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:30.145645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99204a-7962-4c5e-9758-a600ce25f8e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:30.145919 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99204a-7962-4c5e-9758-a600ce25f8e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:30.157309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99204a-7962-4c5e-9758-a600ce25f8e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:10:30.158727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99204a-7962-4c5e-9758-a600ce25f8e7 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:10:30.171972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1163/2287] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:10:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:10:40.102530 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:DELETE=5,keystone:SELECT=51,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:40.167094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:41.252284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36a7aa-134f-47e0-bfae-56b0ab3dc153 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:41.252709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36a7aa-134f-47e0-bfae-56b0ab3dc153 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:41.252917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36a7aa-134f-47e0-bfae-56b0ab3dc153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:41.274860 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-ee36a7aa-134f-47e0-bfae-56b0ab3dc153 None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:10:41.276179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ee36a7aa-134f-47e0-bfae-56b0ab3dc153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:10:41.334820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1125/2288] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 14:10:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:10:41.348588 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99204a-7962-4c5e-9758-a600ce25f8e7 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:10:41.350728 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-aa99204a-7962-4c5e-9758-a600ce25f8e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:10:41.440111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99204a-7962-4c5e-9758-a600ce25f8e7 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:10:41.445937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1f0e2-841f-4ae0-8e8c-a45a57b20351 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:10:41.446553 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1f0e2-841f-4ae0-8e8c-a45a57b20351 service swift] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:10:41.446839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1f0e2-841f-4ae0-8e8c-a45a57b20351 service swift] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:10:41.447116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1f0e2-841f-4ae0-8e8c-a45a57b20351 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:10:41.455273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1f0e2-841f-4ae0-8e8c-a45a57b20351 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:10:41.456915 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1f0e2-841f-4ae0-8e8c-a45a57b20351 service swift] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:10:41.465906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1164/2289] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:10:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:10:51.325533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=25 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:51.462657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=32 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:08.760401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b225b68-c9c7-4f16-a2f9-c03723599663 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:08.761034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b225b68-c9c7-4f16-a2f9-c03723599663 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:08.761034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b225b68-c9c7-4f16-a2f9-c03723599663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:08.781216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-2b225b68-c9c7-4f16-a2f9-c03723599663 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:11:08.782514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2b225b68-c9c7-4f16-a2f9-c03723599663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:08.844562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1126/2290] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Sep 1 14:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:11:08.868756 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1f0e2-841f-4ae0-8e8c-a45a57b20351 service swift] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:11:08.870210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-18b1f0e2-841f-4ae0-8e8c-a45a57b20351 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:08.885993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1f0e2-841f-4ae0-8e8c-a45a57b20351 service swift] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:11:08.891531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efc4d7-137a-4283-a83e-cf4604dfe9cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:11:08.892257 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efc4d7-137a-4283-a83e-cf4604dfe9cc service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:08.892543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efc4d7-137a-4283-a83e-cf4604dfe9cc service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:08.892820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efc4d7-137a-4283-a83e-cf4604dfe9cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:08.901003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efc4d7-137a-4283-a83e-cf4604dfe9cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:11:08.902583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efc4d7-137a-4283-a83e-cf4604dfe9cc service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:11:08.912249 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1165/2291] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:11:14.276753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e89466-e894-459f-b02c-a9c56fef19af None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:14.277287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e89466-e894-459f-b02c-a9c56fef19af None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:14.277287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e89466-e894-459f-b02c-a9c56fef19af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:14.297187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-c4e89466-e894-459f-b02c-a9c56fef19af None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:11:14.302352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c4e89466-e894-459f-b02c-a9c56fef19af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:14.306335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1127/2292] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Sep 1 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:11:14.331180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efc4d7-137a-4283-a83e-cf4604dfe9cc service nova] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:11:14.343413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efc4d7-137a-4283-a83e-cf4604dfe9cc service nova] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:11:14.348865 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a22e0-4b78-4faa-997a-a133c979c866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:11:14.349565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a22e0-4b78-4faa-997a-a133c979c866 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:14.349836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a22e0-4b78-4faa-997a-a133c979c866 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:14.350107 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a22e0-4b78-4faa-997a-a133c979c866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:14.358101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a22e0-4b78-4faa-997a-a133c979c866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:11:14.359658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a22e0-4b78-4faa-997a-a133c979c866 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:11:14.368967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1166/2293] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:11:14.472489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ab572-92b6-4b10-8094-3bd9815ce1a1 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:14.472779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ab572-92b6-4b10-8094-3bd9815ce1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:14.473054 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ab572-92b6-4b10-8094-3bd9815ce1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:14.493563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-289ab572-92b6-4b10-8094-3bd9815ce1a1 None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:11:14.494778 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-289ab572-92b6-4b10-8094-3bd9815ce1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:14.502023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1128/2294] 10.222.0.64 () {58 vars in 967 bytes} [Thu Sep 1 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:11:14.524737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a22e0-4b78-4faa-997a-a133c979c866 service nova] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:11:14.536562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a22e0-4b78-4faa-997a-a133c979c866 service nova] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:11:14.541567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19514949-8ed9-447b-ab46-fdc4094d9d91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:11:14.542235 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19514949-8ed9-447b-ab46-fdc4094d9d91 service swift] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:14.542518 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19514949-8ed9-447b-ab46-fdc4094d9d91 service swift] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:14.542796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19514949-8ed9-447b-ab46-fdc4094d9d91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:14.550799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19514949-8ed9-447b-ab46-fdc4094d9d91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:11:14.553937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19514949-8ed9-447b-ab46-fdc4094d9d91 service swift] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:11:14.560507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1167/2295] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:11:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:11:19.105472 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4a87d-8775-4df9-88c9-1ef2336d9b31 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:19.105980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4a87d-8775-4df9-88c9-1ef2336d9b31 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:19.106114 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4a87d-8775-4df9-88c9-1ef2336d9b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:19.126376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-63d4a87d-8775-4df9-88c9-1ef2336d9b31 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:11:19.127583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-63d4a87d-8775-4df9-88c9-1ef2336d9b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:19.135493 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1129/2296] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Sep 1 14:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:11:19.157863 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19514949-8ed9-447b-ab46-fdc4094d9d91 service swift] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:11:19.170660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19514949-8ed9-447b-ab46-fdc4094d9d91 service swift] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:11:19.176260 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee9ed1-4756-4700-9521-2044c88ca3c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:11:19.176861 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee9ed1-4756-4700-9521-2044c88ca3c5 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:19.177149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee9ed1-4756-4700-9521-2044c88ca3c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:19.177425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee9ed1-4756-4700-9521-2044c88ca3c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:19.186108 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee9ed1-4756-4700-9521-2044c88ca3c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:11:19.187690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee9ed1-4756-4700-9521-2044c88ca3c5 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:11:19.197199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1168/2297] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:11:24.562258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aa7ba-13da-4aad-8199-109cf1e11f92 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:24.562825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aa7ba-13da-4aad-8199-109cf1e11f92 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:24.562825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16aa7ba-13da-4aad-8199-109cf1e11f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:24.582073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-c16aa7ba-13da-4aad-8199-109cf1e11f92 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:11:24.583814 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c16aa7ba-13da-4aad-8199-109cf1e11f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:24.591965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1130/2298] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Sep 1 14:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:11:24.617912 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee9ed1-4756-4700-9521-2044c88ca3c5 service nova] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:11:24.619271 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3bee9ed1-4756-4700-9521-2044c88ca3c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:24.633652 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee9ed1-4756-4700-9521-2044c88ca3c5 service nova] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:11:24.639029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e947a-e782-410a-a2e8-267ee681cc29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:11:24.645348 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e947a-e782-410a-a2e8-267ee681cc29 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:24.645348 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e947a-e782-410a-a2e8-267ee681cc29 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:24.645348 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e947a-e782-410a-a2e8-267ee681cc29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:24.648676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e947a-e782-410a-a2e8-267ee681cc29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:11:24.650338 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e947a-e782-410a-a2e8-267ee681cc29 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:11:24.659964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1169/2299] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:11:29.817044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745f66d-e855-4ead-82eb-b22ef2cd6670 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:29.817593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745f66d-e855-4ead-82eb-b22ef2cd6670 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:29.817593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745f66d-e855-4ead-82eb-b22ef2cd6670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:29.837647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-c745f66d-e855-4ead-82eb-b22ef2cd6670 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:11:29.838892 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c745f66d-e855-4ead-82eb-b22ef2cd6670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:29.847023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1131/2300] 10.222.0.69 () {58 vars in 1016 bytes} [Thu Sep 1 14:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:11:29.871680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e947a-e782-410a-a2e8-267ee681cc29 service nova] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:11:29.882995 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e947a-e782-410a-a2e8-267ee681cc29 service nova] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:11:29.888849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df7309-a97d-40cd-b872-f0b52a02fadb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:11:29.889675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df7309-a97d-40cd-b872-f0b52a02fadb service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:29.889952 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df7309-a97d-40cd-b872-f0b52a02fadb service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:29.890229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df7309-a97d-40cd-b872-f0b52a02fadb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:29.900322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df7309-a97d-40cd-b872-f0b52a02fadb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:11:29.906707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df7309-a97d-40cd-b872-f0b52a02fadb service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:11:29.911759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1170/2301] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:11:34.968589 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745f66d-e855-4ead-82eb-b22ef2cd6670 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:11:34.971825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c745f66d-e855-4ead-82eb-b22ef2cd6670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:34.975521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=43 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:35.025521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745f66d-e855-4ead-82eb-b22ef2cd6670 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:11:35.029065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424f90f-8cc8-4a19-8535-dc1104d65e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:11:35.029672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424f90f-8cc8-4a19-8535-dc1104d65e11 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:35.029947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424f90f-8cc8-4a19-8535-dc1104d65e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:35.030216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424f90f-8cc8-4a19-8535-dc1104d65e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:35.031923 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f424f90f-8cc8-4a19-8535-dc1104d65e11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:35.045340 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424f90f-8cc8-4a19-8535-dc1104d65e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:11:35.046743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424f90f-8cc8-4a19-8535-dc1104d65e11 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:11:35.057287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1132/2302] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:11:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:11:36.874690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df7309-a97d-40cd-b872-f0b52a02fadb service nova] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:11:36.877606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d4df7309-a97d-40cd-b872-f0b52a02fadb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:36.885177 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=37 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:36.890689 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df7309-a97d-40cd-b872-f0b52a02fadb service nova] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:11:36.894403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ae71a-e24d-4367-be94-9200e0f9d943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:11:36.895002 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ae71a-e24d-4367-be94-9200e0f9d943 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:36.895282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ae71a-e24d-4367-be94-9200e0f9d943 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:36.895555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ae71a-e24d-4367-be94-9200e0f9d943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:36.897424 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-7c4ae71a-e24d-4367-be94-9200e0f9d943 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:36.912123 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ae71a-e24d-4367-be94-9200e0f9d943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:11:36.913566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ae71a-e24d-4367-be94-9200e0f9d943 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:11:36.924880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1171/2303] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:11:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:11:42.860592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424f90f-8cc8-4a19-8535-dc1104d65e11 service cinder] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:11:42.869985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424f90f-8cc8-4a19-8535-dc1104d65e11 service cinder] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:11:42.873729 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c26a5-7a44-4e18-a83d-22ed008f2080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:11:42.874330 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c26a5-7a44-4e18-a83d-22ed008f2080 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:11:42.874609 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c26a5-7a44-4e18-a83d-22ed008f2080 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:11:42.874878 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c26a5-7a44-4e18-a83d-22ed008f2080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:11:42.876612 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-825c26a5-7a44-4e18-a83d-22ed008f2080 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:11:42.938380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c26a5-7a44-4e18-a83d-22ed008f2080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:11:42.939809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c26a5-7a44-4e18-a83d-22ed008f2080 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:11:42.952878 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1133/2304] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:11:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:11:47.046117 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=5 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:52.945584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=53 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:01.277287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ae71a-e24d-4367-be94-9200e0f9d943 service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:01.278817 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-7c4ae71a-e24d-4367-be94-9200e0f9d943 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:01.290271 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ae71a-e24d-4367-be94-9200e0f9d943 service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:01.293984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a309f4-c6fa-4399-bea6-4d3730270053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:01.294584 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a309f4-c6fa-4399-bea6-4d3730270053 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:01.294861 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a309f4-c6fa-4399-bea6-4d3730270053 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:01.295133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a309f4-c6fa-4399-bea6-4d3730270053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:01.296839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-22a309f4-c6fa-4399-bea6-4d3730270053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:01.306217 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a309f4-c6fa-4399-bea6-4d3730270053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:01.307626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a309f4-c6fa-4399-bea6-4d3730270053 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:01.315365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1172/2305] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:12:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:12:05.646047 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c26a5-7a44-4e18-a83d-22ed008f2080 service cinder] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:05.660097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c26a5-7a44-4e18-a83d-22ed008f2080 service cinder] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:05.666279 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7586-d758-425a-9e70-4068dd2c876f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:05.666897 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7586-d758-425a-9e70-4068dd2c876f service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:05.667182 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7586-d758-425a-9e70-4068dd2c876f service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:05.667541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad7586-d758-425a-9e70-4068dd2c876f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:05.669284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-09ad7586-d758-425a-9e70-4068dd2c876f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:05.730675 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7586-d758-425a-9e70-4068dd2c876f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:05.732377 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad7586-d758-425a-9e70-4068dd2c876f service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:05.741755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1134/2306] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:12:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:12:09.580064 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a309f4-c6fa-4399-bea6-4d3730270053 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:09.594903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a309f4-c6fa-4399-bea6-4d3730270053 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:09.601279 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb44b0-ebd5-41d5-af01-cc0e8c579260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:09.601896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb44b0-ebd5-41d5-af01-cc0e8c579260 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:09.602341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb44b0-ebd5-41d5-af01-cc0e8c579260 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:09.602613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb44b0-ebd5-41d5-af01-cc0e8c579260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:09.604410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-8edb44b0-ebd5-41d5-af01-cc0e8c579260 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:09.618845 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb44b0-ebd5-41d5-af01-cc0e8c579260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:09.620465 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb44b0-ebd5-41d5-af01-cc0e8c579260 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:09.631800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1173/2307] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:12:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:12:12.770436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7586-d758-425a-9e70-4068dd2c876f service nova] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:12.771932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-09ad7586-d758-425a-9e70-4068dd2c876f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:12.788007 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad7586-d758-425a-9e70-4068dd2c876f service nova] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:12.794472 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9a380-43c8-4084-af1c-b77e2d85eb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:12.795161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9a380-43c8-4084-af1c-b77e2d85eb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:12.795561 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9a380-43c8-4084-af1c-b77e2d85eb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:12.796059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9a380-43c8-4084-af1c-b77e2d85eb02 admin admin] PATH_INFO: `/v3/users/54ef2f77ecf54da6aa8dda65e72da09c` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:12.797283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9a380-43c8-4084-af1c-b77e2d85eb02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ef2f77ecf54da6aa8dda65e72da09c)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:12.800029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9a380-43c8-4084-af1c-b77e2d85eb02 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:13.008763 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7ef9a380-43c8-4084-af1c-b77e2d85eb02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ef2f77ecf54da6aa8dda65e72da09c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:12:13.009275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7ef9a380-43c8-4084-af1c-b77e2d85eb02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ef2f77ecf54da6aa8dda65e72da09c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:12:13.022680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7ef9a380-43c8-4084-af1c-b77e2d85eb02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ef2f77ecf54da6aa8dda65e72da09c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:12:13.114666 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7ef9a380-43c8-4084-af1c-b77e2d85eb02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ef2f77ecf54da6aa8dda65e72da09c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:12:13.115281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7ef9a380-43c8-4084-af1c-b77e2d85eb02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ef2f77ecf54da6aa8dda65e72da09c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:12:13.128220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1135/2308] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:12:12 2022] DELETE /identity/v3/users/54ef2f77ecf54da6aa8dda65e72da09c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:12:13.413237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb44b0-ebd5-41d5-af01-cc0e8c579260 service nova] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:13.425409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb44b0-ebd5-41d5-af01-cc0e8c579260 service nova] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:13.483841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defba164-1d76-4f0a-9290-fb2b5e05dac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:13.484506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba164-1d76-4f0a-9290-fb2b5e05dac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:13.484788 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba164-1d76-4f0a-9290-fb2b5e05dac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:13.485063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba164-1d76-4f0a-9290-fb2b5e05dac9 admin admin] PATH_INFO: `/v3/projects/3106cec73f7144de80fa942dd3f8a25c` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:13.486187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defba164-1d76-4f0a-9290-fb2b5e05dac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3106cec73f7144de80fa942dd3f8a25c)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:13.488127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defba164-1d76-4f0a-9290-fb2b5e05dac9 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:13.592319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-defba164-1d76-4f0a-9290-fb2b5e05dac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3106cec73f7144de80fa942dd3f8a25c', 'request_id': 'req-defba164-1d76-4f0a-9290-fb2b5e05dac9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:12:13.697770 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-defba164-1d76-4f0a-9290-fb2b5e05dac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3106cec73f7144de80fa942dd3f8a25c', 'request_id': 'req-defba164-1d76-4f0a-9290-fb2b5e05dac9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:12:13.705549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-defba164-1d76-4f0a-9290-fb2b5e05dac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3106cec73f7144de80fa942dd3f8a25c', 'request_id': 'req-defba164-1d76-4f0a-9290-fb2b5e05dac9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:12:13.717361 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-defba164-1d76-4f0a-9290-fb2b5e05dac9 admin admin] The token cache is being invalidate because project 3106cec73f7144de80fa942dd3f8a25c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:12:13.717655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-defba164-1d76-4f0a-9290-fb2b5e05dac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:12:13.718308 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-defba164-1d76-4f0a-9290-fb2b5e05dac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:12:13.719820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1174/2309] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:12:13 2022] DELETE /identity/v3/projects/3106cec73f7144de80fa942dd3f8a25c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:12:13.725158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cc4f7-0ba3-45da-ad68-4e084eeebc42 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:13.725413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cc4f7-0ba3-45da-ad68-4e084eeebc42 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:13.725695 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cc4f7-0ba3-45da-ad68-4e084eeebc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:13.745678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-3b3cc4f7-0ba3-45da-ad68-4e084eeebc42 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:12:13.746892 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-3b3cc4f7-0ba3-45da-ad68-4e084eeebc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:13.805795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1136/2310] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:12:13.813687 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f4150-e4f3-43b5-a8c8-45fafde7c01d None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:13.813975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f4150-e4f3-43b5-a8c8-45fafde7c01d None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:13.814255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f4150-e4f3-43b5-a8c8-45fafde7c01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:13.834166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-c09f4150-e4f3-43b5-a8c8-45fafde7c01d None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:12:13.835366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c09f4150-e4f3-43b5-a8c8-45fafde7c01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:13.843432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1175/2311] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:12:13.848310 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cc4f7-0ba3-45da-ad68-4e084eeebc42 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:13.858842 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cc4f7-0ba3-45da-ad68-4e084eeebc42 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:13.867393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10b6ce-d9e9-4f5b-a9ef-756ecdd29248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:13.869829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10b6ce-d9e9-4f5b-a9ef-756ecdd29248 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:13.870117 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10b6ce-d9e9-4f5b-a9ef-756ecdd29248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:13.870395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10b6ce-d9e9-4f5b-a9ef-756ecdd29248 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:13.871058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10b6ce-d9e9-4f5b-a9ef-756ecdd29248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:12:13.871397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10b6ce-d9e9-4f5b-a9ef-756ecdd29248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:13.873064 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10b6ce-d9e9-4f5b-a9ef-756ecdd29248 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:13.880949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:13.886079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1137/2312] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:12:13.890515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f4150-e4f3-43b5-a8c8-45fafde7c01d None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:13.900617 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f4150-e4f3-43b5-a8c8-45fafde7c01d None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:13.905361 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34565fc7-ce27-499f-bb34-0d3b754c0626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:13.905957 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34565fc7-ce27-499f-bb34-0d3b754c0626 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:13.906239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34565fc7-ce27-499f-bb34-0d3b754c0626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:13.906519 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34565fc7-ce27-499f-bb34-0d3b754c0626 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:13.907198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34565fc7-ce27-499f-bb34-0d3b754c0626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:13.909137 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34565fc7-ce27-499f-bb34-0d3b754c0626 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:14.042251 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1176/2313] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:12:13 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:12:14.046449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10b6ce-d9e9-4f5b-a9ef-756ecdd29248 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:14.057406 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10b6ce-d9e9-4f5b-a9ef-756ecdd29248 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:14.112459 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda895eb-fc8e-4f37-be89-b7130f8342d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:14.113663 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda895eb-fc8e-4f37-be89-b7130f8342d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:14.113947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda895eb-fc8e-4f37-be89-b7130f8342d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:14.114216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda895eb-fc8e-4f37-be89-b7130f8342d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:14.114849 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda895eb-fc8e-4f37-be89-b7130f8342d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:14.116810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda895eb-fc8e-4f37-be89-b7130f8342d7 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:14.280815 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1138/2314] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:12:14 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:12:14.284816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34565fc7-ce27-499f-bb34-0d3b754c0626 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:14.295206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34565fc7-ce27-499f-bb34-0d3b754c0626 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:14.299701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce95d26-2daa-472a-844f-539d50d14629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:14.300323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce95d26-2daa-472a-844f-539d50d14629 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:14.301093 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce95d26-2daa-472a-844f-539d50d14629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:14.301363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce95d26-2daa-472a-844f-539d50d14629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:14.301997 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce95d26-2daa-472a-844f-539d50d14629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:14.303635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce95d26-2daa-472a-844f-539d50d14629 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:14.313521 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1177/2315] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:12:14.317910 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda895eb-fc8e-4f37-be89-b7130f8342d7 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:14.329008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda895eb-fc8e-4f37-be89-b7130f8342d7 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:14.334093 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa976b-16a2-42a1-abe5-ff9c52d9382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:14.334703 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa976b-16a2-42a1-abe5-ff9c52d9382a admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:14.334983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa976b-16a2-42a1-abe5-ff9c52d9382a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:14.335255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa976b-16a2-42a1-abe5-ff9c52d9382a admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:14.335929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa976b-16a2-42a1-abe5-ff9c52d9382a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:14.337792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa976b-16a2-42a1-abe5-ff9c52d9382a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:14.348725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1139/2316] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:12:14.353032 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce95d26-2daa-472a-844f-539d50d14629 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:14.363644 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce95d26-2daa-472a-844f-539d50d14629 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:14.368461 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3f96e-0507-4016-a53d-6245fec09d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:14.371844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3f96e-0507-4016-a53d-6245fec09d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:14.371844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3f96e-0507-4016-a53d-6245fec09d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:14.371844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3f96e-0507-4016-a53d-6245fec09d46 admin admin] PATH_INFO: `/v3/projects/66ec11cfcbf04923a3b109e45e645ab3/users/9ca820c9c8634a958981e2e66d0673d3/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:14.384310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3f96e-0507-4016-a53d-6245fec09d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ec11cfcbf04923a3b109e45e645ab3, user_id=9ca820c9c8634a958981e2e66d0673d3, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:14.386951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3f96e-0507-4016-a53d-6245fec09d46 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:14.483490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:14.488327 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1178/2317] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:12:14 2022] PUT /identity/v3/projects/66ec11cfcbf04923a3b109e45e645ab3/users/9ca820c9c8634a958981e2e66d0673d3/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:12:14.493511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7427a-54db-4f73-9823-1d45736c74bd None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:14.493826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7427a-54db-4f73-9823-1d45736c74bd None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:14.494101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7427a-54db-4f73-9823-1d45736c74bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:14.512980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-93a7427a-54db-4f73-9823-1d45736c74bd None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:12:14.514182 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-93a7427a-54db-4f73-9823-1d45736c74bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:14.577458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1140/2318] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:12:14.588293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3f96e-0507-4016-a53d-6245fec09d46 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:14.589966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-7cb3f96e-0507-4016-a53d-6245fec09d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:14.647544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3f96e-0507-4016-a53d-6245fec09d46 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:14.651257 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95185350-a2f2-4372-aa27-2352c0e81bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:14.651850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95185350-a2f2-4372-aa27-2352c0e81bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:14.652151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95185350-a2f2-4372-aa27-2352c0e81bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:14.652417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95185350-a2f2-4372-aa27-2352c0e81bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:14.661487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95185350-a2f2-4372-aa27-2352c0e81bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:14.662893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95185350-a2f2-4372-aa27-2352c0e81bb3 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:14.672416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1179/2319] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:12:21.258482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde704d0-d81b-4da4-8bcc-e5f9946e1d12 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:21.259282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde704d0-d81b-4da4-8bcc-e5f9946e1d12 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:21.259282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde704d0-d81b-4da4-8bcc-e5f9946e1d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:21.290001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-bde704d0-d81b-4da4-8bcc-e5f9946e1d12 None None] MFA Rules not processed for user `9ca820c9c8634a958981e2e66d0673d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:12:21.291229 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bde704d0-d81b-4da4-8bcc-e5f9946e1d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:21.365752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1141/2320] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:12:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:12:21.372376 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95185350-a2f2-4372-aa27-2352c0e81bb3 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:21.383216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95185350-a2f2-4372-aa27-2352c0e81bb3 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:21.388665 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c722e-f072-4cc6-b7ac-1f40a4c3d090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:21.389387 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c722e-f072-4cc6-b7ac-1f40a4c3d090 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:21.389737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c722e-f072-4cc6-b7ac-1f40a4c3d090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:21.390104 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c722e-f072-4cc6-b7ac-1f40a4c3d090 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:21.390815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c722e-f072-4cc6-b7ac-1f40a4c3d090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:21.392881 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c722e-f072-4cc6-b7ac-1f40a4c3d090 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:21.528286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1180/2321] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:12:21 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:12:21.532304 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde704d0-d81b-4da4-8bcc-e5f9946e1d12 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:21.543980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde704d0-d81b-4da4-8bcc-e5f9946e1d12 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:21.547781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:21.604411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456afbf2-db3c-4898-a997-d129f917c640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:21.605081 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456afbf2-db3c-4898-a997-d129f917c640 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:21.605370 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456afbf2-db3c-4898-a997-d129f917c640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:21.605645 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456afbf2-db3c-4898-a997-d129f917c640 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:21.606288 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456afbf2-db3c-4898-a997-d129f917c640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:21.608356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456afbf2-db3c-4898-a997-d129f917c640 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:21.702308 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1142/2322] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:12:21 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:12:21.706336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c722e-f072-4cc6-b7ac-1f40a4c3d090 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:21.717371 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c722e-f072-4cc6-b7ac-1f40a4c3d090 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:21.722015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7530b1-db53-4e36-b3ed-e200f90f3b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:21.723149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7530b1-db53-4e36-b3ed-e200f90f3b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:21.723448 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7530b1-db53-4e36-b3ed-e200f90f3b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:21.723755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7530b1-db53-4e36-b3ed-e200f90f3b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:21.724475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7530b1-db53-4e36-b3ed-e200f90f3b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:21.726064 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7530b1-db53-4e36-b3ed-e200f90f3b91 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:21.736823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1181/2323] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:12:21.741438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456afbf2-db3c-4898-a997-d129f917c640 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:21.751467 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456afbf2-db3c-4898-a997-d129f917c640 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:21.756536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6a1f1-5d58-4d11-855b-ef5f3d2be1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:21.757315 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6a1f1-5d58-4d11-855b-ef5f3d2be1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:21.757614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6a1f1-5d58-4d11-855b-ef5f3d2be1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:21.757930 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6a1f1-5d58-4d11-855b-ef5f3d2be1f1 admin admin] PATH_INFO: `/v3/projects/55f0edd6f5664c9ead4abc22949dd34c/users/8c51252fb49a4d29a586596aeeeb668c/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:21.774434 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6a1f1-5d58-4d11-855b-ef5f3d2be1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f0edd6f5664c9ead4abc22949dd34c, user_id=8c51252fb49a4d29a586596aeeeb668c, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:21.776941 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6a1f1-5d58-4d11-855b-ef5f3d2be1f1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:21.863833 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1143/2324] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:12:21 2022] PUT /identity/v3/projects/55f0edd6f5664c9ead4abc22949dd34c/users/8c51252fb49a4d29a586596aeeeb668c/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:12:21.867990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7530b1-db53-4e36-b3ed-e200f90f3b91 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:21.878090 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7530b1-db53-4e36-b3ed-e200f90f3b91 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:21.933610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d3a60-771a-4163-bb80-3fc2d02fe058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:21.934213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d3a60-771a-4163-bb80-3fc2d02fe058 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:21.934492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d3a60-771a-4163-bb80-3fc2d02fe058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:21.934758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d3a60-771a-4163-bb80-3fc2d02fe058 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:21.935382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d3a60-771a-4163-bb80-3fc2d02fe058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:21.936995 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d3a60-771a-4163-bb80-3fc2d02fe058 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:21.946517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1182/2325] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:12:21.950685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6a1f1-5d58-4d11-855b-ef5f3d2be1f1 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:21.961863 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6a1f1-5d58-4d11-855b-ef5f3d2be1f1 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:21.966511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fc9a0-6685-4c20-8fe6-43d8246d63eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:21.967164 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc9a0-6685-4c20-8fe6-43d8246d63eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:21.967449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc9a0-6685-4c20-8fe6-43d8246d63eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:21.967726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc9a0-6685-4c20-8fe6-43d8246d63eb admin admin] PATH_INFO: `/v3/projects/55f0edd6f5664c9ead4abc22949dd34c/users/8c51252fb49a4d29a586596aeeeb668c/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:21.969693 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fc9a0-6685-4c20-8fe6-43d8246d63eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f0edd6f5664c9ead4abc22949dd34c, user_id=8c51252fb49a4d29a586596aeeeb668c, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:21.972924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fc9a0-6685-4c20-8fe6-43d8246d63eb admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:21.983388 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1144/2326] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:12:21 2022] PUT /identity/v3/projects/55f0edd6f5664c9ead4abc22949dd34c/users/8c51252fb49a4d29a586596aeeeb668c/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:12:26.466845 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd49c1-fce1-4b30-9e90-b0ec54cbdb8a None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:26.467383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd49c1-fce1-4b30-9e90-b0ec54cbdb8a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:26.467573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd49c1-fce1-4b30-9e90-b0ec54cbdb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:26.488678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-30dd49c1-fce1-4b30-9e90-b0ec54cbdb8a None None] MFA Rules not processed for user `9b6dee114b0b4db3ac98075847d613c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:12:26.490516 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-30dd49c1-fce1-4b30-9e90-b0ec54cbdb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:26.562238 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1183/2327] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:12:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:12:27.258482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fc9a0-6685-4c20-8fe6-43d8246d63eb admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:27.261089 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e27fc9a0-6685-4c20-8fe6-43d8246d63eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:27.323042 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fc9a0-6685-4c20-8fe6-43d8246d63eb admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:27.327009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0418821-2e49-48e1-a534-b160ed9a4e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:27.327898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0418821-2e49-48e1-a534-b160ed9a4e1c service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:27.329417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0418821-2e49-48e1-a534-b160ed9a4e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:27.329417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0418821-2e49-48e1-a534-b160ed9a4e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:27.330625 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e0418821-2e49-48e1-a534-b160ed9a4e1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:27.341775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0418821-2e49-48e1-a534-b160ed9a4e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:27.343219 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0418821-2e49-48e1-a534-b160ed9a4e1c service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:27.352642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1145/2328] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:12:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:12:27.903218 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd49c1-fce1-4b30-9e90-b0ec54cbdb8a None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:27.911402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-30dd49c1-fce1-4b30-9e90-b0ec54cbdb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:27.930392 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:28.074836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd49c1-fce1-4b30-9e90-b0ec54cbdb8a None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:28.082448 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca33a96-7b0d-4440-ba37-ad356f3f39aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec4f437077c41039cae3d505b43b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:28.087275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca33a96-7b0d-4440-ba37-ad356f3f39aa service placement] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:28.087275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca33a96-7b0d-4440-ba37-ad356f3f39aa service placement] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:28.087275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca33a96-7b0d-4440-ba37-ad356f3f39aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:28.087275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-dca33a96-7b0d-4440-ba37-ad356f3f39aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:28.102515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca33a96-7b0d-4440-ba37-ad356f3f39aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:28.104261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca33a96-7b0d-4440-ba37-ad356f3f39aa service placement] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:28.121586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1184/2329] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:12:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:12:29.020540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e30f1-19ee-4af0-a4ee-b48e15dcfe62 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:29.020540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e30f1-19ee-4af0-a4ee-b48e15dcfe62 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:29.020540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e30f1-19ee-4af0-a4ee-b48e15dcfe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:29.063400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-a16e30f1-19ee-4af0-a4ee-b48e15dcfe62 None None] MFA Rules not processed for user `8c51252fb49a4d29a586596aeeeb668c`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:12:29.064864 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a16e30f1-19ee-4af0-a4ee-b48e15dcfe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:29.124325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:29.147304 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1146/2330] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:12:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:12:29.160053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca33a96-7b0d-4440-ba37-ad356f3f39aa service placement] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:29.161415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-dca33a96-7b0d-4440-ba37-ad356f3f39aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:29.232740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca33a96-7b0d-4440-ba37-ad356f3f39aa service placement] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:29.237128 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c393a0-38f9-45c8-bc45-1eed12e245c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f750815038d404d9d39a68bf62db8c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:29.237814 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c393a0-38f9-45c8-bc45-1eed12e245c4 service glance] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:29.238284 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c393a0-38f9-45c8-bc45-1eed12e245c4 service glance] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:29.238559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c393a0-38f9-45c8-bc45-1eed12e245c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:29.307817 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c393a0-38f9-45c8-bc45-1eed12e245c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:29.309330 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c393a0-38f9-45c8-bc45-1eed12e245c4 service glance] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:29.318987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1185/2331] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:12:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:12:29.594626 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a75c7-cc14-4c57-add1-fe843c8f0c64 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:29.594916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a75c7-cc14-4c57-add1-fe843c8f0c64 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:29.595194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a75c7-cc14-4c57-add1-fe843c8f0c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:29.618728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-226a75c7-cc14-4c57-add1-fe843c8f0c64 None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:12:29.619987 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-226a75c7-cc14-4c57-add1-fe843c8f0c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:29.680597 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1147/2332] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 14:12:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:12:29.890230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c393a0-38f9-45c8-bc45-1eed12e245c4 service glance] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:29.890230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-30c393a0-38f9-45c8-bc45-1eed12e245c4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:29.947859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:29.965952 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c393a0-38f9-45c8-bc45-1eed12e245c4 service glance] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:29.971901 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef292e51-c1c6-4248-ae36-6efb1a1464c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:29.972528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef292e51-c1c6-4248-ae36-6efb1a1464c1 service swift] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:29.973112 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef292e51-c1c6-4248-ae36-6efb1a1464c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:29.973112 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef292e51-c1c6-4248-ae36-6efb1a1464c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:29.983765 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef292e51-c1c6-4248-ae36-6efb1a1464c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:29.985418 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef292e51-c1c6-4248-ae36-6efb1a1464c1 service swift] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:29.994492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1186/2333] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:12:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:12:34.795211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a75c7-cc14-4c57-add1-fe843c8f0c64 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:34.797397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-226a75c7-cc14-4c57-add1-fe843c8f0c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:34.955921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a75c7-cc14-4c57-add1-fe843c8f0c64 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:34.965238 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6b745-d7a3-4d17-abef-74aa9aa69159 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:34.965894 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6b745-d7a3-4d17-abef-74aa9aa69159 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:34.966183 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6b745-d7a3-4d17-abef-74aa9aa69159 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:34.966470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6b745-d7a3-4d17-abef-74aa9aa69159 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:34.975073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e0d6b745-d7a3-4d17-abef-74aa9aa69159 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:35.063766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6b745-d7a3-4d17-abef-74aa9aa69159 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:35.066185 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6b745-d7a3-4d17-abef-74aa9aa69159 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:35.090369 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1148/2334] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:12:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:12:35.397863 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef292e51-c1c6-4248-ae36-6efb1a1464c1 service swift] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:35.399501 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ef292e51-c1c6-4248-ae36-6efb1a1464c1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:35.436140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef292e51-c1c6-4248-ae36-6efb1a1464c1 service swift] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:35.449549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeef227-eb7c-4b8f-84a2-650501c2edb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:35.450185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeef227-eb7c-4b8f-84a2-650501c2edb2 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:35.450468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeef227-eb7c-4b8f-84a2-650501c2edb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:35.450746 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeef227-eb7c-4b8f-84a2-650501c2edb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:35.453211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fbeef227-eb7c-4b8f-84a2-650501c2edb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:35.470435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeef227-eb7c-4b8f-84a2-650501c2edb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:35.472223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeef227-eb7c-4b8f-84a2-650501c2edb2 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:35.489387 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1187/2335] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:12:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:12:42.885074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9a0da-d352-4b82-8389-74b6e54541cf None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:42.885591 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9a0da-d352-4b82-8389-74b6e54541cf None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:42.894745 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9a0da-d352-4b82-8389-74b6e54541cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:42.914816 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-d2c9a0da-d352-4b82-8389-74b6e54541cf None None] MFA Rules not processed for user `9ca820c9c8634a958981e2e66d0673d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:12:42.916097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d2c9a0da-d352-4b82-8389-74b6e54541cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:42.923355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1149/2336] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:12:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:12:43.241929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeef227-eb7c-4b8f-84a2-650501c2edb2 service nova] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:43.255026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeef227-eb7c-4b8f-84a2-650501c2edb2 service nova] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:43.258625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03846c-9fd7-4952-a876-f49b23678314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:43.259233 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03846c-9fd7-4952-a876-f49b23678314 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:43.259516 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03846c-9fd7-4952-a876-f49b23678314 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:43.259790 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03846c-9fd7-4952-a876-f49b23678314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:43.261985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ff03846c-9fd7-4952-a876-f49b23678314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:43.273180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03846c-9fd7-4952-a876-f49b23678314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:43.274618 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03846c-9fd7-4952-a876-f49b23678314 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:43.283843 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1188/2337] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:12:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:12:43.862801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9a0da-d352-4b82-8389-74b6e54541cf None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:43.875748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9a0da-d352-4b82-8389-74b6e54541cf None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:43.883004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692943a-b90f-4106-bd19-c3e1d48070ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:43.883929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692943a-b90f-4106-bd19-c3e1d48070ba service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:43.884563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692943a-b90f-4106-bd19-c3e1d48070ba service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:43.885178 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692943a-b90f-4106-bd19-c3e1d48070ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:43.887738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-0692943a-b90f-4106-bd19-c3e1d48070ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:43.901547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692943a-b90f-4106-bd19-c3e1d48070ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:43.916132 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692943a-b90f-4106-bd19-c3e1d48070ba service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:43.931616 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1150/2338] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:12:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:12:50.533705 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff55a2-14b4-42b7-a4d6-ed854e9e6bf9 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:50.534278 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff55a2-14b4-42b7-a4d6-ed854e9e6bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:50.534278 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff55a2-14b4-42b7-a4d6-ed854e9e6bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:50.557089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-00ff55a2-14b4-42b7-a4d6-ed854e9e6bf9 None None] MFA Rules not processed for user `d7956f61efc44be8abbce5033cc95849`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:12:50.558340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-00ff55a2-14b4-42b7-a4d6-ed854e9e6bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:50.570890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1189/2339] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:12:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:12:51.292732 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d0350-c685-4c13-bfae-65e91f064d3a None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:51.293212 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d0350-c685-4c13-bfae-65e91f064d3a None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:51.293477 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d0350-c685-4c13-bfae-65e91f064d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:51.314141 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-759d0350-c685-4c13-bfae-65e91f064d3a None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:12:51.315376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-759d0350-c685-4c13-bfae-65e91f064d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:51.322887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1151/2340] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 14:12:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:12:51.335938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff55a2-14b4-42b7-a4d6-ed854e9e6bf9 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:51.348820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff55a2-14b4-42b7-a4d6-ed854e9e6bf9 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:51.354226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c13646-60a7-4008-b439-e373e67f3973 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:51.354914 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c13646-60a7-4008-b439-e373e67f3973 service swift] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:51.355290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c13646-60a7-4008-b439-e373e67f3973 service swift] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:51.355636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c13646-60a7-4008-b439-e373e67f3973 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:51.365913 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c13646-60a7-4008-b439-e373e67f3973 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:51.367560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c13646-60a7-4008-b439-e373e67f3973 service swift] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:51.376851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1190/2341] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:12:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:12:51.531284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928697c-1e58-48c7-bb60-ccfaf560dcee None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:51.531616 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928697c-1e58-48c7-bb60-ccfaf560dcee None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:51.531925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928697c-1e58-48c7-bb60-ccfaf560dcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:51.539070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:51.558846 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e928697c-1e58-48c7-bb60-ccfaf560dcee None None] MFA Rules not processed for user `002a16d91db244028250b9d7781937df`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:12:51.560196 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e928697c-1e58-48c7-bb60-ccfaf560dcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:51.651463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1152/2342] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:12:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:12:57.466792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c13646-60a7-4008-b439-e373e67f3973 service swift] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:12:57.478309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c13646-60a7-4008-b439-e373e67f3973 service swift] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:12:57.482200 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af09c51-6a32-443e-9973-ffa4ab4a4807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:12:57.482824 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af09c51-6a32-443e-9973-ffa4ab4a4807 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:12:57.483113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af09c51-6a32-443e-9973-ffa4ab4a4807 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:12:57.483392 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af09c51-6a32-443e-9973-ffa4ab4a4807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:12:57.485632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-8af09c51-6a32-443e-9973-ffa4ab4a4807 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:12:57.506897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af09c51-6a32-443e-9973-ffa4ab4a4807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:12:57.509745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af09c51-6a32-443e-9973-ffa4ab4a4807 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:12:57.520254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1191/2343] 10.222.0.64 () {60 vars in 1396 bytes} [Thu Sep 1 14:12:57 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3270 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:13:01.833582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=24 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:07.515062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=34 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:31.055945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928697c-1e58-48c7-bb60-ccfaf560dcee None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:13:31.065646 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928697c-1e58-48c7-bb60-ccfaf560dcee None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:13:31.069331 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d9466-3024-4dfa-b3e9-2d61e50e0c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:13:31.069939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9466-3024-4dfa-b3e9-2d61e50e0c86 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:13:31.070221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9466-3024-4dfa-b3e9-2d61e50e0c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:13:31.070494 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9466-3024-4dfa-b3e9-2d61e50e0c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:13:31.081933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d9466-3024-4dfa-b3e9-2d61e50e0c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:13:31.083422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d9466-3024-4dfa-b3e9-2d61e50e0c86 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:13:31.093610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1153/2344] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:13:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:13:31.323466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b730b-9964-48ba-9581-960690f312d1 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:13:31.324150 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b730b-9964-48ba-9581-960690f312d1 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:13:31.324150 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b730b-9964-48ba-9581-960690f312d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:13:31.345412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-889b730b-9964-48ba-9581-960690f312d1 None None] MFA Rules not processed for user `50b3952a90ce47f48cc0a820111604f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:13:31.348610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-889b730b-9964-48ba-9581-960690f312d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:13:31.402798 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1192/2345] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:13:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:13:41.089118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=6 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:41.396045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=25 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:33.154573 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d9466-3024-4dfa-b3e9-2d61e50e0c86 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:33.222323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d9466-3024-4dfa-b3e9-2d61e50e0c86 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:33.227831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397b427-a026-442b-9a46-a5f8900f1a1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec4f437077c41039cae3d505b43b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:33.228458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397b427-a026-442b-9a46-a5f8900f1a1f service placement] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:33.228743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397b427-a026-442b-9a46-a5f8900f1a1f service placement] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:33.229019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397b427-a026-442b-9a46-a5f8900f1a1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:33.230802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e397b427-a026-442b-9a46-a5f8900f1a1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:14:33.265168 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397b427-a026-442b-9a46-a5f8900f1a1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:33.266787 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397b427-a026-442b-9a46-a5f8900f1a1f service placement] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:33.277082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1154/2346] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:14:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:14:43.272613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=36 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:51.536864 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b730b-9964-48ba-9581-960690f312d1 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:51.562267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b730b-9964-48ba-9581-960690f312d1 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:51.565929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc8d22-5b45-4afc-b16e-3281e96eb385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:51.566537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc8d22-5b45-4afc-b16e-3281e96eb385 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:51.566816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc8d22-5b45-4afc-b16e-3281e96eb385 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:51.567085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc8d22-5b45-4afc-b16e-3281e96eb385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:51.568817 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-05dc8d22-5b45-4afc-b16e-3281e96eb385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:14:51.658238 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc8d22-5b45-4afc-b16e-3281e96eb385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:51.659685 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc8d22-5b45-4afc-b16e-3281e96eb385 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:51.679951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1193/2347] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:14:52.662439 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0d075-e060-43e2-a407-d007696a4c3c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:52.662439 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0d075-e060-43e2-a407-d007696a4c3c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:52.662439 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0d075-e060-43e2-a407-d007696a4c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:52.681554 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-20f0d075-e060-43e2-a407-d007696a4c3c None None] MFA Rules not processed for user `9b6dee114b0b4db3ac98075847d613c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:14:52.682822 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-20f0d075-e060-43e2-a407-d007696a4c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:14:52.691162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1155/2348] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:14:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:14:55.893244 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc8d22-5b45-4afc-b16e-3281e96eb385 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:55.894659 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-05dc8d22-5b45-4afc-b16e-3281e96eb385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:14:55.908595 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc8d22-5b45-4afc-b16e-3281e96eb385 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:55.913582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23120b4-a033-42d8-abe9-e88782e49ba1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec4f437077c41039cae3d505b43b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:55.914187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23120b4-a033-42d8-abe9-e88782e49ba1 service placement] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:55.914467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23120b4-a033-42d8-abe9-e88782e49ba1 service placement] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:55.914742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23120b4-a033-42d8-abe9-e88782e49ba1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:55.916507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a23120b4-a033-42d8-abe9-e88782e49ba1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:14:55.928311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23120b4-a033-42d8-abe9-e88782e49ba1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:55.932951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23120b4-a033-42d8-abe9-e88782e49ba1 service placement] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:55.941452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1194/2349] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:14:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:14:56.057247 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0d075-e060-43e2-a407-d007696a4c3c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:56.058723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-20f0d075-e060-43e2-a407-d007696a4c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:14:56.073203 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0d075-e060-43e2-a407-d007696a4c3c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:56.078301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae8c26-124c-49c9-8466-7d3532c4e755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:56.079101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae8c26-124c-49c9-8466-7d3532c4e755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:56.079398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae8c26-124c-49c9-8466-7d3532c4e755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:56.079799 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae8c26-124c-49c9-8466-7d3532c4e755 admin admin] PATH_INFO: `/v3/users/002a16d91db244028250b9d7781937df` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:56.081777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae8c26-124c-49c9-8466-7d3532c4e755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=002a16d91db244028250b9d7781937df)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:56.084325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae8c26-124c-49c9-8466-7d3532c4e755 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:56.335764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-beae8c26-124c-49c9-8466-7d3532c4e755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '002a16d91db244028250b9d7781937df'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:14:56.336570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-beae8c26-124c-49c9-8466-7d3532c4e755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '002a16d91db244028250b9d7781937df'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:14:56.348648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-beae8c26-124c-49c9-8466-7d3532c4e755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '002a16d91db244028250b9d7781937df'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:14:56.464683 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-beae8c26-124c-49c9-8466-7d3532c4e755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '002a16d91db244028250b9d7781937df'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:14:56.465285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-beae8c26-124c-49c9-8466-7d3532c4e755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '002a16d91db244028250b9d7781937df'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:14:56.479678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1156/2350] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:14:56 2022] DELETE /identity/v3/users/002a16d91db244028250b9d7781937df => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:14:56.752833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23120b4-a033-42d8-abe9-e88782e49ba1 service placement] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:56.765921 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23120b4-a033-42d8-abe9-e88782e49ba1 service placement] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:56.828468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc838bb9-82eb-4526-960b-38f0f6fcf4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:56.829114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc838bb9-82eb-4526-960b-38f0f6fcf4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:56.829525 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc838bb9-82eb-4526-960b-38f0f6fcf4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:56.829806 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc838bb9-82eb-4526-960b-38f0f6fcf4bc admin admin] PATH_INFO: `/v3/projects/985c4362b58c4962ae065ec095d2f1b8` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:56.831055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc838bb9-82eb-4526-960b-38f0f6fcf4bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=985c4362b58c4962ae065ec095d2f1b8)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:56.833028 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc838bb9-82eb-4526-960b-38f0f6fcf4bc admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:56.978365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:56.986800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bc838bb9-82eb-4526-960b-38f0f6fcf4bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985c4362b58c4962ae065ec095d2f1b8', 'request_id': 'req-bc838bb9-82eb-4526-960b-38f0f6fcf4bc'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:14:57.094303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bc838bb9-82eb-4526-960b-38f0f6fcf4bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985c4362b58c4962ae065ec095d2f1b8', 'request_id': 'req-bc838bb9-82eb-4526-960b-38f0f6fcf4bc'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:14:57.102295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bc838bb9-82eb-4526-960b-38f0f6fcf4bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985c4362b58c4962ae065ec095d2f1b8', 'request_id': 'req-bc838bb9-82eb-4526-960b-38f0f6fcf4bc'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:14:57.114691 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bc838bb9-82eb-4526-960b-38f0f6fcf4bc admin admin] The token cache is being invalidate because project 985c4362b58c4962ae065ec095d2f1b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:14:57.114990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bc838bb9-82eb-4526-960b-38f0f6fcf4bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:14:57.115880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bc838bb9-82eb-4526-960b-38f0f6fcf4bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:14:57.117475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1195/2351] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:14:56 2022] DELETE /identity/v3/projects/985c4362b58c4962ae065ec095d2f1b8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:14:57.122586 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa41e1-eeba-4800-a483-1389a0e458d4 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:57.124033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa41e1-eeba-4800-a483-1389a0e458d4 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:57.124509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa41e1-eeba-4800-a483-1389a0e458d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:57.200529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-ebfa41e1-eeba-4800-a483-1389a0e458d4 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:14:57.202345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ebfa41e1-eeba-4800-a483-1389a0e458d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:14:57.268946 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1157/2352] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:14:57.279096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e42dfd-0e8a-4474-a2dd-12ed277a9a47 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:57.279383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e42dfd-0e8a-4474-a2dd-12ed277a9a47 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:57.279899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e42dfd-0e8a-4474-a2dd-12ed277a9a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:57.311834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-99e42dfd-0e8a-4474-a2dd-12ed277a9a47 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:14:57.314171 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-99e42dfd-0e8a-4474-a2dd-12ed277a9a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:14:57.325156 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1196/2353] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:14:57.330120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa41e1-eeba-4800-a483-1389a0e458d4 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:57.341897 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa41e1-eeba-4800-a483-1389a0e458d4 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:57.347699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d76e92-07b6-41c0-abae-07b58f4017ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:57.348376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76e92-07b6-41c0-abae-07b58f4017ab admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:57.348729 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76e92-07b6-41c0-abae-07b58f4017ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:57.349008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d76e92-07b6-41c0-abae-07b58f4017ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:57.349677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d76e92-07b6-41c0-abae-07b58f4017ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:14:57.349986 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d76e92-07b6-41c0-abae-07b58f4017ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:57.351632 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d76e92-07b6-41c0-abae-07b58f4017ab admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:57.365022 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1158/2354] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:14:57.369489 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e42dfd-0e8a-4474-a2dd-12ed277a9a47 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:57.379708 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e42dfd-0e8a-4474-a2dd-12ed277a9a47 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:57.384333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43afa8-4970-4228-8e37-4045312851c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:57.384929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43afa8-4970-4228-8e37-4045312851c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:57.385239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43afa8-4970-4228-8e37-4045312851c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:57.385644 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43afa8-4970-4228-8e37-4045312851c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:57.386287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43afa8-4970-4228-8e37-4045312851c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:57.388259 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43afa8-4970-4228-8e37-4045312851c5 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:57.491697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1197/2355] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:14:57 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:14:57.494433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d76e92-07b6-41c0-abae-07b58f4017ab admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:57.505352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d76e92-07b6-41c0-abae-07b58f4017ab admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:57.524827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:57.564805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd57ac8-cc7a-43ea-a148-f700e2a0dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:57.565439 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd57ac8-cc7a-43ea-a148-f700e2a0dbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:57.565752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd57ac8-cc7a-43ea-a148-f700e2a0dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:57.566031 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd57ac8-cc7a-43ea-a148-f700e2a0dbb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:57.566714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd57ac8-cc7a-43ea-a148-f700e2a0dbb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:57.568762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd57ac8-cc7a-43ea-a148-f700e2a0dbb3 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:57.694106 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1159/2356] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:14:57 2022] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:14:57.698464 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43afa8-4970-4228-8e37-4045312851c5 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:57.712133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43afa8-4970-4228-8e37-4045312851c5 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:57.716706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8508b-ee78-413f-a58a-360a5853c9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:57.717837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8508b-ee78-413f-a58a-360a5853c9cc admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:57.718118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8508b-ee78-413f-a58a-360a5853c9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:57.718386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8508b-ee78-413f-a58a-360a5853c9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:57.719036 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8508b-ee78-413f-a58a-360a5853c9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:57.720807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8508b-ee78-413f-a58a-360a5853c9cc admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:57.731151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1198/2357] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:14:57.735742 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd57ac8-cc7a-43ea-a148-f700e2a0dbb3 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:57.745969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd57ac8-cc7a-43ea-a148-f700e2a0dbb3 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:57.751095 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa22ea0-fa97-473a-9a72-f53e83a01b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:57.751821 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa22ea0-fa97-473a-9a72-f53e83a01b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:57.752206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa22ea0-fa97-473a-9a72-f53e83a01b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:57.752535 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa22ea0-fa97-473a-9a72-f53e83a01b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:57.753238 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa22ea0-fa97-473a-9a72-f53e83a01b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:57.754970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa22ea0-fa97-473a-9a72-f53e83a01b6c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:57.766708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1160/2358] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:14:57.771080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8508b-ee78-413f-a58a-360a5853c9cc admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:57.782150 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8508b-ee78-413f-a58a-360a5853c9cc admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:57.786723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a355cd1-5b7c-48f3-80bd-3b7033e8e345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:57.787389 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a355cd1-5b7c-48f3-80bd-3b7033e8e345 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:57.787676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a355cd1-5b7c-48f3-80bd-3b7033e8e345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:57.787987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a355cd1-5b7c-48f3-80bd-3b7033e8e345 admin admin] PATH_INFO: `/v3/projects/25e948792a404098b0fc7917c22c6646/users/e93138f3fb984b1ba1b0bc7e133f28f0/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:57.803454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a355cd1-5b7c-48f3-80bd-3b7033e8e345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e948792a404098b0fc7917c22c6646, user_id=e93138f3fb984b1ba1b0bc7e133f28f0, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:57.806262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a355cd1-5b7c-48f3-80bd-3b7033e8e345 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:57.924898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1199/2359] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:14:57 2022] PUT /identity/v3/projects/25e948792a404098b0fc7917c22c6646/users/e93138f3fb984b1ba1b0bc7e133f28f0/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:14:57.934951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f523ae-8825-4484-a845-b053f734f610 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:57.935232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f523ae-8825-4484-a845-b053f734f610 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:57.935503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f523ae-8825-4484-a845-b053f734f610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:57.965835 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-17f523ae-8825-4484-a845-b053f734f610 None None] MFA Rules not processed for user `e93138f3fb984b1ba1b0bc7e133f28f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:14:57.967097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-17f523ae-8825-4484-a845-b053f734f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:14:58.042642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1161/2360] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:14:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:14:58.043034 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a355cd1-5b7c-48f3-80bd-3b7033e8e345 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:58.118090 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a355cd1-5b7c-48f3-80bd-3b7033e8e345 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:58.122965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c2723-34b4-4143-b604-108c55332239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:58.124143 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c2723-34b4-4143-b604-108c55332239 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:58.124644 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c2723-34b4-4143-b604-108c55332239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:58.125075 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c2723-34b4-4143-b604-108c55332239 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:58.128523 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c2723-34b4-4143-b604-108c55332239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:58.128523 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c2723-34b4-4143-b604-108c55332239 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:58.300415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1200/2361] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:14:58 2022] POST /identity/v3/projects => generated 373 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:14:58.302262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f523ae-8825-4484-a845-b053f734f610 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:58.314106 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f523ae-8825-4484-a845-b053f734f610 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:58.373843 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514dbe9-7de8-4581-8c43-c642db79eac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:58.374637 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514dbe9-7de8-4581-8c43-c642db79eac4 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:58.374857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514dbe9-7de8-4581-8c43-c642db79eac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:58.375139 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514dbe9-7de8-4581-8c43-c642db79eac4 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:58.375905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514dbe9-7de8-4581-8c43-c642db79eac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:58.377803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514dbe9-7de8-4581-8c43-c642db79eac4 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:58.491424 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1162/2362] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:14:58 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:14:58.495250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c2723-34b4-4143-b604-108c55332239 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:58.506123 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c2723-34b4-4143-b604-108c55332239 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:58.510653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9e857-29bf-449d-94fe-f4f12c3190c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:58.511403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9e857-29bf-449d-94fe-f4f12c3190c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:58.511683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9e857-29bf-449d-94fe-f4f12c3190c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:58.512016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9e857-29bf-449d-94fe-f4f12c3190c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:58.512657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9e857-29bf-449d-94fe-f4f12c3190c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:58.514837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9e857-29bf-449d-94fe-f4f12c3190c6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:58.529271 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1201/2363] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:14:58.530496 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514dbe9-7de8-4581-8c43-c642db79eac4 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:58.540954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514dbe9-7de8-4581-8c43-c642db79eac4 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:58.546387 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addaff4-945e-48d0-b94a-3a8240279e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:58.547127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addaff4-945e-48d0-b94a-3a8240279e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:58.547418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addaff4-945e-48d0-b94a-3a8240279e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:58.547695 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addaff4-945e-48d0-b94a-3a8240279e5c admin admin] PATH_INFO: `/v3/projects/c544fa50cdba461dbc28a4a2ed8cd911/users/f76d42c4ee5b419e8f0c989bbef627e6/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:58.563902 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addaff4-945e-48d0-b94a-3a8240279e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c544fa50cdba461dbc28a4a2ed8cd911, user_id=f76d42c4ee5b419e8f0c989bbef627e6, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:58.566547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addaff4-945e-48d0-b94a-3a8240279e5c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:58.570538 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:58.731547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1163/2364] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:14:58 2022] PUT /identity/v3/projects/c544fa50cdba461dbc28a4a2ed8cd911/users/f76d42c4ee5b419e8f0c989bbef627e6/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:14:58.736532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9e857-29bf-449d-94fe-f4f12c3190c6 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:58.747152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9e857-29bf-449d-94fe-f4f12c3190c6 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:58.787509 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:58.806052 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687709f-0f77-4133-9c96-dcef59e0641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:58.806667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687709f-0f77-4133-9c96-dcef59e0641a admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:58.806947 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687709f-0f77-4133-9c96-dcef59e0641a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:58.807221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687709f-0f77-4133-9c96-dcef59e0641a admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:58.807994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687709f-0f77-4133-9c96-dcef59e0641a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:58.809538 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687709f-0f77-4133-9c96-dcef59e0641a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:58.828408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1202/2365] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:14:58.828659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addaff4-945e-48d0-b94a-3a8240279e5c admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:58.838585 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addaff4-945e-48d0-b94a-3a8240279e5c admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:58.844725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c4b51-1a33-481c-9f55-02ce7beb8d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:58.845466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4b51-1a33-481c-9f55-02ce7beb8d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:58.845893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4b51-1a33-481c-9f55-02ce7beb8d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:58.846170 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4b51-1a33-481c-9f55-02ce7beb8d4b admin admin] PATH_INFO: `/v3/projects/c544fa50cdba461dbc28a4a2ed8cd911/users/f76d42c4ee5b419e8f0c989bbef627e6/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:58.848116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c4b51-1a33-481c-9f55-02ce7beb8d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c544fa50cdba461dbc28a4a2ed8cd911, user_id=f76d42c4ee5b419e8f0c989bbef627e6, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:58.850904 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c4b51-1a33-481c-9f55-02ce7beb8d4b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:58.861851 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1164/2366] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:14:58 2022] PUT /identity/v3/projects/c544fa50cdba461dbc28a4a2ed8cd911/users/f76d42c4ee5b419e8f0c989bbef627e6/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:14:58.872640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7e7a3-2ff0-4bfd-ade4-691994345125 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:58.872929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7e7a3-2ff0-4bfd-ade4-691994345125 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:58.873729 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7e7a3-2ff0-4bfd-ade4-691994345125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:58.904116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-6ef7e7a3-2ff0-4bfd-ade4-691994345125 None None] MFA Rules not processed for user `f76d42c4ee5b419e8f0c989bbef627e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:14:58.905389 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6ef7e7a3-2ff0-4bfd-ade4-691994345125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:14:58.978220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1203/2367] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:14:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:14:58.990018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c4b51-1a33-481c-9f55-02ce7beb8d4b admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:58.991853 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c17c4b51-1a33-481c-9f55-02ce7beb8d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:14:59.080261 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c4b51-1a33-481c-9f55-02ce7beb8d4b admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:59.084871 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1ce47-9e59-4dfd-818b-fefee4b171eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:59.085577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1ce47-9e59-4dfd-818b-fefee4b171eb service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:59.085865 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1ce47-9e59-4dfd-818b-fefee4b171eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:59.086178 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1ce47-9e59-4dfd-818b-fefee4b171eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:59.096055 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1ce47-9e59-4dfd-818b-fefee4b171eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:59.097486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1ce47-9e59-4dfd-818b-fefee4b171eb service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:59.107157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1165/2368] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:14:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:14:59.485228 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7e7a3-2ff0-4bfd-ade4-691994345125 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:14:59.495030 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7e7a3-2ff0-4bfd-ade4-691994345125 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:14:59.499131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285613f-5120-4dca-9dc4-b07f873436e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:14:59.499738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285613f-5120-4dca-9dc4-b07f873436e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:14:59.500049 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285613f-5120-4dca-9dc4-b07f873436e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:14:59.500323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285613f-5120-4dca-9dc4-b07f873436e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:14:59.565531 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285613f-5120-4dca-9dc4-b07f873436e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:14:59.567470 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285613f-5120-4dca-9dc4-b07f873436e9 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:14:59.578347 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1204/2369] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:14:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:15:09.102698 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:09.573802 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=73 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:34.089387 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557d2fa-5fad-4120-9591-68a45e69d54e None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:34.089894 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557d2fa-5fad-4120-9591-68a45e69d54e None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:34.089989 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557d2fa-5fad-4120-9591-68a45e69d54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:34.119203 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-1557d2fa-5fad-4120-9591-68a45e69d54e None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:15:34.120423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1557d2fa-5fad-4120-9591-68a45e69d54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:34.191915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1166/2370] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 14:15:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:15:34.233146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285613f-5120-4dca-9dc4-b07f873436e9 service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:34.234564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-8285613f-5120-4dca-9dc4-b07f873436e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:34.304079 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285613f-5120-4dca-9dc4-b07f873436e9 service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:34.309377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085278-03d2-4ca6-839a-95e81aab4b09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:34.310546 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085278-03d2-4ca6-839a-95e81aab4b09 service swift] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:34.310827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085278-03d2-4ca6-839a-95e81aab4b09 service swift] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:34.311102 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085278-03d2-4ca6-839a-95e81aab4b09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:34.319593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30085278-03d2-4ca6-839a-95e81aab4b09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:34.321243 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30085278-03d2-4ca6-839a-95e81aab4b09 service swift] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:34.329732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1205/2371] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:15:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:15:44.181148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=32 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:44.326289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=32 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:52.614639 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557d2fa-5fad-4120-9591-68a45e69d54e None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:52.616304 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1557d2fa-5fad-4120-9591-68a45e69d54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:52.693206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557d2fa-5fad-4120-9591-68a45e69d54e None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:52.697136 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58ed29-a6bb-41e8-916b-ce5949099b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:52.697768 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58ed29-a6bb-41e8-916b-ce5949099b58 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:52.698050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58ed29-a6bb-41e8-916b-ce5949099b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:52.698385 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58ed29-a6bb-41e8-916b-ce5949099b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:52.700294 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6a58ed29-a6bb-41e8-916b-ce5949099b58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:52.763414 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58ed29-a6bb-41e8-916b-ce5949099b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:52.764879 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58ed29-a6bb-41e8-916b-ce5949099b58 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:52.774446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1167/2372] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:15:53.376111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085278-03d2-4ca6-839a-95e81aab4b09 service swift] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:53.386545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085278-03d2-4ca6-839a-95e81aab4b09 service swift] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:53.394037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0819f3c-d1fb-41a7-89c6-a155ddcd16aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:53.394037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819f3c-d1fb-41a7-89c6-a155ddcd16aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:53.394037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819f3c-d1fb-41a7-89c6-a155ddcd16aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:53.394037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819f3c-d1fb-41a7-89c6-a155ddcd16aa admin admin] PATH_INFO: `/v3/users/e93138f3fb984b1ba1b0bc7e133f28f0` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:53.394475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0819f3c-d1fb-41a7-89c6-a155ddcd16aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e93138f3fb984b1ba1b0bc7e133f28f0)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:53.396372 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0819f3c-d1fb-41a7-89c6-a155ddcd16aa admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:53.657395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e0819f3c-d1fb-41a7-89c6-a155ddcd16aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e93138f3fb984b1ba1b0bc7e133f28f0'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:53.670092 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e0819f3c-d1fb-41a7-89c6-a155ddcd16aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e93138f3fb984b1ba1b0bc7e133f28f0'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:53.784091 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e0819f3c-d1fb-41a7-89c6-a155ddcd16aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e93138f3fb984b1ba1b0bc7e133f28f0'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:53.792433 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e0819f3c-d1fb-41a7-89c6-a155ddcd16aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e93138f3fb984b1ba1b0bc7e133f28f0'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:53.797173 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e0819f3c-d1fb-41a7-89c6-a155ddcd16aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e93138f3fb984b1ba1b0bc7e133f28f0'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:53.808116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1206/2373] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:15:53 2022] DELETE /identity/v3/users/e93138f3fb984b1ba1b0bc7e133f28f0 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:15:53.813115 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93a380-bfb8-4927-b51d-752329b421c6 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:53.813907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93a380-bfb8-4927-b51d-752329b421c6 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:53.813907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93a380-bfb8-4927-b51d-752329b421c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:53.834825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6e93a380-bfb8-4927-b51d-752329b421c6 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:15:53.836315 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6e93a380-bfb8-4927-b51d-752329b421c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:53.916907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1168/2374] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:15:53.929063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0819f3c-d1fb-41a7-89c6-a155ddcd16aa admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:53.930857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e0819f3c-d1fb-41a7-89c6-a155ddcd16aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:54.003044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0819f3c-d1fb-41a7-89c6-a155ddcd16aa admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:54.008480 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a364b9-bc51-4193-b4f0-789e256f34b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:54.009227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a364b9-bc51-4193-b4f0-789e256f34b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:54.009579 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a364b9-bc51-4193-b4f0-789e256f34b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:54.010149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a364b9-bc51-4193-b4f0-789e256f34b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:54.021429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a364b9-bc51-4193-b4f0-789e256f34b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:54.023058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a364b9-bc51-4193-b4f0-789e256f34b1 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:54.034848 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1207/2375] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:15:54.564109 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93a380-bfb8-4927-b51d-752329b421c6 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:54.565699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6e93a380-bfb8-4927-b51d-752329b421c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:54.579806 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93a380-bfb8-4927-b51d-752329b421c6 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:54.593814 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99023ae6-f895-4881-becb-676f227ee168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:54.594516 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99023ae6-f895-4881-becb-676f227ee168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:54.594803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99023ae6-f895-4881-becb-676f227ee168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:54.597234 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99023ae6-f895-4881-becb-676f227ee168 admin admin] PATH_INFO: `/v3/projects/25e948792a404098b0fc7917c22c6646` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:54.605662 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99023ae6-f895-4881-becb-676f227ee168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e948792a404098b0fc7917c22c6646)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:54.607637 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99023ae6-f895-4881-becb-676f227ee168 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:54.813151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:54.823125 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-99023ae6-f895-4881-becb-676f227ee168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e948792a404098b0fc7917c22c6646', 'request_id': 'req-99023ae6-f895-4881-becb-676f227ee168'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:54.829675 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-99023ae6-f895-4881-becb-676f227ee168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e948792a404098b0fc7917c22c6646', 'request_id': 'req-99023ae6-f895-4881-becb-676f227ee168'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:54.986781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-99023ae6-f895-4881-becb-676f227ee168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e948792a404098b0fc7917c22c6646', 'request_id': 'req-99023ae6-f895-4881-becb-676f227ee168'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:55.000253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-99023ae6-f895-4881-becb-676f227ee168 admin admin] The token cache is being invalidate because project 25e948792a404098b0fc7917c22c6646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:15:55.000545 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-99023ae6-f895-4881-becb-676f227ee168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:55.001212 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-99023ae6-f895-4881-becb-676f227ee168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:55.002930 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1169/2376] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:15:54 2022] DELETE /identity/v3/projects/25e948792a404098b0fc7917c22c6646 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:15:55.006886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a364b9-bc51-4193-b4f0-789e256f34b1 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:55.017668 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a364b9-bc51-4193-b4f0-789e256f34b1 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:55.093443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abf68e-0d21-4923-8171-4b3429a8449f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:55.094394 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abf68e-0d21-4923-8171-4b3429a8449f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:55.094851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abf68e-0d21-4923-8171-4b3429a8449f admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:55.095384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abf68e-0d21-4923-8171-4b3429a8449f admin admin] PATH_INFO: `/v3/users/f76d42c4ee5b419e8f0c989bbef627e6` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:55.097293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abf68e-0d21-4923-8171-4b3429a8449f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f76d42c4ee5b419e8f0c989bbef627e6)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:55.101554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abf68e-0d21-4923-8171-4b3429a8449f admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:55.132415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:55.148082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99023ae6-f895-4881-becb-676f227ee168 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:55.149735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-99023ae6-f895-4881-becb-676f227ee168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:55.234959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99023ae6-f895-4881-becb-676f227ee168 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:55.243970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb393ed9-8478-426b-8e2e-19d205d909ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f750815038d404d9d39a68bf62db8c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:55.243970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb393ed9-8478-426b-8e2e-19d205d909ab service glance] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:55.243970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb393ed9-8478-426b-8e2e-19d205d909ab service glance] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:55.243970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb393ed9-8478-426b-8e2e-19d205d909ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:55.244417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bb393ed9-8478-426b-8e2e-19d205d909ab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:55.325731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb393ed9-8478-426b-8e2e-19d205d909ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:55.327203 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb393ed9-8478-426b-8e2e-19d205d909ab service glance] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:55.347494 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1170/2377] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:15:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:15:55.427292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-99abf68e-0d21-4923-8171-4b3429a8449f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f76d42c4ee5b419e8f0c989bbef627e6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:55.440375 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-99abf68e-0d21-4923-8171-4b3429a8449f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f76d42c4ee5b419e8f0c989bbef627e6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:55.531061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-99abf68e-0d21-4923-8171-4b3429a8449f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f76d42c4ee5b419e8f0c989bbef627e6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:55.540352 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-99abf68e-0d21-4923-8171-4b3429a8449f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f76d42c4ee5b419e8f0c989bbef627e6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:55.541206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-99abf68e-0d21-4923-8171-4b3429a8449f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f76d42c4ee5b419e8f0c989bbef627e6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:55.548564 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1208/2378] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:15:55 2022] DELETE /identity/v3/users/f76d42c4ee5b419e8f0c989bbef627e6 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:15:55.611513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb393ed9-8478-426b-8e2e-19d205d909ab service glance] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:55.613553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bb393ed9-8478-426b-8e2e-19d205d909ab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:55.678870 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:55.680601 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb393ed9-8478-426b-8e2e-19d205d909ab service glance] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:55.733157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade8b4b-eb11-4009-90f6-fe4ac08edc42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:55.733775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8b4b-eb11-4009-90f6-fe4ac08edc42 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:55.734055 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8b4b-eb11-4009-90f6-fe4ac08edc42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:55.734380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8b4b-eb11-4009-90f6-fe4ac08edc42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:55.736199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2ade8b4b-eb11-4009-90f6-fe4ac08edc42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:55.746894 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade8b4b-eb11-4009-90f6-fe4ac08edc42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:55.748466 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade8b4b-eb11-4009-90f6-fe4ac08edc42 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:55.758447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1171/2379] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:15:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:15:55.875105 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abf68e-0d21-4923-8171-4b3429a8449f admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:55.876672 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-99abf68e-0d21-4923-8171-4b3429a8449f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:55.890672 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abf68e-0d21-4923-8171-4b3429a8449f admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:55.895191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787c859-3413-4d5b-8bb5-214747faa07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:55.895815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787c859-3413-4d5b-8bb5-214747faa07e service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:55.896129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787c859-3413-4d5b-8bb5-214747faa07e service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:55.896403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787c859-3413-4d5b-8bb5-214747faa07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:55.905393 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-8787c859-3413-4d5b-8bb5-214747faa07e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:55.982419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787c859-3413-4d5b-8bb5-214747faa07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:55.983889 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787c859-3413-4d5b-8bb5-214747faa07e service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:55.997512 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1209/2380] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:15:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:15:56.231596 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade8b4b-eb11-4009-90f6-fe4ac08edc42 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:56.233849 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2ade8b4b-eb11-4009-90f6-fe4ac08edc42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:56.368354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade8b4b-eb11-4009-90f6-fe4ac08edc42 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:56.374340 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67298bf3-ea1c-4729-bfe9-eadc1082a37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:56.375246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67298bf3-ea1c-4729-bfe9-eadc1082a37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:56.375735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67298bf3-ea1c-4729-bfe9-eadc1082a37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:56.376205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67298bf3-ea1c-4729-bfe9-eadc1082a37c admin admin] PATH_INFO: `/v3/projects/c544fa50cdba461dbc28a4a2ed8cd911` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:56.377462 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67298bf3-ea1c-4729-bfe9-eadc1082a37c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c544fa50cdba461dbc28a4a2ed8cd911)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:56.379622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67298bf3-ea1c-4729-bfe9-eadc1082a37c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:56.577938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-67298bf3-ea1c-4729-bfe9-eadc1082a37c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c544fa50cdba461dbc28a4a2ed8cd911', 'request_id': 'req-67298bf3-ea1c-4729-bfe9-eadc1082a37c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:56.584951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-67298bf3-ea1c-4729-bfe9-eadc1082a37c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c544fa50cdba461dbc28a4a2ed8cd911', 'request_id': 'req-67298bf3-ea1c-4729-bfe9-eadc1082a37c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:56.784760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-67298bf3-ea1c-4729-bfe9-eadc1082a37c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c544fa50cdba461dbc28a4a2ed8cd911', 'request_id': 'req-67298bf3-ea1c-4729-bfe9-eadc1082a37c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:56.814844 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-67298bf3-ea1c-4729-bfe9-eadc1082a37c admin admin] The token cache is being invalidate because project c544fa50cdba461dbc28a4a2ed8cd911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:15:56.815177 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-67298bf3-ea1c-4729-bfe9-eadc1082a37c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:56.816033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-67298bf3-ea1c-4729-bfe9-eadc1082a37c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:56.823391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a06df-6510-4041-98a7-c324d2d7f9a5 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:56.824223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a06df-6510-4041-98a7-c324d2d7f9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:56.824223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a06df-6510-4041-98a7-c324d2d7f9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:56.825131 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1172/2381] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:15:56 2022] DELETE /identity/v3/projects/c544fa50cdba461dbc28a4a2ed8cd911 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:15:56.859428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-499a06df-6510-4041-98a7-c324d2d7f9a5 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:15:56.860811 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-499a06df-6510-4041-98a7-c324d2d7f9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:56.935914 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1210/2382] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:15:56.949001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06e585-8fdf-4b69-9b5d-7b5af86e907c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:56.954034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06e585-8fdf-4b69-9b5d-7b5af86e907c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:56.954034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06e585-8fdf-4b69-9b5d-7b5af86e907c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:56.977498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6d06e585-8fdf-4b69-9b5d-7b5af86e907c None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:15:56.981194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6d06e585-8fdf-4b69-9b5d-7b5af86e907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:57.001130 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1173/2383] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:15:57.005592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a06df-6510-4041-98a7-c324d2d7f9a5 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:57.016148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a06df-6510-4041-98a7-c324d2d7f9a5 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:57.021527 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155d942-a7c1-4701-87f0-939bbe85fa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:57.022275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155d942-a7c1-4701-87f0-939bbe85fa61 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:57.022459 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155d942-a7c1-4701-87f0-939bbe85fa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:57.022742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155d942-a7c1-4701-87f0-939bbe85fa61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:57.023497 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155d942-a7c1-4701-87f0-939bbe85fa61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:15:57.023811 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155d942-a7c1-4701-87f0-939bbe85fa61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:57.025554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155d942-a7c1-4701-87f0-939bbe85fa61 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:57.039917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1211/2384] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:15:57.044649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06e585-8fdf-4b69-9b5d-7b5af86e907c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:57.054969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06e585-8fdf-4b69-9b5d-7b5af86e907c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:57.060157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b526b-2296-4535-b796-b26135d4192e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:57.060765 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b526b-2296-4535-b796-b26135d4192e admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:57.061046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b526b-2296-4535-b796-b26135d4192e admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:57.061316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b526b-2296-4535-b796-b26135d4192e admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:57.061954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b526b-2296-4535-b796-b26135d4192e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:57.063924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b526b-2296-4535-b796-b26135d4192e admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:57.195549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1174/2385] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:15:57 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:15:57.199788 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155d942-a7c1-4701-87f0-939bbe85fa61 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:57.205757 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b526b-2296-4535-b796-b26135d4192e admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:57.208355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-aa7b526b-2296-4535-b796-b26135d4192e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:57.212104 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155d942-a7c1-4701-87f0-939bbe85fa61 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:57.217242 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:57.218090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:57.276150 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f3e86-f70a-4b28-99e6-57bcfa2427d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:57.276962 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f3e86-f70a-4b28-99e6-57bcfa2427d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:57.277876 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f3e86-f70a-4b28-99e6-57bcfa2427d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:57.278277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f3e86-f70a-4b28-99e6-57bcfa2427d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:57.279025 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f3e86-f70a-4b28-99e6-57bcfa2427d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:57.280832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b526b-2296-4535-b796-b26135d4192e admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:57.281792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f3e86-f70a-4b28-99e6-57bcfa2427d3 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:57.285771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c06cc7-7ffb-49c3-862c-b41c268832b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:57.286409 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c06cc7-7ffb-49c3-862c-b41c268832b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:57.286693 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c06cc7-7ffb-49c3-862c-b41c268832b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:57.286970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c06cc7-7ffb-49c3-862c-b41c268832b5 admin admin] PATH_INFO: `/v3/users/50b3952a90ce47f48cc0a820111604f0` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:57.288157 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c06cc7-7ffb-49c3-862c-b41c268832b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50b3952a90ce47f48cc0a820111604f0)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:57.290095 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c06cc7-7ffb-49c3-862c-b41c268832b5 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:57.608856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1212/2386] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:15:57 2022] POST /identity/v3/users => generated 289 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:15:57.609942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f3e86-f70a-4b28-99e6-57bcfa2427d3 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:57.619783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f3e86-f70a-4b28-99e6-57bcfa2427d3 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:57.624455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586d4a3-8021-4c4f-bad9-d948ea989b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:57.625053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586d4a3-8021-4c4f-bad9-d948ea989b54 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:57.625335 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586d4a3-8021-4c4f-bad9-d948ea989b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:57.625610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586d4a3-8021-4c4f-bad9-d948ea989b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:57.626249 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586d4a3-8021-4c4f-bad9-d948ea989b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:57.627950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586d4a3-8021-4c4f-bad9-d948ea989b54 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:57.641976 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1213/2387] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:15:57.645893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586d4a3-8021-4c4f-bad9-d948ea989b54 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:57.656690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586d4a3-8021-4c4f-bad9-d948ea989b54 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:57.664594 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3d154-2c2b-4d1b-a779-6b2e672d00c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:57.665209 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d154-2c2b-4d1b-a779-6b2e672d00c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:57.665489 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d154-2c2b-4d1b-a779-6b2e672d00c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:57.665760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3d154-2c2b-4d1b-a779-6b2e672d00c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:57.666432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3d154-2c2b-4d1b-a779-6b2e672d00c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:57.668105 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3d154-2c2b-4d1b-a779-6b2e672d00c2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:57.679196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1214/2388] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:15:57.683376 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3d154-2c2b-4d1b-a779-6b2e672d00c2 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:57.693420 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3d154-2c2b-4d1b-a779-6b2e672d00c2 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:57.698856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a05821-3b6b-4c91-bf28-ca92f56fa29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:57.700157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a05821-3b6b-4c91-bf28-ca92f56fa29d admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:57.700589 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a05821-3b6b-4c91-bf28-ca92f56fa29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:57.700990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a05821-3b6b-4c91-bf28-ca92f56fa29d admin admin] PATH_INFO: `/v3/projects/dc8c19859686463eb6aeaa528b874b05/users/567a6ef226024a8fab3062f776850089/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:57.717121 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a05821-3b6b-4c91-bf28-ca92f56fa29d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8c19859686463eb6aeaa528b874b05, user_id=567a6ef226024a8fab3062f776850089, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:57.719796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a05821-3b6b-4c91-bf28-ca92f56fa29d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:57.769034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f8c06cc7-7ffb-49c3-862c-b41c268832b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50b3952a90ce47f48cc0a820111604f0'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:57.769700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f8c06cc7-7ffb-49c3-862c-b41c268832b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50b3952a90ce47f48cc0a820111604f0'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:57.782291 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f8c06cc7-7ffb-49c3-862c-b41c268832b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50b3952a90ce47f48cc0a820111604f0'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:57.952433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f8c06cc7-7ffb-49c3-862c-b41c268832b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50b3952a90ce47f48cc0a820111604f0'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:57.953167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f8c06cc7-7ffb-49c3-862c-b41c268832b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50b3952a90ce47f48cc0a820111604f0'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:57.958371 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1215/2389] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:15:57 2022] PUT /identity/v3/projects/dc8c19859686463eb6aeaa528b874b05/users/567a6ef226024a8fab3062f776850089/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:15:57.967158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1175/2390] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:15:57 2022] DELETE /identity/v3/users/50b3952a90ce47f48cc0a820111604f0 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:15:57.971906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e61cc3-9e84-44f4-b1ac-44dbcd0acb2c None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:57.972058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e61cc3-9e84-44f4-b1ac-44dbcd0acb2c None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:57.972289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e61cc3-9e84-44f4-b1ac-44dbcd0acb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:58.002516 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-74e61cc3-9e84-44f4-b1ac-44dbcd0acb2c None None] MFA Rules not processed for user `567a6ef226024a8fab3062f776850089`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:15:58.003754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-74e61cc3-9e84-44f4-b1ac-44dbcd0acb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:58.079261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1216/2391] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:15:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:15:58.083993 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c06cc7-7ffb-49c3-862c-b41c268832b5 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:58.085915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f8c06cc7-7ffb-49c3-862c-b41c268832b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:58.164668 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c06cc7-7ffb-49c3-862c-b41c268832b5 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:58.170141 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4250a-22e1-42cb-9b34-c23df6c96a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:58.170767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4250a-22e1-42cb-9b34-c23df6c96a2c admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:58.171050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4250a-22e1-42cb-9b34-c23df6c96a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:58.171326 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4250a-22e1-42cb-9b34-c23df6c96a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:58.172415 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4250a-22e1-42cb-9b34-c23df6c96a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:58.173996 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4250a-22e1-42cb-9b34-c23df6c96a2c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:58.242912 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e61cc3-9e84-44f4-b1ac-44dbcd0acb2c None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:58.244677 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-74e61cc3-9e84-44f4-b1ac-44dbcd0acb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:58.261562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e61cc3-9e84-44f4-b1ac-44dbcd0acb2c None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:58.268188 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77d365-0ac7-4a88-8764-b49dd4a5b58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:58.269800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77d365-0ac7-4a88-8764-b49dd4a5b58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:58.270232 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77d365-0ac7-4a88-8764-b49dd4a5b58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:58.270521 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77d365-0ac7-4a88-8764-b49dd4a5b58e admin admin] PATH_INFO: `/v3/projects/3b4abbd87d2345438f246a98f5a0d011` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:58.272676 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77d365-0ac7-4a88-8764-b49dd4a5b58e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b4abbd87d2345438f246a98f5a0d011)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:58.280453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77d365-0ac7-4a88-8764-b49dd4a5b58e admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:58.284348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1176/2392] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:15:58 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:15:58.288767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4250a-22e1-42cb-9b34-c23df6c96a2c admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:58.356430 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4250a-22e1-42cb-9b34-c23df6c96a2c admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:58.361112 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cac9f0-d56b-41ad-83fb-e164283711e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:58.361716 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cac9f0-d56b-41ad-83fb-e164283711e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:58.362034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cac9f0-d56b-41ad-83fb-e164283711e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:58.362496 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cac9f0-d56b-41ad-83fb-e164283711e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:58.363094 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cac9f0-d56b-41ad-83fb-e164283711e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:58.365110 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cac9f0-d56b-41ad-83fb-e164283711e6 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:58.430768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ca77d365-0ac7-4a88-8764-b49dd4a5b58e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b4abbd87d2345438f246a98f5a0d011', 'request_id': 'req-ca77d365-0ac7-4a88-8764-b49dd4a5b58e'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:58.539482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1177/2393] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:15:58 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:15:58.543628 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cac9f0-d56b-41ad-83fb-e164283711e6 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:58.553687 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cac9f0-d56b-41ad-83fb-e164283711e6 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:58.554857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ca77d365-0ac7-4a88-8764-b49dd4a5b58e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b4abbd87d2345438f246a98f5a0d011', 'request_id': 'req-ca77d365-0ac7-4a88-8764-b49dd4a5b58e'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:58.563440 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ca77d365-0ac7-4a88-8764-b49dd4a5b58e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b4abbd87d2345438f246a98f5a0d011', 'request_id': 'req-ca77d365-0ac7-4a88-8764-b49dd4a5b58e'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:58.581858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ca77d365-0ac7-4a88-8764-b49dd4a5b58e admin admin] The token cache is being invalidate because project 3b4abbd87d2345438f246a98f5a0d011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:15:58.582468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ca77d365-0ac7-4a88-8764-b49dd4a5b58e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:58.584590 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ca77d365-0ac7-4a88-8764-b49dd4a5b58e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:15:58.586335 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1217/2394] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:15:58 2022] DELETE /identity/v3/projects/3b4abbd87d2345438f246a98f5a0d011 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:15:58.592537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e588d-2194-4c8e-82cc-5f9b276c628e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:58.592826 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e588d-2194-4c8e-82cc-5f9b276c628e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:58.593100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e588d-2194-4c8e-82cc-5f9b276c628e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:58.614316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-318e588d-2194-4c8e-82cc-5f9b276c628e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:15:58.615604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-318e588d-2194-4c8e-82cc-5f9b276c628e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:58.622309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e192210-fd38-42a4-9d5d-7836dc9c832b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:58.622939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e192210-fd38-42a4-9d5d-7836dc9c832b admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:58.623726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e192210-fd38-42a4-9d5d-7836dc9c832b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:58.623726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e192210-fd38-42a4-9d5d-7836dc9c832b admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:58.624161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e192210-fd38-42a4-9d5d-7836dc9c832b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:58.625775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e192210-fd38-42a4-9d5d-7836dc9c832b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:58.635945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1178/2395] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:15:58.640677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e192210-fd38-42a4-9d5d-7836dc9c832b admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:58.642687 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-3e192210-fd38-42a4-9d5d-7836dc9c832b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:58.655223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e192210-fd38-42a4-9d5d-7836dc9c832b admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:58.659957 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9aec2-7e6f-4484-8616-f75d29a3af11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:58.660629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9aec2-7e6f-4484-8616-f75d29a3af11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:58.660910 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9aec2-7e6f-4484-8616-f75d29a3af11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:58.661423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9aec2-7e6f-4484-8616-f75d29a3af11 admin admin] PATH_INFO: `/v3/projects/a2454b802e1445f19290acb8b678580f/users/408690a1264442e8aac7d3ea92e9d4c6/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:58.677481 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9aec2-7e6f-4484-8616-f75d29a3af11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2454b802e1445f19290acb8b678580f, user_id=408690a1264442e8aac7d3ea92e9d4c6, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:58.684778 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9aec2-7e6f-4484-8616-f75d29a3af11 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:58.685320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1218/2396] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:15:58.693213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50f1aa-5bc7-424c-a5bc-fe84ce9a165e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:58.693516 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50f1aa-5bc7-424c-a5bc-fe84ce9a165e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:58.693794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50f1aa-5bc7-424c-a5bc-fe84ce9a165e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:58.714475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-6d50f1aa-5bc7-424c-a5bc-fe84ce9a165e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:15:58.717990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6d50f1aa-5bc7-424c-a5bc-fe84ce9a165e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:58.729280 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1219/2397] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:15:58.734650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50f1aa-5bc7-424c-a5bc-fe84ce9a165e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:58.755737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50f1aa-5bc7-424c-a5bc-fe84ce9a165e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:58.763679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfba9d-005a-49fc-be4d-7d0368064a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:58.764733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfba9d-005a-49fc-be4d-7d0368064a7d admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:58.765660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfba9d-005a-49fc-be4d-7d0368064a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:58.765792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfba9d-005a-49fc-be4d-7d0368064a7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:58.767210 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfba9d-005a-49fc-be4d-7d0368064a7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:15:58.767800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfba9d-005a-49fc-be4d-7d0368064a7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:58.770286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfba9d-005a-49fc-be4d-7d0368064a7d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:58.790363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1220/2398] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:15:58.790363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfba9d-005a-49fc-be4d-7d0368064a7d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:58.797590 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfba9d-005a-49fc-be4d-7d0368064a7d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:58.803038 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71335c5-01e3-41d3-8f3c-9cc8cb15d28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:58.803760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71335c5-01e3-41d3-8f3c-9cc8cb15d28d admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:58.804194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71335c5-01e3-41d3-8f3c-9cc8cb15d28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:58.804539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71335c5-01e3-41d3-8f3c-9cc8cb15d28d admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:58.805277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71335c5-01e3-41d3-8f3c-9cc8cb15d28d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:58.807248 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71335c5-01e3-41d3-8f3c-9cc8cb15d28d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:58.822100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1179/2399] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:15:58 2022] PUT /identity/v3/projects/a2454b802e1445f19290acb8b678580f/users/408690a1264442e8aac7d3ea92e9d4c6/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:15:58.826311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9aec2-7e6f-4484-8616-f75d29a3af11 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:58.833615 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:58.897807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9aec2-7e6f-4484-8616-f75d29a3af11 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:58.902720 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f813825-87dd-4ce7-96c2-5f7e79e00ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:58.903335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f813825-87dd-4ce7-96c2-5f7e79e00ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:58.903617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f813825-87dd-4ce7-96c2-5f7e79e00ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:58.903917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f813825-87dd-4ce7-96c2-5f7e79e00ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:58.904600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f813825-87dd-4ce7-96c2-5f7e79e00ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:58.906188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f813825-87dd-4ce7-96c2-5f7e79e00ae3 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:58.917449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1221/2400] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:15:58 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:15:58.918791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1180/2401] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:15:58.922137 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71335c5-01e3-41d3-8f3c-9cc8cb15d28d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:58.922891 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f813825-87dd-4ce7-96c2-5f7e79e00ae3 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:58.933623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f813825-87dd-4ce7-96c2-5f7e79e00ae3 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:58.989021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71335c5-01e3-41d3-8f3c-9cc8cb15d28d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:58.992163 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8af16-eb7d-4c96-9ed1-3a956c3c65f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:58.992320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770e6e0-132b-4d54-848b-542a865367bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:58.993007 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770e6e0-132b-4d54-848b-542a865367bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:58.993118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8af16-eb7d-4c96-9ed1-3a956c3c65f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:58.993419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770e6e0-132b-4d54-848b-542a865367bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:58.993538 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8af16-eb7d-4c96-9ed1-3a956c3c65f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:58.993812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770e6e0-132b-4d54-848b-542a865367bd admin admin] PATH_INFO: `/v3/projects/a2454b802e1445f19290acb8b678580f/users/408690a1264442e8aac7d3ea92e9d4c6/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:58.993922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8af16-eb7d-4c96-9ed1-3a956c3c65f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:58.994562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8af16-eb7d-4c96-9ed1-3a956c3c65f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:58.995891 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770e6e0-132b-4d54-848b-542a865367bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2454b802e1445f19290acb8b678580f, user_id=408690a1264442e8aac7d3ea92e9d4c6, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:58.997420 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f8af16-eb7d-4c96-9ed1-3a956c3c65f1 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:58.999592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770e6e0-132b-4d54-848b-542a865367bd admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:59.014331 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1181/2402] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:15:58 2022] PUT /identity/v3/projects/a2454b802e1445f19290acb8b678580f/users/408690a1264442e8aac7d3ea92e9d4c6/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:15:59.014331 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e86c4-7396-453f-905b-3b5ff6fdffdb None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:59.014547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:59.014650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e86c4-7396-453f-905b-3b5ff6fdffdb None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:59.014650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e86c4-7396-453f-905b-3b5ff6fdffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:59.031695 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-fd6e86c4-7396-453f-905b-3b5ff6fdffdb None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:15:59.032925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-fd6e86c4-7396-453f-905b-3b5ff6fdffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:59.087761 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1182/2403] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 14:15:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:15:59.089045 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7bdd6-e14b-4357-97b6-37c4f60a4e3b None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:59.089374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7bdd6-e14b-4357-97b6-37c4f60a4e3b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:59.089600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7bdd6-e14b-4357-97b6-37c4f60a4e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:59.118076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-81e7bdd6-e14b-4357-97b6-37c4f60a4e3b None None] MFA Rules not processed for user `408690a1264442e8aac7d3ea92e9d4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:15:59.118320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1222/2404] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:15:58 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:15:59.119286 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-81e7bdd6-e14b-4357-97b6-37c4f60a4e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:59.121844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8af16-eb7d-4c96-9ed1-3a956c3c65f1 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:59.121844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-80f8af16-eb7d-4c96-9ed1-3a956c3c65f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:59.200680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1183/2405] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:15:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:15:59.202034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7bdd6-e14b-4357-97b6-37c4f60a4e3b None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:59.207611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8af16-eb7d-4c96-9ed1-3a956c3c65f1 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:59.292931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7bdd6-e14b-4357-97b6-37c4f60a4e3b None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:59.295849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e10d2-8726-4721-b575-62b02d2fa958 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:59.296500 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e10d2-8726-4721-b575-62b02d2fa958 service swift] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:59.296783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e10d2-8726-4721-b575-62b02d2fa958 service swift] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:59.297058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e10d2-8726-4721-b575-62b02d2fa958 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:59.298289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f3937-b851-4741-9496-bb6cd9d209c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:59.299128 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f3937-b851-4741-9496-bb6cd9d209c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:59.299458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f3937-b851-4741-9496-bb6cd9d209c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:59.299724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f3937-b851-4741-9496-bb6cd9d209c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:59.300429 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f3937-b851-4741-9496-bb6cd9d209c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:59.302118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f3937-b851-4741-9496-bb6cd9d209c6 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:59.306337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e10d2-8726-4721-b575-62b02d2fa958 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:59.307950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e10d2-8726-4721-b575-62b02d2fa958 service swift] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:59.312724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1184/2406] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:15:59.313354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f3937-b851-4741-9496-bb6cd9d209c6 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:59.315125 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c96f3937-b851-4741-9496-bb6cd9d209c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:59.316554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1223/2407] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:15:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:15:59.317423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e10d2-8726-4721-b575-62b02d2fa958 service swift] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:59.333207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e10d2-8726-4721-b575-62b02d2fa958 service swift] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:59.338575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e9480-65e5-49c0-ba0a-f90f093b9978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:59.339027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e9480-65e5-49c0-ba0a-f90f093b9978 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:59.339405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e9480-65e5-49c0-ba0a-f90f093b9978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:59.340214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e9480-65e5-49c0-ba0a-f90f093b9978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:59.340876 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e9480-65e5-49c0-ba0a-f90f093b9978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:59.350186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e9480-65e5-49c0-ba0a-f90f093b9978 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:59.353941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1224/2408] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:15:59.358556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e9480-65e5-49c0-ba0a-f90f093b9978 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:59.368410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e9480-65e5-49c0-ba0a-f90f093b9978 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:59.373174 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752625c-6fb2-435f-930a-5fb074124666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:59.373899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752625c-6fb2-435f-930a-5fb074124666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:59.374236 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752625c-6fb2-435f-930a-5fb074124666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:59.374520 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752625c-6fb2-435f-930a-5fb074124666 admin admin] PATH_INFO: `/v3/projects/e083703201b147dc86914670eca155d2/users/1ce42fbe87fe4d69b2937806e4e3be72/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:59.379233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f3937-b851-4741-9496-bb6cd9d209c6 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:59.383083 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7a276-4632-41d9-9520-75bdfefa49b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:59.383685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7a276-4632-41d9-9520-75bdfefa49b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:59.383997 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7a276-4632-41d9-9520-75bdfefa49b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:59.384265 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7a276-4632-41d9-9520-75bdfefa49b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:59.386038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bab7a276-4632-41d9-9520-75bdfefa49b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:59.391125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752625c-6fb2-435f-930a-5fb074124666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e083703201b147dc86914670eca155d2, user_id=1ce42fbe87fe4d69b2937806e4e3be72, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:59.393952 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752625c-6fb2-435f-930a-5fb074124666 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:59.444731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7a276-4632-41d9-9520-75bdfefa49b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:59.446176 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7a276-4632-41d9-9520-75bdfefa49b7 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:59.455109 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1185/2409] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:15:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:15:59.561540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1225/2410] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:15:59 2022] PUT /identity/v3/projects/e083703201b147dc86914670eca155d2/users/1ce42fbe87fe4d69b2937806e4e3be72/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:15:59.564337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8de0a-d35d-4165-b6f0-dea5e4fb7690 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:59.564629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8de0a-d35d-4165-b6f0-dea5e4fb7690 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:59.564917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8de0a-d35d-4165-b6f0-dea5e4fb7690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:59.627542 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-eff8de0a-d35d-4165-b6f0-dea5e4fb7690 None None] MFA Rules not processed for user `1ce42fbe87fe4d69b2937806e4e3be72`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:15:59.632227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-eff8de0a-d35d-4165-b6f0-dea5e4fb7690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:59.710755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1186/2411] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:15:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:15:59.722972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752625c-6fb2-435f-930a-5fb074124666 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:15:59.724749 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1752625c-6fb2-435f-930a-5fb074124666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:15:59.817647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752625c-6fb2-435f-930a-5fb074124666 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:15:59.823495 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9b50e-6500-451a-8076-1e88731519da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:15:59.824157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9b50e-6500-451a-8076-1e88731519da service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:15:59.824614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9b50e-6500-451a-8076-1e88731519da service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:15:59.827258 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9b50e-6500-451a-8076-1e88731519da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:15:59.834313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9b50e-6500-451a-8076-1e88731519da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:15:59.836021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9b50e-6500-451a-8076-1e88731519da service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:15:59.845896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1226/2412] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:15:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:00.763692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:00.995546 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:01.458314 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:01.615923 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:05.292963 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8de0a-d35d-4165-b6f0-dea5e4fb7690 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:05.294565 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-eff8de0a-d35d-4165-b6f0-dea5e4fb7690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:05.317772 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:05.377196 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8de0a-d35d-4165-b6f0-dea5e4fb7690 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:05.382645 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a717b49-9c89-4a7c-a799-7ee94a5defb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:05.383717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a717b49-9c89-4a7c-a799-7ee94a5defb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:05.384258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a717b49-9c89-4a7c-a799-7ee94a5defb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:05.384592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a717b49-9c89-4a7c-a799-7ee94a5defb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:05.452973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a717b49-9c89-4a7c-a799-7ee94a5defb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:05.454586 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a717b49-9c89-4a7c-a799-7ee94a5defb1 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:05.466203 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1187/2413] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:08.234199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9b50e-6500-451a-8076-1e88731519da service nova] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:08.300638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9b50e-6500-451a-8076-1e88731519da service nova] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:08.317099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123de489-8a28-43e6-bda4-1270081cc72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:08.317099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123de489-8a28-43e6-bda4-1270081cc72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:08.317099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123de489-8a28-43e6-bda4-1270081cc72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:08.317099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123de489-8a28-43e6-bda4-1270081cc72a admin admin] PATH_INFO: `/v3/users/1ce42fbe87fe4d69b2937806e4e3be72` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:08.317438 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123de489-8a28-43e6-bda4-1270081cc72a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce42fbe87fe4d69b2937806e4e3be72)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:08.317438 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123de489-8a28-43e6-bda4-1270081cc72a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:08.549758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-123de489-8a28-43e6-bda4-1270081cc72a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce42fbe87fe4d69b2937806e4e3be72'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:08.571654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-123de489-8a28-43e6-bda4-1270081cc72a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce42fbe87fe4d69b2937806e4e3be72'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:08.723453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-123de489-8a28-43e6-bda4-1270081cc72a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce42fbe87fe4d69b2937806e4e3be72'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:08.732968 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-123de489-8a28-43e6-bda4-1270081cc72a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce42fbe87fe4d69b2937806e4e3be72'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:08.733680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-123de489-8a28-43e6-bda4-1270081cc72a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce42fbe87fe4d69b2937806e4e3be72'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:08.739940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1227/2414] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:16:08 2022] DELETE /identity/v3/users/1ce42fbe87fe4d69b2937806e4e3be72 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:08.744467 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e8107-72d3-4bfc-8d29-8bea7c27e7b3 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:08.745017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e8107-72d3-4bfc-8d29-8bea7c27e7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:08.745115 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e8107-72d3-4bfc-8d29-8bea7c27e7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:08.766587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-9f9e8107-72d3-4bfc-8d29-8bea7c27e7b3 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:08.767830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-9f9e8107-72d3-4bfc-8d29-8bea7c27e7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:08.843925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1188/2415] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:16:08.856440 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123de489-8a28-43e6-bda4-1270081cc72a admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:08.858969 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-123de489-8a28-43e6-bda4-1270081cc72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:08.919105 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123de489-8a28-43e6-bda4-1270081cc72a admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:08.922796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0406097-8596-444f-96e8-1b1948d0fe7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:08.923429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0406097-8596-444f-96e8-1b1948d0fe7e service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:08.923705 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0406097-8596-444f-96e8-1b1948d0fe7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:08.924007 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0406097-8596-444f-96e8-1b1948d0fe7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:08.934286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0406097-8596-444f-96e8-1b1948d0fe7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:08.935727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0406097-8596-444f-96e8-1b1948d0fe7e service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:08.945608 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1228/2416] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:09.507780 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e8107-72d3-4bfc-8d29-8bea7c27e7b3 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:09.509357 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-9f9e8107-72d3-4bfc-8d29-8bea7c27e7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:09.521603 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e8107-72d3-4bfc-8d29-8bea7c27e7b3 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:09.526568 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15997615-e275-4fd7-8b3f-6dcfcb4ed8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:09.527199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15997615-e275-4fd7-8b3f-6dcfcb4ed8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:09.527479 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15997615-e275-4fd7-8b3f-6dcfcb4ed8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:09.527751 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15997615-e275-4fd7-8b3f-6dcfcb4ed8b2 admin admin] PATH_INFO: `/v3/projects/e083703201b147dc86914670eca155d2` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:09.528983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15997615-e275-4fd7-8b3f-6dcfcb4ed8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e083703201b147dc86914670eca155d2)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:09.530949 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15997615-e275-4fd7-8b3f-6dcfcb4ed8b2 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:09.674309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-15997615-e275-4fd7-8b3f-6dcfcb4ed8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e083703201b147dc86914670eca155d2', 'request_id': 'req-15997615-e275-4fd7-8b3f-6dcfcb4ed8b2'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:09.679056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:09.680251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-15997615-e275-4fd7-8b3f-6dcfcb4ed8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e083703201b147dc86914670eca155d2', 'request_id': 'req-15997615-e275-4fd7-8b3f-6dcfcb4ed8b2'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:09.786619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-15997615-e275-4fd7-8b3f-6dcfcb4ed8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e083703201b147dc86914670eca155d2', 'request_id': 'req-15997615-e275-4fd7-8b3f-6dcfcb4ed8b2'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:09.798561 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-15997615-e275-4fd7-8b3f-6dcfcb4ed8b2 admin admin] The token cache is being invalidate because project e083703201b147dc86914670eca155d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:16:09.798860 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-15997615-e275-4fd7-8b3f-6dcfcb4ed8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:09.799516 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-15997615-e275-4fd7-8b3f-6dcfcb4ed8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:09.801041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1189/2417] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:16:09 2022] DELETE /identity/v3/projects/e083703201b147dc86914670eca155d2 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:09.805943 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a7f93-236f-464a-9872-9eb2094a4180 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:09.806469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a7f93-236f-464a-9872-9eb2094a4180 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:09.806572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a7f93-236f-464a-9872-9eb2094a4180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:09.827304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-ec3a7f93-236f-464a-9872-9eb2094a4180 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:09.828614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ec3a7f93-236f-464a-9872-9eb2094a4180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:09.838618 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:09.888804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1229/2418] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:09.896639 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c62f1-d0a1-4b60-b969-dcddf3e53376 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:09.896937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c62f1-d0a1-4b60-b969-dcddf3e53376 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:09.897215 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c62f1-d0a1-4b60-b969-dcddf3e53376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:09.918532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-268c62f1-d0a1-4b60-b969-dcddf3e53376 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:09.919748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-268c62f1-d0a1-4b60-b969-dcddf3e53376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:09.927832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1190/2419] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:09.932082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a7f93-236f-464a-9872-9eb2094a4180 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:09.942028 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a7f93-236f-464a-9872-9eb2094a4180 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:09.952929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d1320-72fd-4e72-bec7-6173202459d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:09.952929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d1320-72fd-4e72-bec7-6173202459d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:09.952929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d1320-72fd-4e72-bec7-6173202459d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:09.952929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d1320-72fd-4e72-bec7-6173202459d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:09.953340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d1320-72fd-4e72-bec7-6173202459d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:16:09.953340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d1320-72fd-4e72-bec7-6173202459d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:09.953340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d1320-72fd-4e72-bec7-6173202459d1 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:09.962197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1230/2420] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:16:09.967040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c62f1-d0a1-4b60-b969-dcddf3e53376 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:09.976177 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c62f1-d0a1-4b60-b969-dcddf3e53376 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:09.981865 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fff8bf-2fb0-42cc-a415-9363d106a3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:09.987422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fff8bf-2fb0-42cc-a415-9363d106a3ca admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:09.987422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fff8bf-2fb0-42cc-a415-9363d106a3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:09.987422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fff8bf-2fb0-42cc-a415-9363d106a3ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:09.987422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fff8bf-2fb0-42cc-a415-9363d106a3ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:09.987422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fff8bf-2fb0-42cc-a415-9363d106a3ca admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:10.088975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1191/2421] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:16:09 2022] POST /identity/v3/projects => generated 363 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:10.093767 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d1320-72fd-4e72-bec7-6173202459d1 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:10.103734 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d1320-72fd-4e72-bec7-6173202459d1 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:10.159745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9378cd-8a17-47f5-8ec9-4550adf23659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:10.160382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9378cd-8a17-47f5-8ec9-4550adf23659 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:10.160661 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9378cd-8a17-47f5-8ec9-4550adf23659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:10.160949 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9378cd-8a17-47f5-8ec9-4550adf23659 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:10.161569 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9378cd-8a17-47f5-8ec9-4550adf23659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:10.163462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9378cd-8a17-47f5-8ec9-4550adf23659 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:10.286553 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1231/2422] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:16:10 2022] POST /identity/v3/users => generated 282 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:10.290983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fff8bf-2fb0-42cc-a415-9363d106a3ca admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:10.301343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fff8bf-2fb0-42cc-a415-9363d106a3ca admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:10.305988 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdedbc-8426-4a47-a7dc-661efa75718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:10.306624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdedbc-8426-4a47-a7dc-661efa75718c admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:10.306923 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdedbc-8426-4a47-a7dc-661efa75718c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:10.307201 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdedbc-8426-4a47-a7dc-661efa75718c admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:10.307844 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdedbc-8426-4a47-a7dc-661efa75718c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:10.309463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdedbc-8426-4a47-a7dc-661efa75718c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:10.319378 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1192/2423] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:10.323297 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9378cd-8a17-47f5-8ec9-4550adf23659 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:10.334100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9378cd-8a17-47f5-8ec9-4550adf23659 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:10.338727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce67bdc-176d-469e-8467-8a954ce198b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:10.351011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce67bdc-176d-469e-8467-8a954ce198b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:10.351011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce67bdc-176d-469e-8467-8a954ce198b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:10.351011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce67bdc-176d-469e-8467-8a954ce198b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:10.351011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce67bdc-176d-469e-8467-8a954ce198b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:10.351011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce67bdc-176d-469e-8467-8a954ce198b5 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:10.353442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1232/2424] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:10.358297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdedbc-8426-4a47-a7dc-661efa75718c admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:10.368411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdedbc-8426-4a47-a7dc-661efa75718c admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:10.373511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c5dd3-0a8e-400d-a26c-c342958f420f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:10.374162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c5dd3-0a8e-400d-a26c-c342958f420f admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:10.374453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c5dd3-0a8e-400d-a26c-c342958f420f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:10.374733 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c5dd3-0a8e-400d-a26c-c342958f420f admin admin] PATH_INFO: `/v3/projects/7dd756625bdc463ba70bc67982689d87/users/e0de5f4793ae480f9f865fd1056810c2/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:10.389242 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c5dd3-0a8e-400d-a26c-c342958f420f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd756625bdc463ba70bc67982689d87, user_id=e0de5f4793ae480f9f865fd1056810c2, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:10.391937 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c5dd3-0a8e-400d-a26c-c342958f420f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:10.572310 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1193/2425] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:10 2022] PUT /identity/v3/projects/7dd756625bdc463ba70bc67982689d87/users/e0de5f4793ae480f9f865fd1056810c2/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:10.583566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752a1f8-41c8-4faa-af25-b4b9d7100ae9 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:10.583849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752a1f8-41c8-4faa-af25-b4b9d7100ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:10.584152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752a1f8-41c8-4faa-af25-b4b9d7100ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:10.620381 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-f752a1f8-41c8-4faa-af25-b4b9d7100ae9 None None] MFA Rules not processed for user `e0de5f4793ae480f9f865fd1056810c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:10.620381 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f752a1f8-41c8-4faa-af25-b4b9d7100ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:10.676561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1233/2426] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:10.681181 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c5dd3-0a8e-400d-a26c-c342958f420f admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:10.742209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c5dd3-0a8e-400d-a26c-c342958f420f admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:10.747427 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40846039-2a73-476f-8787-9aa7ee288567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:10.748062 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40846039-2a73-476f-8787-9aa7ee288567 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:10.748348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40846039-2a73-476f-8787-9aa7ee288567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:10.748625 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40846039-2a73-476f-8787-9aa7ee288567 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:10.749266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40846039-2a73-476f-8787-9aa7ee288567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:10.751178 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40846039-2a73-476f-8787-9aa7ee288567 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:10.853564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1194/2427] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:16:10 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:10.856718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752a1f8-41c8-4faa-af25-b4b9d7100ae9 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:10.869665 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752a1f8-41c8-4faa-af25-b4b9d7100ae9 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:10.879463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:10.936464 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c45b6-b24b-4624-9153-7a069de36a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:10.937129 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c45b6-b24b-4624-9153-7a069de36a44 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:10.937408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c45b6-b24b-4624-9153-7a069de36a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:10.937679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c45b6-b24b-4624-9153-7a069de36a44 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:10.938390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c45b6-b24b-4624-9153-7a069de36a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:10.940367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c45b6-b24b-4624-9153-7a069de36a44 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:11.070061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1234/2428] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:16:10 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:11.076147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40846039-2a73-476f-8787-9aa7ee288567 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:11.088645 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40846039-2a73-476f-8787-9aa7ee288567 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:11.093795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa17ee-356e-47b5-868c-0152009727c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:11.094401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa17ee-356e-47b5-868c-0152009727c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:11.094808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa17ee-356e-47b5-868c-0152009727c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:11.095088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa17ee-356e-47b5-868c-0152009727c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:11.095733 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa17ee-356e-47b5-868c-0152009727c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:11.097398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa17ee-356e-47b5-868c-0152009727c3 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:11.108678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1195/2429] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:11.113071 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c45b6-b24b-4624-9153-7a069de36a44 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:11.123937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c45b6-b24b-4624-9153-7a069de36a44 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:11.133038 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23b0fb-ae18-4766-8ff8-ad99c672209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:11.133038 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23b0fb-ae18-4766-8ff8-ad99c672209d admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:11.133038 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23b0fb-ae18-4766-8ff8-ad99c672209d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:11.133038 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23b0fb-ae18-4766-8ff8-ad99c672209d admin admin] PATH_INFO: `/v3/projects/c1b0c364fef74bf08829a68e6498d696/users/ebaa7f3a0c97426e837a8772958e8277/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:11.146234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23b0fb-ae18-4766-8ff8-ad99c672209d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b0c364fef74bf08829a68e6498d696, user_id=ebaa7f3a0c97426e837a8772958e8277, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:11.148998 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23b0fb-ae18-4766-8ff8-ad99c672209d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:11.269455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1235/2430] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:11 2022] PUT /identity/v3/projects/c1b0c364fef74bf08829a68e6498d696/users/ebaa7f3a0c97426e837a8772958e8277/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:11.273683 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa17ee-356e-47b5-868c-0152009727c3 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:11.284726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa17ee-356e-47b5-868c-0152009727c3 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:11.335504 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:11.344319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5d26d-c82f-4547-a0cb-d0f1462173c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:11.347515 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5d26d-c82f-4547-a0cb-d0f1462173c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:11.347515 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5d26d-c82f-4547-a0cb-d0f1462173c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:11.347515 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5d26d-c82f-4547-a0cb-d0f1462173c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:11.347515 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5d26d-c82f-4547-a0cb-d0f1462173c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:11.347925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5d26d-c82f-4547-a0cb-d0f1462173c8 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:11.358102 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1196/2431] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:11.362533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23b0fb-ae18-4766-8ff8-ad99c672209d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:11.375104 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23b0fb-ae18-4766-8ff8-ad99c672209d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:11.380031 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74cdd4-cded-4040-933d-292232bbcbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:11.381812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74cdd4-cded-4040-933d-292232bbcbc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:11.381812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74cdd4-cded-4040-933d-292232bbcbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:11.381812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74cdd4-cded-4040-933d-292232bbcbc5 admin admin] PATH_INFO: `/v3/projects/c1b0c364fef74bf08829a68e6498d696/users/ebaa7f3a0c97426e837a8772958e8277/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:11.383277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74cdd4-cded-4040-933d-292232bbcbc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b0c364fef74bf08829a68e6498d696, user_id=ebaa7f3a0c97426e837a8772958e8277, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:11.385879 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74cdd4-cded-4040-933d-292232bbcbc5 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:11.396759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1236/2432] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:11 2022] PUT /identity/v3/projects/c1b0c364fef74bf08829a68e6498d696/users/ebaa7f3a0c97426e837a8772958e8277/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:11.408358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b3161-f1f9-465a-9c5d-fae85c4929cc None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:11.412746 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b3161-f1f9-465a-9c5d-fae85c4929cc None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:11.412746 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b3161-f1f9-465a-9c5d-fae85c4929cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:11.436330 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-984b3161-f1f9-465a-9c5d-fae85c4929cc None None] MFA Rules not processed for user `ebaa7f3a0c97426e837a8772958e8277`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:11.437540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-984b3161-f1f9-465a-9c5d-fae85c4929cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:11.512681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1197/2433] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:11.524234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74cdd4-cded-4040-933d-292232bbcbc5 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:11.525955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0e74cdd4-cded-4040-933d-292232bbcbc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:11.584925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74cdd4-cded-4040-933d-292232bbcbc5 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:11.588717 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2411a-d5b3-4e3a-9fad-d3bfbade0d6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:11.589878 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2411a-d5b3-4e3a-9fad-d3bfbade0d6b service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:11.590167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2411a-d5b3-4e3a-9fad-d3bfbade0d6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:11.590439 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2411a-d5b3-4e3a-9fad-d3bfbade0d6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:11.599394 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2411a-d5b3-4e3a-9fad-d3bfbade0d6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:11.600851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2411a-d5b3-4e3a-9fad-d3bfbade0d6b service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:11.610715 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1237/2434] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:12.592850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b3161-f1f9-465a-9c5d-fae85c4929cc None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:12.655409 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b3161-f1f9-465a-9c5d-fae85c4929cc None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:12.660093 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1062cb4-21b0-4f8c-b6a9-be1466d8314d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:12.660723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062cb4-21b0-4f8c-b6a9-be1466d8314d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:12.661033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062cb4-21b0-4f8c-b6a9-be1466d8314d admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:12.664036 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062cb4-21b0-4f8c-b6a9-be1466d8314d admin admin] PATH_INFO: `/v3/users/e0de5f4793ae480f9f865fd1056810c2` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:12.664036 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1062cb4-21b0-4f8c-b6a9-be1466d8314d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0de5f4793ae480f9f865fd1056810c2)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:12.664542 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1062cb4-21b0-4f8c-b6a9-be1466d8314d admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:12.960857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f1062cb4-21b0-4f8c-b6a9-be1466d8314d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0de5f4793ae480f9f865fd1056810c2'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:12.961507 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f1062cb4-21b0-4f8c-b6a9-be1466d8314d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0de5f4793ae480f9f865fd1056810c2'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:12.974100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f1062cb4-21b0-4f8c-b6a9-be1466d8314d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0de5f4793ae480f9f865fd1056810c2'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:13.060264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f1062cb4-21b0-4f8c-b6a9-be1466d8314d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0de5f4793ae480f9f865fd1056810c2'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:13.060898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f1062cb4-21b0-4f8c-b6a9-be1466d8314d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0de5f4793ae480f9f865fd1056810c2'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:13.067346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:13.075618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1198/2435] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:16:12 2022] DELETE /identity/v3/users/e0de5f4793ae480f9f865fd1056810c2 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:13.081880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40ab53-8624-43b0-84a9-ba2e56a03726 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:13.082390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40ab53-8624-43b0-84a9-ba2e56a03726 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:13.082758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40ab53-8624-43b0-84a9-ba2e56a03726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:13.102096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-3a40ab53-8624-43b0-84a9-ba2e56a03726 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:13.103304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3a40ab53-8624-43b0-84a9-ba2e56a03726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:13.163947 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1238/2436] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:13.173787 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1062cb4-21b0-4f8c-b6a9-be1466d8314d admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:13.175196 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f1062cb4-21b0-4f8c-b6a9-be1466d8314d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:13.235968 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1062cb4-21b0-4f8c-b6a9-be1466d8314d admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:13.239619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1954e9e-17c8-4264-824f-f10a5d90eba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:13.240265 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1954e9e-17c8-4264-824f-f10a5d90eba4 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:13.240546 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1954e9e-17c8-4264-824f-f10a5d90eba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:13.240820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1954e9e-17c8-4264-824f-f10a5d90eba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:13.250400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1954e9e-17c8-4264-824f-f10a5d90eba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:13.251836 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1954e9e-17c8-4264-824f-f10a5d90eba4 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:13.261859 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1199/2437] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:13.819414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40ab53-8624-43b0-84a9-ba2e56a03726 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:13.820897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3a40ab53-8624-43b0-84a9-ba2e56a03726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:13.835403 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40ab53-8624-43b0-84a9-ba2e56a03726 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:13.839124 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:13.839658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:13.839974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:13.840255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca admin admin] PATH_INFO: `/v3/projects/7dd756625bdc463ba70bc67982689d87` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:13.841479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd756625bdc463ba70bc67982689d87)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:13.843508 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:13.845732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:13.995196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd756625bdc463ba70bc67982689d87', 'request_id': 'req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:14.091376 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd756625bdc463ba70bc67982689d87', 'request_id': 'req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:14.097902 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd756625bdc463ba70bc67982689d87', 'request_id': 'req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:14.108809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca admin admin] The token cache is being invalidate because project 7dd756625bdc463ba70bc67982689d87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:16:14.109105 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:14.109753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:14.111324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1239/2438] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:16:13 2022] DELETE /identity/v3/projects/7dd756625bdc463ba70bc67982689d87 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:14.115435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1954e9e-17c8-4264-824f-f10a5d90eba4 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:14.125677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1954e9e-17c8-4264-824f-f10a5d90eba4 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:14.184738 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dbc0f-d240-4098-ab77-ed673bdc5658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:14.185370 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dbc0f-d240-4098-ab77-ed673bdc5658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:14.185647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dbc0f-d240-4098-ab77-ed673bdc5658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:14.185914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dbc0f-d240-4098-ab77-ed673bdc5658 admin admin] PATH_INFO: `/v3/users/ebaa7f3a0c97426e837a8772958e8277` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:14.187012 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dbc0f-d240-4098-ab77-ed673bdc5658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebaa7f3a0c97426e837a8772958e8277)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:14.189090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dbc0f-d240-4098-ab77-ed673bdc5658 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:14.385976 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c90dbc0f-d240-4098-ab77-ed673bdc5658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebaa7f3a0c97426e837a8772958e8277'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:14.387216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c90dbc0f-d240-4098-ab77-ed673bdc5658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebaa7f3a0c97426e837a8772958e8277'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:14.400009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c90dbc0f-d240-4098-ab77-ed673bdc5658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebaa7f3a0c97426e837a8772958e8277'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:14.477348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c90dbc0f-d240-4098-ab77-ed673bdc5658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebaa7f3a0c97426e837a8772958e8277'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:14.478006 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c90dbc0f-d240-4098-ab77-ed673bdc5658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebaa7f3a0c97426e837a8772958e8277'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:14.492169 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1200/2439] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:16:14 2022] DELETE /identity/v3/users/ebaa7f3a0c97426e837a8772958e8277 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:14.963166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:14.967318 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:14.992528 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47664acd-22d4-4bf2-a2b1-b4bf93f254ca admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:15.058674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c651f1-1cb8-447e-b8f6-0aebabf18c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:15.059314 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c651f1-1cb8-447e-b8f6-0aebabf18c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:15.059593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c651f1-1cb8-447e-b8f6-0aebabf18c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:15.059944 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c651f1-1cb8-447e-b8f6-0aebabf18c39 admin admin] PATH_INFO: `/v3/projects/c1b0c364fef74bf08829a68e6498d696` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:15.061064 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c651f1-1cb8-447e-b8f6-0aebabf18c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b0c364fef74bf08829a68e6498d696)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:15.062959 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c651f1-1cb8-447e-b8f6-0aebabf18c39 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:15.169852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-71c651f1-1cb8-447e-b8f6-0aebabf18c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b0c364fef74bf08829a68e6498d696', 'request_id': 'req-71c651f1-1cb8-447e-b8f6-0aebabf18c39'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:15.246665 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-71c651f1-1cb8-447e-b8f6-0aebabf18c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b0c364fef74bf08829a68e6498d696', 'request_id': 'req-71c651f1-1cb8-447e-b8f6-0aebabf18c39'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:15.253365 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-71c651f1-1cb8-447e-b8f6-0aebabf18c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b0c364fef74bf08829a68e6498d696', 'request_id': 'req-71c651f1-1cb8-447e-b8f6-0aebabf18c39'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:15.264551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-71c651f1-1cb8-447e-b8f6-0aebabf18c39 admin admin] The token cache is being invalidate because project c1b0c364fef74bf08829a68e6498d696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:16:15.264849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-71c651f1-1cb8-447e-b8f6-0aebabf18c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:15.265490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-71c651f1-1cb8-447e-b8f6-0aebabf18c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:15.266976 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1240/2440] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:16:14 2022] DELETE /identity/v3/projects/c1b0c364fef74bf08829a68e6498d696 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:15.271901 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4fce-820f-438e-80b6-40fc14a16888 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:15.272403 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4fce-820f-438e-80b6-40fc14a16888 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:15.272513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4fce-820f-438e-80b6-40fc14a16888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:15.292371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-12bd4fce-820f-438e-80b6-40fc14a16888 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:15.293595 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-12bd4fce-820f-438e-80b6-40fc14a16888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:15.305682 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:15.352607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1201/2441] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:15.360558 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b8537-291a-4659-bab8-19830b77d3ae None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:15.360849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b8537-291a-4659-bab8-19830b77d3ae None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:15.361145 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b8537-291a-4659-bab8-19830b77d3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:15.381541 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-146b8537-291a-4659-bab8-19830b77d3ae None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:15.382767 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-146b8537-291a-4659-bab8-19830b77d3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:15.390932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1241/2442] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:15.395234 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd4fce-820f-438e-80b6-40fc14a16888 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:15.404790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd4fce-820f-438e-80b6-40fc14a16888 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:15.409549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af0eab-fc7c-4461-8b24-a06b669199e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:15.410155 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af0eab-fc7c-4461-8b24-a06b669199e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:15.410438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af0eab-fc7c-4461-8b24-a06b669199e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:15.410713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af0eab-fc7c-4461-8b24-a06b669199e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:15.411359 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af0eab-fc7c-4461-8b24-a06b669199e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:16:15.411663 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af0eab-fc7c-4461-8b24-a06b669199e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:15.413600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af0eab-fc7c-4461-8b24-a06b669199e4 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:15.426674 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1202/2443] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:16:15.431172 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b8537-291a-4659-bab8-19830b77d3ae None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:15.441521 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b8537-291a-4659-bab8-19830b77d3ae None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:15.446385 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc71067-2521-416e-9c8a-040b2ca41ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:15.446992 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc71067-2521-416e-9c8a-040b2ca41ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:15.447274 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc71067-2521-416e-9c8a-040b2ca41ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:15.447546 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc71067-2521-416e-9c8a-040b2ca41ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:15.448276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc71067-2521-416e-9c8a-040b2ca41ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:15.453289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc71067-2521-416e-9c8a-040b2ca41ab2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:15.461684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:15.567162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1242/2444] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:16:15 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:15.570508 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af0eab-fc7c-4461-8b24-a06b669199e4 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:15.580354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af0eab-fc7c-4461-8b24-a06b669199e4 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:15.639131 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fd60c-5ce3-430e-9de6-bdfa017cab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:15.639750 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fd60c-5ce3-430e-9de6-bdfa017cab92 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:15.640072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fd60c-5ce3-430e-9de6-bdfa017cab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:15.640335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fd60c-5ce3-430e-9de6-bdfa017cab92 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:15.640969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fd60c-5ce3-430e-9de6-bdfa017cab92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:15.642898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fd60c-5ce3-430e-9de6-bdfa017cab92 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:15.849953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1203/2445] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:16:15 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:15.854086 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc71067-2521-416e-9c8a-040b2ca41ab2 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:15.864820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc71067-2521-416e-9c8a-040b2ca41ab2 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:15.869315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754753f-0be6-40aa-9a31-e4255d9be094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:15.869942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754753f-0be6-40aa-9a31-e4255d9be094 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:15.870220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754753f-0be6-40aa-9a31-e4255d9be094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:15.870540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754753f-0be6-40aa-9a31-e4255d9be094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:15.871211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754753f-0be6-40aa-9a31-e4255d9be094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:15.873144 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754753f-0be6-40aa-9a31-e4255d9be094 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:15.883434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1243/2446] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:15.887550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fd60c-5ce3-430e-9de6-bdfa017cab92 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:15.897733 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fd60c-5ce3-430e-9de6-bdfa017cab92 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:15.903092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27833ea4-fa1a-4dbb-baf6-355830f59a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:15.903689 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27833ea4-fa1a-4dbb-baf6-355830f59a54 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:15.904009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27833ea4-fa1a-4dbb-baf6-355830f59a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:15.904287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27833ea4-fa1a-4dbb-baf6-355830f59a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:15.904929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27833ea4-fa1a-4dbb-baf6-355830f59a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:15.906521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27833ea4-fa1a-4dbb-baf6-355830f59a54 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:15.917195 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1204/2447] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:15.921944 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754753f-0be6-40aa-9a31-e4255d9be094 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:15.932002 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754753f-0be6-40aa-9a31-e4255d9be094 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:15.937047 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fa9c2-73c1-4399-a204-cfffba6003a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:15.937754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa9c2-73c1-4399-a204-cfffba6003a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:15.937974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa9c2-73c1-4399-a204-cfffba6003a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:15.938250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa9c2-73c1-4399-a204-cfffba6003a4 admin admin] PATH_INFO: `/v3/projects/e63952ee57274235a1129e1cf7875e45/users/51c9115fd8494ec89defafcfcd5c4fa7/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:15.953046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fa9c2-73c1-4399-a204-cfffba6003a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63952ee57274235a1129e1cf7875e45, user_id=51c9115fd8494ec89defafcfcd5c4fa7, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:15.955706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fa9c2-73c1-4399-a204-cfffba6003a4 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:16.026363 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1244/2448] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:15 2022] PUT /identity/v3/projects/e63952ee57274235a1129e1cf7875e45/users/51c9115fd8494ec89defafcfcd5c4fa7/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:16.037803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec53c66-8880-4db7-b789-109f4ba83396 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:16.038116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec53c66-8880-4db7-b789-109f4ba83396 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:16.038393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec53c66-8880-4db7-b789-109f4ba83396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:16.067154 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-eec53c66-8880-4db7-b789-109f4ba83396 None None] MFA Rules not processed for user `51c9115fd8494ec89defafcfcd5c4fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:16.068384 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-eec53c66-8880-4db7-b789-109f4ba83396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:16.131185 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1205/2449] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:16.135562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fa9c2-73c1-4399-a204-cfffba6003a4 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:16.197646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fa9c2-73c1-4399-a204-cfffba6003a4 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:16.202549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca384c3b-bab5-4058-af09-dba7a8c69cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:16.203184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca384c3b-bab5-4058-af09-dba7a8c69cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:16.203463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca384c3b-bab5-4058-af09-dba7a8c69cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:16.203928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca384c3b-bab5-4058-af09-dba7a8c69cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:16.204560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca384c3b-bab5-4058-af09-dba7a8c69cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:16.206599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca384c3b-bab5-4058-af09-dba7a8c69cb5 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:16.295825 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1245/2450] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:16:16 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:16.300199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec53c66-8880-4db7-b789-109f4ba83396 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:16.311513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec53c66-8880-4db7-b789-109f4ba83396 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:16.320711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:16.368715 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a9ef4-6536-477b-98b5-ea3b9f44dbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:16.369367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a9ef4-6536-477b-98b5-ea3b9f44dbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:16.369650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a9ef4-6536-477b-98b5-ea3b9f44dbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:16.369921 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a9ef4-6536-477b-98b5-ea3b9f44dbb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:16.371103 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a9ef4-6536-477b-98b5-ea3b9f44dbb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:16.373112 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a9ef4-6536-477b-98b5-ea3b9f44dbb8 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:16.497580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1206/2451] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:16:16 2022] POST /identity/v3/users => generated 300 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:16.501504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca384c3b-bab5-4058-af09-dba7a8c69cb5 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:16.512340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca384c3b-bab5-4058-af09-dba7a8c69cb5 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:16.516942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778815d0-315e-437d-9af5-e83938e55599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:16.517538 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778815d0-315e-437d-9af5-e83938e55599 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:16.517822 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778815d0-315e-437d-9af5-e83938e55599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:16.518096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778815d0-315e-437d-9af5-e83938e55599 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:16.518733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778815d0-315e-437d-9af5-e83938e55599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:16.520386 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778815d0-315e-437d-9af5-e83938e55599 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:16.538048 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1246/2452] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:16.542176 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a9ef4-6536-477b-98b5-ea3b9f44dbb8 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:16.552773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a9ef4-6536-477b-98b5-ea3b9f44dbb8 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:16.557604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366570c3-3f17-4e66-9fe8-a94eb9927986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:16.558873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366570c3-3f17-4e66-9fe8-a94eb9927986 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:16.559153 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366570c3-3f17-4e66-9fe8-a94eb9927986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:16.559433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366570c3-3f17-4e66-9fe8-a94eb9927986 admin admin] PATH_INFO: `/v3/projects/388792304ef245fa9bc0fd3d9b776a72/users/a32fce9b7ad44ebfa023f666113dc58c/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:16.577426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366570c3-3f17-4e66-9fe8-a94eb9927986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=388792304ef245fa9bc0fd3d9b776a72, user_id=a32fce9b7ad44ebfa023f666113dc58c, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:16.580173 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366570c3-3f17-4e66-9fe8-a94eb9927986 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:16.704223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1207/2453] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:16 2022] PUT /identity/v3/projects/388792304ef245fa9bc0fd3d9b776a72/users/a32fce9b7ad44ebfa023f666113dc58c/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:16:16.708543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778815d0-315e-437d-9af5-e83938e55599 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:16.718514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778815d0-315e-437d-9af5-e83938e55599 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:16.776841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c57882-b63b-47cd-8de2-60a7d79e30ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:16.777370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c57882-b63b-47cd-8de2-60a7d79e30ae admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:16.777656 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c57882-b63b-47cd-8de2-60a7d79e30ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:16.777932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c57882-b63b-47cd-8de2-60a7d79e30ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:16.778576 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c57882-b63b-47cd-8de2-60a7d79e30ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:16.780236 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c57882-b63b-47cd-8de2-60a7d79e30ae admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:16.790866 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1247/2454] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:16.795229 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366570c3-3f17-4e66-9fe8-a94eb9927986 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:16.805997 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366570c3-3f17-4e66-9fe8-a94eb9927986 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:16.811197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18c2db-1b0c-48fa-91f5-790040c1183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:16.812048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c2db-1b0c-48fa-91f5-790040c1183d admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:16.812473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c2db-1b0c-48fa-91f5-790040c1183d admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:16.812894 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c2db-1b0c-48fa-91f5-790040c1183d admin admin] PATH_INFO: `/v3/projects/388792304ef245fa9bc0fd3d9b776a72/users/a32fce9b7ad44ebfa023f666113dc58c/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:16.815776 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18c2db-1b0c-48fa-91f5-790040c1183d admin admin] RBAC: Authorizing `identity:create_grant(project_id=388792304ef245fa9bc0fd3d9b776a72, user_id=a32fce9b7ad44ebfa023f666113dc58c, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:16.819634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18c2db-1b0c-48fa-91f5-790040c1183d admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:16.832633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1208/2455] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:16 2022] PUT /identity/v3/projects/388792304ef245fa9bc0fd3d9b776a72/users/a32fce9b7ad44ebfa023f666113dc58c/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:16.848357 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7289ca0-a0a4-42e7-a8c6-449d9e950e6a None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:16.848590 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7289ca0-a0a4-42e7-a8c6-449d9e950e6a None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:16.848869 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7289ca0-a0a4-42e7-a8c6-449d9e950e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:16.878039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-b7289ca0-a0a4-42e7-a8c6-449d9e950e6a None None] MFA Rules not processed for user `a32fce9b7ad44ebfa023f666113dc58c`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:16.879281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b7289ca0-a0a4-42e7-a8c6-449d9e950e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:16.892684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:16.957973 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1248/2456] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:16.980769 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18c2db-1b0c-48fa-91f5-790040c1183d admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:16.982542 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7a18c2db-1b0c-48fa-91f5-790040c1183d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:17.039706 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18c2db-1b0c-48fa-91f5-790040c1183d admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:17.044195 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091f5a6-977f-4e31-bc3c-43350fdf3de1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:17.044797 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091f5a6-977f-4e31-bc3c-43350fdf3de1 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:17.045072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091f5a6-977f-4e31-bc3c-43350fdf3de1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:17.045340 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091f5a6-977f-4e31-bc3c-43350fdf3de1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:17.054253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091f5a6-977f-4e31-bc3c-43350fdf3de1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:17.055660 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091f5a6-977f-4e31-bc3c-43350fdf3de1 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:17.065501 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1209/2457] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:17.094111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7289ca0-a0a4-42e7-a8c6-449d9e950e6a None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:17.155639 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7289ca0-a0a4-42e7-a8c6-449d9e950e6a None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:17.160334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748226e-37d1-46d4-a0f0-7e512532c3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:17.160991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748226e-37d1-46d4-a0f0-7e512532c3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:17.161269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748226e-37d1-46d4-a0f0-7e512532c3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:17.161552 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748226e-37d1-46d4-a0f0-7e512532c3e6 admin admin] PATH_INFO: `/v3/users/51c9115fd8494ec89defafcfcd5c4fa7` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:17.162671 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748226e-37d1-46d4-a0f0-7e512532c3e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51c9115fd8494ec89defafcfcd5c4fa7)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:17.164655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748226e-37d1-46d4-a0f0-7e512532c3e6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:17.350340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4748226e-37d1-46d4-a0f0-7e512532c3e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51c9115fd8494ec89defafcfcd5c4fa7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:17.361909 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4748226e-37d1-46d4-a0f0-7e512532c3e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51c9115fd8494ec89defafcfcd5c4fa7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:17.445710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4748226e-37d1-46d4-a0f0-7e512532c3e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51c9115fd8494ec89defafcfcd5c4fa7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:17.454026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4748226e-37d1-46d4-a0f0-7e512532c3e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51c9115fd8494ec89defafcfcd5c4fa7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:17.454713 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4748226e-37d1-46d4-a0f0-7e512532c3e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51c9115fd8494ec89defafcfcd5c4fa7'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:17.460970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1249/2458] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:16:17 2022] DELETE /identity/v3/users/51c9115fd8494ec89defafcfcd5c4fa7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:17.466103 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbc7fc-4a68-436b-a89f-79343be8e5bb None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:17.466581 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbc7fc-4a68-436b-a89f-79343be8e5bb None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:17.466677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbc7fc-4a68-436b-a89f-79343be8e5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:17.486993 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e9bbc7fc-4a68-436b-a89f-79343be8e5bb None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:17.488503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e9bbc7fc-4a68-436b-a89f-79343be8e5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:17.548539 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1210/2459] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:16:17.558822 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748226e-37d1-46d4-a0f0-7e512532c3e6 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:17.560261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-4748226e-37d1-46d4-a0f0-7e512532c3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:17.596166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:17.620164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748226e-37d1-46d4-a0f0-7e512532c3e6 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:17.623830 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30666ebd-c7f1-4ba6-b616-9e22cd7a0b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:17.624567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30666ebd-c7f1-4ba6-b616-9e22cd7a0b3c service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:17.624819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30666ebd-c7f1-4ba6-b616-9e22cd7a0b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:17.625096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30666ebd-c7f1-4ba6-b616-9e22cd7a0b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:17.634679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30666ebd-c7f1-4ba6-b616-9e22cd7a0b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:17.636589 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30666ebd-c7f1-4ba6-b616-9e22cd7a0b3c service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:17.646652 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1250/2460] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:18.284441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbc7fc-4a68-436b-a89f-79343be8e5bb None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:18.285964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e9bbc7fc-4a68-436b-a89f-79343be8e5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:18.298224 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbc7fc-4a68-436b-a89f-79343be8e5bb None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:18.302991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:18.303753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:18.304075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:18.304354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c admin admin] PATH_INFO: `/v3/projects/e63952ee57274235a1129e1cf7875e45` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:18.305483 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e63952ee57274235a1129e1cf7875e45)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:18.307396 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:18.310538 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:18.454897 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e63952ee57274235a1129e1cf7875e45', 'request_id': 'req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:18.460834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e63952ee57274235a1129e1cf7875e45', 'request_id': 'req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:18.534636 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e63952ee57274235a1129e1cf7875e45', 'request_id': 'req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:18.547348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c admin admin] The token cache is being invalidate because project e63952ee57274235a1129e1cf7875e45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:16:18.547639 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:18.548308 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:18.549798 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1211/2461] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:16:18 2022] DELETE /identity/v3/projects/e63952ee57274235a1129e1cf7875e45 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:18.556532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30666ebd-c7f1-4ba6-b616-9e22cd7a0b3c service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:18.568849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30666ebd-c7f1-4ba6-b616-9e22cd7a0b3c service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:18.626935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd35d1-0ab2-48d6-937d-618814cfb3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:18.627574 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd35d1-0ab2-48d6-937d-618814cfb3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:18.627855 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd35d1-0ab2-48d6-937d-618814cfb3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:18.628159 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd35d1-0ab2-48d6-937d-618814cfb3ce admin admin] PATH_INFO: `/v3/users/a32fce9b7ad44ebfa023f666113dc58c` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:18.629292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd35d1-0ab2-48d6-937d-618814cfb3ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a32fce9b7ad44ebfa023f666113dc58c)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:18.631281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd35d1-0ab2-48d6-937d-618814cfb3ce admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:18.871396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-03bd35d1-0ab2-48d6-937d-618814cfb3ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a32fce9b7ad44ebfa023f666113dc58c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:18.883076 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-03bd35d1-0ab2-48d6-937d-618814cfb3ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a32fce9b7ad44ebfa023f666113dc58c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:18.971499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-03bd35d1-0ab2-48d6-937d-618814cfb3ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a32fce9b7ad44ebfa023f666113dc58c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:18.979455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-03bd35d1-0ab2-48d6-937d-618814cfb3ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a32fce9b7ad44ebfa023f666113dc58c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:18.980816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-03bd35d1-0ab2-48d6-937d-618814cfb3ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a32fce9b7ad44ebfa023f666113dc58c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:18.986763 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1251/2462] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:16:18 2022] DELETE /identity/v3/users/a32fce9b7ad44ebfa023f666113dc58c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:19.519728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:19.521197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:19.535451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8044d9a-c4ca-44fc-baf7-a470b2a5c52c admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:19.595536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7a4dd-cd56-4ae8-94b8-1dbcf3580c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:19.596213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7a4dd-cd56-4ae8-94b8-1dbcf3580c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:19.596499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7a4dd-cd56-4ae8-94b8-1dbcf3580c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:19.596775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7a4dd-cd56-4ae8-94b8-1dbcf3580c5b admin admin] PATH_INFO: `/v3/projects/388792304ef245fa9bc0fd3d9b776a72` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:19.597892 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7a4dd-cd56-4ae8-94b8-1dbcf3580c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=388792304ef245fa9bc0fd3d9b776a72)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:19.600490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7a4dd-cd56-4ae8-94b8-1dbcf3580c5b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:19.784616 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-46c7a4dd-cd56-4ae8-94b8-1dbcf3580c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388792304ef245fa9bc0fd3d9b776a72', 'request_id': 'req-46c7a4dd-cd56-4ae8-94b8-1dbcf3580c5b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:19.792787 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-46c7a4dd-cd56-4ae8-94b8-1dbcf3580c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388792304ef245fa9bc0fd3d9b776a72', 'request_id': 'req-46c7a4dd-cd56-4ae8-94b8-1dbcf3580c5b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:19.912043 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-46c7a4dd-cd56-4ae8-94b8-1dbcf3580c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388792304ef245fa9bc0fd3d9b776a72', 'request_id': 'req-46c7a4dd-cd56-4ae8-94b8-1dbcf3580c5b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:19.926910 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-46c7a4dd-cd56-4ae8-94b8-1dbcf3580c5b admin admin] The token cache is being invalidate because project 388792304ef245fa9bc0fd3d9b776a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:16:19.927210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-46c7a4dd-cd56-4ae8-94b8-1dbcf3580c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:19.927856 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-46c7a4dd-cd56-4ae8-94b8-1dbcf3580c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:19.929372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1212/2463] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:16:19 2022] DELETE /identity/v3/projects/388792304ef245fa9bc0fd3d9b776a72 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:19.934317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c2e68-a775-47a0-959e-c9b43e9b88a3 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:19.934815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c2e68-a775-47a0-959e-c9b43e9b88a3 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:19.934916 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c2e68-a775-47a0-959e-c9b43e9b88a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:19.955103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-311c2e68-a775-47a0-959e-c9b43e9b88a3 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:19.956323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-311c2e68-a775-47a0-959e-c9b43e9b88a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:20.009835 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:20.022834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1252/2464] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:20.031456 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9308143-1d78-4f11-ad69-da2266f13aa0 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:20.031770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9308143-1d78-4f11-ad69-da2266f13aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:20.032078 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9308143-1d78-4f11-ad69-da2266f13aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:20.053274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-a9308143-1d78-4f11-ad69-da2266f13aa0 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:20.054507 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a9308143-1d78-4f11-ad69-da2266f13aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:20.062754 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1213/2465] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:16:20.067114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c2e68-a775-47a0-959e-c9b43e9b88a3 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:20.078220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c2e68-a775-47a0-959e-c9b43e9b88a3 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:20.083296 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7283fc-2e43-4c3b-b0ad-b7dabbc9673d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:20.083937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7283fc-2e43-4c3b-b0ad-b7dabbc9673d admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:20.084249 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7283fc-2e43-4c3b-b0ad-b7dabbc9673d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:20.084583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7283fc-2e43-4c3b-b0ad-b7dabbc9673d admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:20.085256 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7283fc-2e43-4c3b-b0ad-b7dabbc9673d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:16:20.085562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7283fc-2e43-4c3b-b0ad-b7dabbc9673d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:20.087152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7283fc-2e43-4c3b-b0ad-b7dabbc9673d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:20.100774 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1253/2466] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:16:20.104855 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9308143-1d78-4f11-ad69-da2266f13aa0 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:20.114570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9308143-1d78-4f11-ad69-da2266f13aa0 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:20.119518 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953ee20-9e93-41ae-847c-cd53b39cae81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:20.120183 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953ee20-9e93-41ae-847c-cd53b39cae81 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:20.120468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953ee20-9e93-41ae-847c-cd53b39cae81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:20.120767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953ee20-9e93-41ae-847c-cd53b39cae81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:20.121415 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953ee20-9e93-41ae-847c-cd53b39cae81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:20.123336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953ee20-9e93-41ae-847c-cd53b39cae81 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:20.138666 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:20.265183 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1214/2467] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:16:20 2022] POST /identity/v3/projects => generated 407 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:20.269265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7283fc-2e43-4c3b-b0ad-b7dabbc9673d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:20.280241 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7283fc-2e43-4c3b-b0ad-b7dabbc9673d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:20.339477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9ccf0-0b2e-440d-992f-8114268615c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:20.340128 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9ccf0-0b2e-440d-992f-8114268615c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:20.340460 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9ccf0-0b2e-440d-992f-8114268615c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:20.340745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9ccf0-0b2e-440d-992f-8114268615c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:20.341395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9ccf0-0b2e-440d-992f-8114268615c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:20.343546 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9ccf0-0b2e-440d-992f-8114268615c2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:20.455517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1254/2468] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:16:20 2022] POST /identity/v3/users => generated 304 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:20.460178 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953ee20-9e93-41ae-847c-cd53b39cae81 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:20.471196 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953ee20-9e93-41ae-847c-cd53b39cae81 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:20.476301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550722e5-050c-447b-8243-32c85b4be504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:20.476905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550722e5-050c-447b-8243-32c85b4be504 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:20.477189 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550722e5-050c-447b-8243-32c85b4be504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:20.477521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550722e5-050c-447b-8243-32c85b4be504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:20.478166 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550722e5-050c-447b-8243-32c85b4be504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:20.480482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550722e5-050c-447b-8243-32c85b4be504 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:20.491400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1215/2469] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:20.495565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9ccf0-0b2e-440d-992f-8114268615c2 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:20.506004 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9ccf0-0b2e-440d-992f-8114268615c2 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:20.510930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b4882-7b88-4aca-a1bc-4bddbae7bd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:20.511546 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4882-7b88-4aca-a1bc-4bddbae7bd52 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:20.511829 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4882-7b88-4aca-a1bc-4bddbae7bd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:20.512142 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b4882-7b88-4aca-a1bc-4bddbae7bd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:20.512786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b4882-7b88-4aca-a1bc-4bddbae7bd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:20.514457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b4882-7b88-4aca-a1bc-4bddbae7bd52 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:20.527416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1255/2470] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:20.534111 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550722e5-050c-447b-8243-32c85b4be504 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:20.549074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550722e5-050c-447b-8243-32c85b4be504 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:20.554012 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a965f71-5cf0-4f1e-9c2e-3c537aca14d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:20.554715 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a965f71-5cf0-4f1e-9c2e-3c537aca14d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:20.555019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a965f71-5cf0-4f1e-9c2e-3c537aca14d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:20.555320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a965f71-5cf0-4f1e-9c2e-3c537aca14d8 admin admin] PATH_INFO: `/v3/projects/ea0fe8cdd71a4d53af5a0095acbc0e83/users/9ca998c43c8f44c9988e7f9fdc09f1f9/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:20.570773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a965f71-5cf0-4f1e-9c2e-3c537aca14d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0fe8cdd71a4d53af5a0095acbc0e83, user_id=9ca998c43c8f44c9988e7f9fdc09f1f9, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:20.577962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a965f71-5cf0-4f1e-9c2e-3c537aca14d8 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:20.675623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1216/2471] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:20 2022] PUT /identity/v3/projects/ea0fe8cdd71a4d53af5a0095acbc0e83/users/9ca998c43c8f44c9988e7f9fdc09f1f9/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:20.687506 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bf400-6a5c-4188-b26b-2b79a5dc7f48 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:20.687792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bf400-6a5c-4188-b26b-2b79a5dc7f48 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:20.688091 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bf400-6a5c-4188-b26b-2b79a5dc7f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:20.715475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-197bf400-6a5c-4188-b26b-2b79a5dc7f48 None None] MFA Rules not processed for user `9ca998c43c8f44c9988e7f9fdc09f1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:20.716726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-197bf400-6a5c-4188-b26b-2b79a5dc7f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:20.780255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1256/2472] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:20 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:20.784654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a965f71-5cf0-4f1e-9c2e-3c537aca14d8 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:20.851330 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a965f71-5cf0-4f1e-9c2e-3c537aca14d8 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:20.856727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b244434-03f5-4f38-9a70-ed6065a37e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:20.857354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244434-03f5-4f38-9a70-ed6065a37e35 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:20.857640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244434-03f5-4f38-9a70-ed6065a37e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:20.857916 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244434-03f5-4f38-9a70-ed6065a37e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:20.858564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b244434-03f5-4f38-9a70-ed6065a37e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:20.860531 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b244434-03f5-4f38-9a70-ed6065a37e35 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:20.986747 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1217/2473] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:16:20 2022] POST /identity/v3/projects => generated 409 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:16:20.991984 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bf400-6a5c-4188-b26b-2b79a5dc7f48 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:21.004080 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bf400-6a5c-4188-b26b-2b79a5dc7f48 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:21.049473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:21.061004 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a11c5-f0d4-4f3b-a473-671359f21a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:21.061696 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a11c5-f0d4-4f3b-a473-671359f21a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:21.061979 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a11c5-f0d4-4f3b-a473-671359f21a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:21.062251 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a11c5-f0d4-4f3b-a473-671359f21a6c admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:21.063169 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a11c5-f0d4-4f3b-a473-671359f21a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:21.064840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a11c5-f0d4-4f3b-a473-671359f21a6c admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:21.187884 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1257/2474] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:16:20 2022] POST /identity/v3/users => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:21.191979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b244434-03f5-4f38-9a70-ed6065a37e35 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:21.202795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b244434-03f5-4f38-9a70-ed6065a37e35 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:21.207599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954468cd-cc75-433f-b1e4-1bee6120f73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:21.208253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954468cd-cc75-433f-b1e4-1bee6120f73e admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:21.208535 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954468cd-cc75-433f-b1e4-1bee6120f73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:21.208804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954468cd-cc75-433f-b1e4-1bee6120f73e admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:21.209463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954468cd-cc75-433f-b1e4-1bee6120f73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:21.211066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954468cd-cc75-433f-b1e4-1bee6120f73e admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:21.221507 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1218/2475] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:21.225787 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a11c5-f0d4-4f3b-a473-671359f21a6c admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:21.235758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a11c5-f0d4-4f3b-a473-671359f21a6c admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:21.240339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c01c6-9e44-4259-9ef5-1537018b9470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:21.240992 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c01c6-9e44-4259-9ef5-1537018b9470 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:21.241337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c01c6-9e44-4259-9ef5-1537018b9470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:21.241607 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c01c6-9e44-4259-9ef5-1537018b9470 admin admin] PATH_INFO: `/v3/projects/086c676ed7da4d7d8415c63b046a822d/users/6e7f4b59016b43c6b0075928952b3615/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:21.256730 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c01c6-9e44-4259-9ef5-1537018b9470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=086c676ed7da4d7d8415c63b046a822d, user_id=6e7f4b59016b43c6b0075928952b3615, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:21.259385 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c01c6-9e44-4259-9ef5-1537018b9470 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:21.343972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1258/2476] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:21 2022] PUT /identity/v3/projects/086c676ed7da4d7d8415c63b046a822d/users/6e7f4b59016b43c6b0075928952b3615/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:21.347962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954468cd-cc75-433f-b1e4-1bee6120f73e admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:21.358569 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954468cd-cc75-433f-b1e4-1bee6120f73e admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:21.413803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83062995-bf54-4d71-a39c-e195a2135c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:21.414408 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83062995-bf54-4d71-a39c-e195a2135c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:21.414691 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83062995-bf54-4d71-a39c-e195a2135c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:21.414968 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83062995-bf54-4d71-a39c-e195a2135c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:21.415605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83062995-bf54-4d71-a39c-e195a2135c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:21.417729 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83062995-bf54-4d71-a39c-e195a2135c38 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:21.427277 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1219/2477] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:21.431473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c01c6-9e44-4259-9ef5-1537018b9470 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:21.442768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c01c6-9e44-4259-9ef5-1537018b9470 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:21.447793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed6636-943a-45a1-8fe3-a72cae54cfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:21.448493 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed6636-943a-45a1-8fe3-a72cae54cfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:21.448787 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed6636-943a-45a1-8fe3-a72cae54cfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:21.457207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed6636-943a-45a1-8fe3-a72cae54cfd2 admin admin] PATH_INFO: `/v3/projects/086c676ed7da4d7d8415c63b046a822d/users/6e7f4b59016b43c6b0075928952b3615/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:21.457207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed6636-943a-45a1-8fe3-a72cae54cfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=086c676ed7da4d7d8415c63b046a822d, user_id=6e7f4b59016b43c6b0075928952b3615, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:21.457207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed6636-943a-45a1-8fe3-a72cae54cfd2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:21.464385 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1259/2478] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:21 2022] PUT /identity/v3/projects/086c676ed7da4d7d8415c63b046a822d/users/6e7f4b59016b43c6b0075928952b3615/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:21.474581 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7294f-2bb0-4b44-9be0-47e58110f6ca None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:21.474924 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7294f-2bb0-4b44-9be0-47e58110f6ca None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:21.475211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7294f-2bb0-4b44-9be0-47e58110f6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:21.504118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-f9c7294f-2bb0-4b44-9be0-47e58110f6ca None None] MFA Rules not processed for user `6e7f4b59016b43c6b0075928952b3615`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:21.505345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f9c7294f-2bb0-4b44-9be0-47e58110f6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:21.522744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:21.575417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1220/2479] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:21 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:21.600647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed6636-943a-45a1-8fe3-a72cae54cfd2 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:21.600647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-80ed6636-943a-45a1-8fe3-a72cae54cfd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:21.660942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed6636-943a-45a1-8fe3-a72cae54cfd2 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:21.664840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b783cd-c89f-4d3e-b3ce-60416d3808fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:21.665461 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b783cd-c89f-4d3e-b3ce-60416d3808fb service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:21.665748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b783cd-c89f-4d3e-b3ce-60416d3808fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:21.666042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b783cd-c89f-4d3e-b3ce-60416d3808fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:21.676397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b783cd-c89f-4d3e-b3ce-60416d3808fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:21.677904 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b783cd-c89f-4d3e-b3ce-60416d3808fb service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:21.689701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1260/2480] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:21 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:21.963170 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528f024-d201-4d6d-bfb1-61c84afff81b None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:21.963461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528f024-d201-4d6d-bfb1-61c84afff81b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:21.963767 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528f024-d201-4d6d-bfb1-61c84afff81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:21.983460 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-d528f024-d201-4d6d-bfb1-61c84afff81b None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:21.984766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d528f024-d201-4d6d-bfb1-61c84afff81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:22.043592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1221/2481] 10.222.0.64 () {58 vars in 967 bytes} [Thu Sep 1 14:16:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:22.055799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b783cd-c89f-4d3e-b3ce-60416d3808fb service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:22.057251 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-29b783cd-c89f-4d3e-b3ce-60416d3808fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:22.108202 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528f024-d201-4d6d-bfb1-61c84afff81b None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:22.117366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528f024-d201-4d6d-bfb1-61c84afff81b None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:22.121533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ea585-2a9b-405f-a5e0-6708729c53af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:22.122133 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ea585-2a9b-405f-a5e0-6708729c53af service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:22.122405 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ea585-2a9b-405f-a5e0-6708729c53af service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:22.122676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ea585-2a9b-405f-a5e0-6708729c53af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:22.132333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b783cd-c89f-4d3e-b3ce-60416d3808fb service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:22.138077 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61940734-eed9-4c4e-b3d7-d587830a3008 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:22.138701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61940734-eed9-4c4e-b3d7-d587830a3008 service swift] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:22.138966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61940734-eed9-4c4e-b3d7-d587830a3008 service swift] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:22.139239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61940734-eed9-4c4e-b3d7-d587830a3008 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:22.147517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61940734-eed9-4c4e-b3d7-d587830a3008 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:22.149148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61940734-eed9-4c4e-b3d7-d587830a3008 service swift] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:22.157446 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1261/2482] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:16:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:16:22.196743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ea585-2a9b-405f-a5e0-6708729c53af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:22.196743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ea585-2a9b-405f-a5e0-6708729c53af service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:22.201216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1222/2483] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:22 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:16:25.474127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61940734-eed9-4c4e-b3d7-d587830a3008 service swift] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:25.475527 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-61940734-eed9-4c4e-b3d7-d587830a3008 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:25.510251 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:25.539720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61940734-eed9-4c4e-b3d7-d587830a3008 service swift] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:25.544244 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1c8a2-da2a-49bd-9a56-1ea8d58375b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:25.544863 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1c8a2-da2a-49bd-9a56-1ea8d58375b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:25.545139 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1c8a2-da2a-49bd-9a56-1ea8d58375b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:25.545409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1c8a2-da2a-49bd-9a56-1ea8d58375b4 admin admin] PATH_INFO: `/v3/users/567a6ef226024a8fab3062f776850089` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:25.546504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1c8a2-da2a-49bd-9a56-1ea8d58375b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=567a6ef226024a8fab3062f776850089)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:25.548437 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1c8a2-da2a-49bd-9a56-1ea8d58375b4 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:25.863818 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-78b1c8a2-da2a-49bd-9a56-1ea8d58375b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '567a6ef226024a8fab3062f776850089'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:25.876318 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-78b1c8a2-da2a-49bd-9a56-1ea8d58375b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '567a6ef226024a8fab3062f776850089'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:25.985718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-78b1c8a2-da2a-49bd-9a56-1ea8d58375b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '567a6ef226024a8fab3062f776850089'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:25.993383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-78b1c8a2-da2a-49bd-9a56-1ea8d58375b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '567a6ef226024a8fab3062f776850089'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:25.994047 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-78b1c8a2-da2a-49bd-9a56-1ea8d58375b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '567a6ef226024a8fab3062f776850089'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:26.000963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1262/2484] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:16:25 2022] DELETE /identity/v3/users/567a6ef226024a8fab3062f776850089 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:26.005569 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f2b16-9b73-4063-81ba-b7e014c4e53d None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:26.006082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f2b16-9b73-4063-81ba-b7e014c4e53d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:26.006187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f2b16-9b73-4063-81ba-b7e014c4e53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:26.025316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-284f2b16-9b73-4063-81ba-b7e014c4e53d None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:26.026528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-284f2b16-9b73-4063-81ba-b7e014c4e53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:26.078226 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:26.087671 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1223/2485] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:26.097505 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1c8a2-da2a-49bd-9a56-1ea8d58375b4 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:26.099008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-78b1c8a2-da2a-49bd-9a56-1ea8d58375b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:26.156857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1c8a2-da2a-49bd-9a56-1ea8d58375b4 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:26.160438 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfb1ad-e848-46b5-a4ec-49e2618c635c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:26.161041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfb1ad-e848-46b5-a4ec-49e2618c635c service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:26.161320 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfb1ad-e848-46b5-a4ec-49e2618c635c service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:26.161592 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfb1ad-e848-46b5-a4ec-49e2618c635c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:26.171201 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfb1ad-e848-46b5-a4ec-49e2618c635c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:26.172667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dfb1ad-e848-46b5-a4ec-49e2618c635c service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:26.182093 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1263/2486] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:26.613395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f2b16-9b73-4063-81ba-b7e014c4e53d None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:26.617596 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-284f2b16-9b73-4063-81ba-b7e014c4e53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:26.627546 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f2b16-9b73-4063-81ba-b7e014c4e53d None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:26.633288 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5bbef-99d9-47bc-8e8e-c922a3de6176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:26.633755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5bbef-99d9-47bc-8e8e-c922a3de6176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:26.634034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5bbef-99d9-47bc-8e8e-c922a3de6176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:26.634304 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5bbef-99d9-47bc-8e8e-c922a3de6176 admin admin] PATH_INFO: `/v3/projects/dc8c19859686463eb6aeaa528b874b05` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:26.635502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5bbef-99d9-47bc-8e8e-c922a3de6176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8c19859686463eb6aeaa528b874b05)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:26.637939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5bbef-99d9-47bc-8e8e-c922a3de6176 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:26.824501 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-79a5bbef-99d9-47bc-8e8e-c922a3de6176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8c19859686463eb6aeaa528b874b05', 'request_id': 'req-79a5bbef-99d9-47bc-8e8e-c922a3de6176'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:26.830407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-79a5bbef-99d9-47bc-8e8e-c922a3de6176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8c19859686463eb6aeaa528b874b05', 'request_id': 'req-79a5bbef-99d9-47bc-8e8e-c922a3de6176'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:26.980501 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-79a5bbef-99d9-47bc-8e8e-c922a3de6176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8c19859686463eb6aeaa528b874b05', 'request_id': 'req-79a5bbef-99d9-47bc-8e8e-c922a3de6176'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:26.993042 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-79a5bbef-99d9-47bc-8e8e-c922a3de6176 admin admin] The token cache is being invalidate because project dc8c19859686463eb6aeaa528b874b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:16:26.993355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-79a5bbef-99d9-47bc-8e8e-c922a3de6176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:26.994027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-79a5bbef-99d9-47bc-8e8e-c922a3de6176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:26.995555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1224/2487] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:16:26 2022] DELETE /identity/v3/projects/dc8c19859686463eb6aeaa528b874b05 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:26.999681 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfb1ad-e848-46b5-a4ec-49e2618c635c service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:27.009793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfb1ad-e848-46b5-a4ec-49e2618c635c service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:27.074653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:27.081857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b599b-5521-4e32-9761-82cfe5022891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:27.083026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b599b-5521-4e32-9761-82cfe5022891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:27.083319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b599b-5521-4e32-9761-82cfe5022891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:27.083596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b599b-5521-4e32-9761-82cfe5022891 admin admin] PATH_INFO: `/v3/users/408690a1264442e8aac7d3ea92e9d4c6` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:27.084929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b599b-5521-4e32-9761-82cfe5022891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=408690a1264442e8aac7d3ea92e9d4c6)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:27.086852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b599b-5521-4e32-9761-82cfe5022891 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:27.392342 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4d3b599b-5521-4e32-9761-82cfe5022891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408690a1264442e8aac7d3ea92e9d4c6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:27.404549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4d3b599b-5521-4e32-9761-82cfe5022891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408690a1264442e8aac7d3ea92e9d4c6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:27.522963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4d3b599b-5521-4e32-9761-82cfe5022891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408690a1264442e8aac7d3ea92e9d4c6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:27.530216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4d3b599b-5521-4e32-9761-82cfe5022891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408690a1264442e8aac7d3ea92e9d4c6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:27.530866 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-4d3b599b-5521-4e32-9761-82cfe5022891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408690a1264442e8aac7d3ea92e9d4c6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:27.537572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1264/2488] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:16:26 2022] DELETE /identity/v3/users/408690a1264442e8aac7d3ea92e9d4c6 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:28.124814 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5bbef-99d9-47bc-8e8e-c922a3de6176 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:28.126472 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-79a5bbef-99d9-47bc-8e8e-c922a3de6176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:28.140615 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5bbef-99d9-47bc-8e8e-c922a3de6176 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:28.203296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992851f9-0d23-4a63-8fb9-c879b1a9bcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:28.203964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992851f9-0d23-4a63-8fb9-c879b1a9bcf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:28.204386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992851f9-0d23-4a63-8fb9-c879b1a9bcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:28.204546 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992851f9-0d23-4a63-8fb9-c879b1a9bcf1 admin admin] PATH_INFO: `/v3/projects/a2454b802e1445f19290acb8b678580f` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:28.205689 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992851f9-0d23-4a63-8fb9-c879b1a9bcf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2454b802e1445f19290acb8b678580f)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:28.207852 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992851f9-0d23-4a63-8fb9-c879b1a9bcf1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:28.395300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-992851f9-0d23-4a63-8fb9-c879b1a9bcf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2454b802e1445f19290acb8b678580f', 'request_id': 'req-992851f9-0d23-4a63-8fb9-c879b1a9bcf1'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:28.409208 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-992851f9-0d23-4a63-8fb9-c879b1a9bcf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2454b802e1445f19290acb8b678580f', 'request_id': 'req-992851f9-0d23-4a63-8fb9-c879b1a9bcf1'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:28.586014 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-992851f9-0d23-4a63-8fb9-c879b1a9bcf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2454b802e1445f19290acb8b678580f', 'request_id': 'req-992851f9-0d23-4a63-8fb9-c879b1a9bcf1'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:28.598470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-992851f9-0d23-4a63-8fb9-c879b1a9bcf1 admin admin] The token cache is being invalidate because project a2454b802e1445f19290acb8b678580f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:16:28.598765 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-992851f9-0d23-4a63-8fb9-c879b1a9bcf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:28.599435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-992851f9-0d23-4a63-8fb9-c879b1a9bcf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:28.601023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1225/2489] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:16:28 2022] DELETE /identity/v3/projects/a2454b802e1445f19290acb8b678580f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:28.606529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4fb9a-f564-4ef1-b32a-1ce84a6dd172 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:28.607009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4fb9a-f564-4ef1-b32a-1ce84a6dd172 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:28.607009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4fb9a-f564-4ef1-b32a-1ce84a6dd172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:28.626902 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-57c4fb9a-f564-4ef1-b32a-1ce84a6dd172 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:28.628151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-57c4fb9a-f564-4ef1-b32a-1ce84a6dd172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:28.698816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1265/2490] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:28.708388 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4af5a-5c33-40c9-87fe-b0faabad207d None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:28.708674 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4af5a-5c33-40c9-87fe-b0faabad207d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:28.708943 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4af5a-5c33-40c9-87fe-b0faabad207d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:28.731758 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-87b4af5a-5c33-40c9-87fe-b0faabad207d None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:28.733020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-87b4af5a-5c33-40c9-87fe-b0faabad207d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:28.741238 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1226/2491] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:28.745854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4fb9a-f564-4ef1-b32a-1ce84a6dd172 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:28.760041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4fb9a-f564-4ef1-b32a-1ce84a6dd172 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:28.764830 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3084c-7040-4634-acf3-1c535352c359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:28.765436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3084c-7040-4634-acf3-1c535352c359 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:28.765714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3084c-7040-4634-acf3-1c535352c359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:28.765988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3084c-7040-4634-acf3-1c535352c359 admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:28.766629 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3084c-7040-4634-acf3-1c535352c359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:16:28.766935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3084c-7040-4634-acf3-1c535352c359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:28.768734 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3084c-7040-4634-acf3-1c535352c359 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:28.782726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1266/2492] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:16:28.787342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4af5a-5c33-40c9-87fe-b0faabad207d None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:28.793837 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:28.798192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4af5a-5c33-40c9-87fe-b0faabad207d None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:28.803360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22ba5a-d41a-4e7d-ba4d-7e960b91dc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:28.804088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ba5a-d41a-4e7d-ba4d-7e960b91dc01 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:28.804413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ba5a-d41a-4e7d-ba4d-7e960b91dc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:28.804696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ba5a-d41a-4e7d-ba4d-7e960b91dc01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:28.805376 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22ba5a-d41a-4e7d-ba4d-7e960b91dc01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:28.807362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22ba5a-d41a-4e7d-ba4d-7e960b91dc01 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:29.027511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1227/2493] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:16:28 2022] POST /identity/v3/projects => generated 381 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:29.032103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3084c-7040-4634-acf3-1c535352c359 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:29.042936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3084c-7040-4634-acf3-1c535352c359 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:29.109990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b0f0d-3a01-4d9c-aa99-e4657319978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:29.110667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b0f0d-3a01-4d9c-aa99-e4657319978b admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:29.111124 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b0f0d-3a01-4d9c-aa99-e4657319978b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:29.111513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b0f0d-3a01-4d9c-aa99-e4657319978b admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:29.112230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b0f0d-3a01-4d9c-aa99-e4657319978b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:29.114261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b0f0d-3a01-4d9c-aa99-e4657319978b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:29.124028 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:29.227417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1267/2494] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:16:29 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:29.228731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22ba5a-d41a-4e7d-ba4d-7e960b91dc01 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:29.240523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22ba5a-d41a-4e7d-ba4d-7e960b91dc01 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:29.245670 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551ce9e-7a74-4ce2-a21a-7e2d7e428e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:29.246287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551ce9e-7a74-4ce2-a21a-7e2d7e428e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:29.246573 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551ce9e-7a74-4ce2-a21a-7e2d7e428e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:29.246843 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551ce9e-7a74-4ce2-a21a-7e2d7e428e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:29.247485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551ce9e-7a74-4ce2-a21a-7e2d7e428e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:29.249295 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551ce9e-7a74-4ce2-a21a-7e2d7e428e93 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:29.262413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1228/2495] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:16:29.266563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b0f0d-3a01-4d9c-aa99-e4657319978b admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:29.278319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b0f0d-3a01-4d9c-aa99-e4657319978b admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:29.293664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185537c-0ace-448d-8cd1-a0d9949f6303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:29.293664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185537c-0ace-448d-8cd1-a0d9949f6303 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:29.293664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185537c-0ace-448d-8cd1-a0d9949f6303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:29.293664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185537c-0ace-448d-8cd1-a0d9949f6303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:29.294272 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185537c-0ace-448d-8cd1-a0d9949f6303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:29.294272 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185537c-0ace-448d-8cd1-a0d9949f6303 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:29.298596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1268/2496] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:29.302810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551ce9e-7a74-4ce2-a21a-7e2d7e428e93 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:29.313983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551ce9e-7a74-4ce2-a21a-7e2d7e428e93 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:29.319090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa82a56-921f-490e-8f67-0a63a51f0041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:29.319753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa82a56-921f-490e-8f67-0a63a51f0041 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:29.320082 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa82a56-921f-490e-8f67-0a63a51f0041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:29.320377 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa82a56-921f-490e-8f67-0a63a51f0041 admin admin] PATH_INFO: `/v3/projects/2990c9984a2547d8a01d6daf88d6e024/users/61b9a274e84140fc9e7f2e7b17810075/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:29.336004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa82a56-921f-490e-8f67-0a63a51f0041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2990c9984a2547d8a01d6daf88d6e024, user_id=61b9a274e84140fc9e7f2e7b17810075, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:29.338763 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa82a56-921f-490e-8f67-0a63a51f0041 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:29.472125 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1229/2497] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:29 2022] PUT /identity/v3/projects/2990c9984a2547d8a01d6daf88d6e024/users/61b9a274e84140fc9e7f2e7b17810075/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:29.488802 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91130b73-185a-4cfd-9609-6aba6a01d67e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:29.489001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91130b73-185a-4cfd-9609-6aba6a01d67e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:29.489275 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91130b73-185a-4cfd-9609-6aba6a01d67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:29.516946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-91130b73-185a-4cfd-9609-6aba6a01d67e None None] MFA Rules not processed for user `61b9a274e84140fc9e7f2e7b17810075`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:29.518499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-91130b73-185a-4cfd-9609-6aba6a01d67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:29.583579 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1269/2498] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:29.588367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa82a56-921f-490e-8f67-0a63a51f0041 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:29.651565 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa82a56-921f-490e-8f67-0a63a51f0041 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:29.656381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd521f8-9ddd-4cc9-bacd-65fc7272e16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:29.656992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd521f8-9ddd-4cc9-bacd-65fc7272e16a admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:29.657276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd521f8-9ddd-4cc9-bacd-65fc7272e16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:29.657554 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd521f8-9ddd-4cc9-bacd-65fc7272e16a admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:29.658215 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd521f8-9ddd-4cc9-bacd-65fc7272e16a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:29.660151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd521f8-9ddd-4cc9-bacd-65fc7272e16a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:30.064296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1230/2499] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:16:29 2022] POST /identity/v3/projects => generated 383 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:30.068148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91130b73-185a-4cfd-9609-6aba6a01d67e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:30.078827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91130b73-185a-4cfd-9609-6aba6a01d67e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:30.136001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59c8ac-08ef-4f19-aec3-17da6daaec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:30.136614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59c8ac-08ef-4f19-aec3-17da6daaec5b admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:30.136896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59c8ac-08ef-4f19-aec3-17da6daaec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:30.137169 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59c8ac-08ef-4f19-aec3-17da6daaec5b admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:30.137801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59c8ac-08ef-4f19-aec3-17da6daaec5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:30.139710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59c8ac-08ef-4f19-aec3-17da6daaec5b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:30.263118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1270/2500] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:16:30 2022] POST /identity/v3/users => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:30.267292 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd521f8-9ddd-4cc9-bacd-65fc7272e16a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:30.278178 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd521f8-9ddd-4cc9-bacd-65fc7272e16a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:30.282810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c171aca-87a9-4f60-ac80-76a10752f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:30.283402 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c171aca-87a9-4f60-ac80-76a10752f659 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:30.283680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c171aca-87a9-4f60-ac80-76a10752f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:30.284010 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c171aca-87a9-4f60-ac80-76a10752f659 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:30.284654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c171aca-87a9-4f60-ac80-76a10752f659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:30.286232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c171aca-87a9-4f60-ac80-76a10752f659 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:30.297672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1231/2501] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:30.301626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59c8ac-08ef-4f19-aec3-17da6daaec5b admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:30.312075 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59c8ac-08ef-4f19-aec3-17da6daaec5b admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:30.317822 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a803bc1-49e4-40af-bf9b-26ecfa52f3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:30.318444 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a803bc1-49e4-40af-bf9b-26ecfa52f3f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:30.318722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a803bc1-49e4-40af-bf9b-26ecfa52f3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:30.319061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a803bc1-49e4-40af-bf9b-26ecfa52f3f4 admin admin] PATH_INFO: `/v3/projects/e2799959819d4ea6aadd55ab6b978a08/users/fcfded761fdb44b488171f3bc2a4c340/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:30.336501 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a803bc1-49e4-40af-bf9b-26ecfa52f3f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2799959819d4ea6aadd55ab6b978a08, user_id=fcfded761fdb44b488171f3bc2a4c340, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:30.339936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a803bc1-49e4-40af-bf9b-26ecfa52f3f4 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:30.435426 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1271/2502] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:30 2022] PUT /identity/v3/projects/e2799959819d4ea6aadd55ab6b978a08/users/fcfded761fdb44b488171f3bc2a4c340/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:16:30.439651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c171aca-87a9-4f60-ac80-76a10752f659 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:30.450708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c171aca-87a9-4f60-ac80-76a10752f659 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:30.508928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563cd06-1d13-4661-9430-94cbe70131d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:30.509582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563cd06-1d13-4661-9430-94cbe70131d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:30.509895 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563cd06-1d13-4661-9430-94cbe70131d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:30.510171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563cd06-1d13-4661-9430-94cbe70131d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:30.511355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563cd06-1d13-4661-9430-94cbe70131d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:30.513049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563cd06-1d13-4661-9430-94cbe70131d8 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:30.523500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1232/2503] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:30.528360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a803bc1-49e4-40af-bf9b-26ecfa52f3f4 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:30.539131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a803bc1-49e4-40af-bf9b-26ecfa52f3f4 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:30.544085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd651b-6b13-48ab-961f-34ac91655e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:30.544747 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd651b-6b13-48ab-961f-34ac91655e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:30.545029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd651b-6b13-48ab-961f-34ac91655e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:30.545305 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd651b-6b13-48ab-961f-34ac91655e63 admin admin] PATH_INFO: `/v3/projects/e2799959819d4ea6aadd55ab6b978a08/users/fcfded761fdb44b488171f3bc2a4c340/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:30.547252 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd651b-6b13-48ab-961f-34ac91655e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2799959819d4ea6aadd55ab6b978a08, user_id=fcfded761fdb44b488171f3bc2a4c340, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:30.549944 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd651b-6b13-48ab-961f-34ac91655e63 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:30.560593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1272/2504] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:30 2022] PUT /identity/v3/projects/e2799959819d4ea6aadd55ab6b978a08/users/fcfded761fdb44b488171f3bc2a4c340/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:30.570744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340ebbe-7193-4a57-a89a-3534957bbc6d None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:30.570976 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340ebbe-7193-4a57-a89a-3534957bbc6d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:30.571256 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340ebbe-7193-4a57-a89a-3534957bbc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:30.592292 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:30.600728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-0340ebbe-7193-4a57-a89a-3534957bbc6d None None] MFA Rules not processed for user `fcfded761fdb44b488171f3bc2a4c340`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:30.601948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-0340ebbe-7193-4a57-a89a-3534957bbc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:30.672928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1233/2505] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:30.684266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd651b-6b13-48ab-961f-34ac91655e63 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:30.685965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0bdd651b-6b13-48ab-961f-34ac91655e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:30.716764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:30.747698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd651b-6b13-48ab-961f-34ac91655e63 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:30.751501 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02920329-0df1-4931-aa4e-dbbafac2c09a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:30.752148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02920329-0df1-4931-aa4e-dbbafac2c09a service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:30.752433 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02920329-0df1-4931-aa4e-dbbafac2c09a service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:30.752710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02920329-0df1-4931-aa4e-dbbafac2c09a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:30.762291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02920329-0df1-4931-aa4e-dbbafac2c09a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:30.763719 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02920329-0df1-4931-aa4e-dbbafac2c09a service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:30.773099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1273/2506] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:30.874986 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340ebbe-7193-4a57-a89a-3534957bbc6d None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:30.884984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340ebbe-7193-4a57-a89a-3534957bbc6d None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:30.889396 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740991f-da6f-4c8c-834a-2014f53d4a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:30.890005 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740991f-da6f-4c8c-834a-2014f53d4a0b service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:30.890329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740991f-da6f-4c8c-834a-2014f53d4a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:30.890626 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740991f-da6f-4c8c-834a-2014f53d4a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:30.948351 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740991f-da6f-4c8c-834a-2014f53d4a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:30.949804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740991f-da6f-4c8c-834a-2014f53d4a0b service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:30.959512 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1234/2507] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:31.233858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02920329-0df1-4931-aa4e-dbbafac2c09a service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:31.235304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-02920329-0df1-4931-aa4e-dbbafac2c09a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:31.302828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02920329-0df1-4931-aa4e-dbbafac2c09a service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:31.307921 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd334874-0065-4fe3-be7f-02bf37623642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:31.308555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd334874-0065-4fe3-be7f-02bf37623642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:31.308863 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd334874-0065-4fe3-be7f-02bf37623642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:31.309134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd334874-0065-4fe3-be7f-02bf37623642 admin admin] PATH_INFO: `/v3/users/9ca998c43c8f44c9988e7f9fdc09f1f9` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:31.310272 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd334874-0065-4fe3-be7f-02bf37623642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca998c43c8f44c9988e7f9fdc09f1f9)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:31.312370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd334874-0065-4fe3-be7f-02bf37623642 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:31.578974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bd334874-0065-4fe3-be7f-02bf37623642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca998c43c8f44c9988e7f9fdc09f1f9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:31.591345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bd334874-0065-4fe3-be7f-02bf37623642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca998c43c8f44c9988e7f9fdc09f1f9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:31.679938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bd334874-0065-4fe3-be7f-02bf37623642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca998c43c8f44c9988e7f9fdc09f1f9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:31.688211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bd334874-0065-4fe3-be7f-02bf37623642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca998c43c8f44c9988e7f9fdc09f1f9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:31.688898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bd334874-0065-4fe3-be7f-02bf37623642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca998c43c8f44c9988e7f9fdc09f1f9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:31.695103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1274/2508] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:16:31 2022] DELETE /identity/v3/users/9ca998c43c8f44c9988e7f9fdc09f1f9 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:31.700552 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02338041-4cf4-4638-86df-644615b6f0f5 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:31.701080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02338041-4cf4-4638-86df-644615b6f0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:31.701271 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02338041-4cf4-4638-86df-644615b6f0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:31.721113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-02338041-4cf4-4638-86df-644615b6f0f5 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:31.722322 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-02338041-4cf4-4638-86df-644615b6f0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:31.781467 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1235/2509] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:31.791112 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd334874-0065-4fe3-be7f-02bf37623642 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:31.792567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-bd334874-0065-4fe3-be7f-02bf37623642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:31.843649 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:31.857110 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd334874-0065-4fe3-be7f-02bf37623642 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:31.859173 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e466a-bcac-4430-b2f5-b6fe1eb7be37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:31.859783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e466a-bcac-4430-b2f5-b6fe1eb7be37 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:31.860098 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e466a-bcac-4430-b2f5-b6fe1eb7be37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:31.860395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e466a-bcac-4430-b2f5-b6fe1eb7be37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:31.869451 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e466a-bcac-4430-b2f5-b6fe1eb7be37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:31.871446 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e466a-bcac-4430-b2f5-b6fe1eb7be37 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:31.881191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1275/2510] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:32.377067 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02338041-4cf4-4638-86df-644615b6f0f5 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:32.379955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-02338041-4cf4-4638-86df-644615b6f0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:32.392647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02338041-4cf4-4638-86df-644615b6f0f5 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:32.397932 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:32.398774 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:32.398934 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:32.399177 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea admin admin] PATH_INFO: `/v3/projects/ea0fe8cdd71a4d53af5a0095acbc0e83` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:32.400432 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea0fe8cdd71a4d53af5a0095acbc0e83)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:32.402879 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:32.512097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:32.527553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea0fe8cdd71a4d53af5a0095acbc0e83', 'request_id': 'req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:32.533170 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea0fe8cdd71a4d53af5a0095acbc0e83', 'request_id': 'req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:32.660411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea0fe8cdd71a4d53af5a0095acbc0e83', 'request_id': 'req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:32.672842 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea admin admin] The token cache is being invalidate because project ea0fe8cdd71a4d53af5a0095acbc0e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:16:32.673176 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:32.673861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:32.675421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1236/2511] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:16:32 2022] DELETE /identity/v3/projects/ea0fe8cdd71a4d53af5a0095acbc0e83 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:32.679413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e466a-bcac-4430-b2f5-b6fe1eb7be37 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:32.689659 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e466a-bcac-4430-b2f5-b6fe1eb7be37 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:32.749426 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f6248-5bcc-4f33-a13a-3fdbc9acc6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:32.750058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f6248-5bcc-4f33-a13a-3fdbc9acc6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:32.750341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f6248-5bcc-4f33-a13a-3fdbc9acc6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:32.750617 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f6248-5bcc-4f33-a13a-3fdbc9acc6c9 admin admin] PATH_INFO: `/v3/users/6e7f4b59016b43c6b0075928952b3615` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:32.751732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f6248-5bcc-4f33-a13a-3fdbc9acc6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e7f4b59016b43c6b0075928952b3615)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:32.753677 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f6248-5bcc-4f33-a13a-3fdbc9acc6c9 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:33.000927 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-362f6248-5bcc-4f33-a13a-3fdbc9acc6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7f4b59016b43c6b0075928952b3615'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:33.012743 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-362f6248-5bcc-4f33-a13a-3fdbc9acc6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7f4b59016b43c6b0075928952b3615'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:33.123237 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-362f6248-5bcc-4f33-a13a-3fdbc9acc6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7f4b59016b43c6b0075928952b3615'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:33.131505 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-362f6248-5bcc-4f33-a13a-3fdbc9acc6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7f4b59016b43c6b0075928952b3615'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:33.132183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-362f6248-5bcc-4f33-a13a-3fdbc9acc6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7f4b59016b43c6b0075928952b3615'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:33.138652 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1276/2512] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:16:32 2022] DELETE /identity/v3/users/6e7f4b59016b43c6b0075928952b3615 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:33.593715 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:33.595263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:33.609186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9e07a-8761-4ce1-907f-d9a81bd686ea admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:33.667046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8164f51-6f51-4da3-8a00-4bbeffaf826b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:33.667681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8164f51-6f51-4da3-8a00-4bbeffaf826b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:33.668042 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8164f51-6f51-4da3-8a00-4bbeffaf826b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:33.668315 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8164f51-6f51-4da3-8a00-4bbeffaf826b admin admin] PATH_INFO: `/v3/projects/086c676ed7da4d7d8415c63b046a822d` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:33.669420 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8164f51-6f51-4da3-8a00-4bbeffaf826b admin admin] RBAC: Authorizing `identity:delete_project(project_id=086c676ed7da4d7d8415c63b046a822d)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:33.671369 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8164f51-6f51-4da3-8a00-4bbeffaf826b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:34.064442 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b8164f51-6f51-4da3-8a00-4bbeffaf826b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086c676ed7da4d7d8415c63b046a822d', 'request_id': 'req-b8164f51-6f51-4da3-8a00-4bbeffaf826b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:34.070498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b8164f51-6f51-4da3-8a00-4bbeffaf826b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086c676ed7da4d7d8415c63b046a822d', 'request_id': 'req-b8164f51-6f51-4da3-8a00-4bbeffaf826b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:34.280602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b8164f51-6f51-4da3-8a00-4bbeffaf826b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086c676ed7da4d7d8415c63b046a822d', 'request_id': 'req-b8164f51-6f51-4da3-8a00-4bbeffaf826b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:34.293056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b8164f51-6f51-4da3-8a00-4bbeffaf826b admin admin] The token cache is being invalidate because project 086c676ed7da4d7d8415c63b046a822d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:16:34.293346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b8164f51-6f51-4da3-8a00-4bbeffaf826b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:34.294001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b8164f51-6f51-4da3-8a00-4bbeffaf826b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:34.295486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1237/2513] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:16:33 2022] DELETE /identity/v3/projects/086c676ed7da4d7d8415c63b046a822d => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:34.300479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe267710-9429-4e6f-97bb-5d82c8870452 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:34.301188 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe267710-9429-4e6f-97bb-5d82c8870452 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:34.301188 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe267710-9429-4e6f-97bb-5d82c8870452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:34.321657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-fe267710-9429-4e6f-97bb-5d82c8870452 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:34.323356 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fe267710-9429-4e6f-97bb-5d82c8870452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:34.381223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1277/2514] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:34.389807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f71d71-7806-4431-a138-cf5b43c8c038 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:34.390102 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f71d71-7806-4431-a138-cf5b43c8c038 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:34.390509 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f71d71-7806-4431-a138-cf5b43c8c038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:34.410661 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-d9f71d71-7806-4431-a138-cf5b43c8c038 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:34.411892 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d9f71d71-7806-4431-a138-cf5b43c8c038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:34.419842 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1238/2515] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:34.424224 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe267710-9429-4e6f-97bb-5d82c8870452 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:34.435127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe267710-9429-4e6f-97bb-5d82c8870452 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:34.438699 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049eb9a-2b17-4153-a916-cfc10c820c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:34.439291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049eb9a-2b17-4153-a916-cfc10c820c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:34.439570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049eb9a-2b17-4153-a916-cfc10c820c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:34.439839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049eb9a-2b17-4153-a916-cfc10c820c95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:34.440505 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049eb9a-2b17-4153-a916-cfc10c820c95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:16:34.440808 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049eb9a-2b17-4153-a916-cfc10c820c95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:34.442404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049eb9a-2b17-4153-a916-cfc10c820c95 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:34.443923 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:34.454938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1278/2516] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:16:34.459541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f71d71-7806-4431-a138-cf5b43c8c038 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:34.470125 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f71d71-7806-4431-a138-cf5b43c8c038 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:34.475548 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22357327-5f2a-4d7f-9d8b-247d81c42bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:34.480903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22357327-5f2a-4d7f-9d8b-247d81c42bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:34.480903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22357327-5f2a-4d7f-9d8b-247d81c42bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:34.480903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22357327-5f2a-4d7f-9d8b-247d81c42bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:34.480903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22357327-5f2a-4d7f-9d8b-247d81c42bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:34.480903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22357327-5f2a-4d7f-9d8b-247d81c42bc6 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:34.624075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1239/2517] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:16:34 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:34.626164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049eb9a-2b17-4153-a916-cfc10c820c95 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:34.636316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049eb9a-2b17-4153-a916-cfc10c820c95 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:34.698070 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63e453-0018-4a2e-9e42-5d7fbe224fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:34.698633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63e453-0018-4a2e-9e42-5d7fbe224fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:34.698934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63e453-0018-4a2e-9e42-5d7fbe224fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:34.699218 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63e453-0018-4a2e-9e42-5d7fbe224fe0 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:34.699928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63e453-0018-4a2e-9e42-5d7fbe224fe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:34.701857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63e453-0018-4a2e-9e42-5d7fbe224fe0 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:34.798169 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1279/2518] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:16:34 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:34.802714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22357327-5f2a-4d7f-9d8b-247d81c42bc6 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:34.814368 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22357327-5f2a-4d7f-9d8b-247d81c42bc6 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:34.820066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05992251-35eb-4c1c-b8d1-dc5ca6557120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:34.820700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05992251-35eb-4c1c-b8d1-dc5ca6557120 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:34.820980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05992251-35eb-4c1c-b8d1-dc5ca6557120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:34.821254 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05992251-35eb-4c1c-b8d1-dc5ca6557120 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:34.821899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05992251-35eb-4c1c-b8d1-dc5ca6557120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:34.823492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05992251-35eb-4c1c-b8d1-dc5ca6557120 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:34.834381 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1240/2519] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:34.839226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63e453-0018-4a2e-9e42-5d7fbe224fe0 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:34.849961 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63e453-0018-4a2e-9e42-5d7fbe224fe0 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:34.855527 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302aefe-3834-4dae-86e2-21ea678b0aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:34.859411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302aefe-3834-4dae-86e2-21ea678b0aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:34.859411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302aefe-3834-4dae-86e2-21ea678b0aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:34.859411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302aefe-3834-4dae-86e2-21ea678b0aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:34.859411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302aefe-3834-4dae-86e2-21ea678b0aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:34.859411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302aefe-3834-4dae-86e2-21ea678b0aa8 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:34.870819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1280/2520] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:34.875041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05992251-35eb-4c1c-b8d1-dc5ca6557120 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:34.886012 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05992251-35eb-4c1c-b8d1-dc5ca6557120 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:34.891502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49528a-8e15-4b6c-a3a5-e74053e521fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:34.892212 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49528a-8e15-4b6c-a3a5-e74053e521fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:34.892497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49528a-8e15-4b6c-a3a5-e74053e521fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:34.892761 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49528a-8e15-4b6c-a3a5-e74053e521fa admin admin] PATH_INFO: `/v3/projects/d1d0287e79ea4f07ae48ff632954a88f/users/47bcac4ef427421d8476a6c28c2eaabd/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:34.895117 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:34.909382 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49528a-8e15-4b6c-a3a5-e74053e521fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d0287e79ea4f07ae48ff632954a88f, user_id=47bcac4ef427421d8476a6c28c2eaabd, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:34.916925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49528a-8e15-4b6c-a3a5-e74053e521fa admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:35.052041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1241/2521] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:34 2022] PUT /identity/v3/projects/d1d0287e79ea4f07ae48ff632954a88f/users/47bcac4ef427421d8476a6c28c2eaabd/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:35.067384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f44f38-ff83-40f2-8529-49a237fccd65 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:35.067384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f44f38-ff83-40f2-8529-49a237fccd65 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:35.067384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f44f38-ff83-40f2-8529-49a237fccd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:35.094012 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-40f44f38-ff83-40f2-8529-49a237fccd65 None None] MFA Rules not processed for user `47bcac4ef427421d8476a6c28c2eaabd`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:35.095252 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-40f44f38-ff83-40f2-8529-49a237fccd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:35.181667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1281/2522] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:35.185693 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49528a-8e15-4b6c-a3a5-e74053e521fa admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:35.257990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49528a-8e15-4b6c-a3a5-e74053e521fa admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:35.263355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78044ac-f853-4083-8ed8-3c2b66449259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:35.263991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78044ac-f853-4083-8ed8-3c2b66449259 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:35.264274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78044ac-f853-4083-8ed8-3c2b66449259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:35.264548 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78044ac-f853-4083-8ed8-3c2b66449259 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:35.265190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78044ac-f853-4083-8ed8-3c2b66449259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:35.267104 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78044ac-f853-4083-8ed8-3c2b66449259 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:35.381855 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1242/2523] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:16:35 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:35.388117 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f44f38-ff83-40f2-8529-49a237fccd65 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:35.402340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f44f38-ff83-40f2-8529-49a237fccd65 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:35.459195 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6b083-0721-410f-920f-59492830b06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:35.459834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6b083-0721-410f-920f-59492830b06b admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:35.460148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6b083-0721-410f-920f-59492830b06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:35.460453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6b083-0721-410f-920f-59492830b06b admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:35.461115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6b083-0721-410f-920f-59492830b06b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:35.463111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6b083-0721-410f-920f-59492830b06b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:35.473621 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:35.603837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1282/2524] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:16:35 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:16:35.603994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78044ac-f853-4083-8ed8-3c2b66449259 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:35.604149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6b083-0721-410f-920f-59492830b06b admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:35.604789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-d78044ac-f853-4083-8ed8-3c2b66449259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:35.619174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78044ac-f853-4083-8ed8-3c2b66449259 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:35.620632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6b083-0721-410f-920f-59492830b06b admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:35.624420 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36015c25-dfe7-41cf-ad89-11bab163546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:35.625582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36015c25-dfe7-41cf-ad89-11bab163546f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:35.626041 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36015c25-dfe7-41cf-ad89-11bab163546f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:35.626534 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36015c25-dfe7-41cf-ad89-11bab163546f admin admin] PATH_INFO: `/v3/users/61b9a274e84140fc9e7f2e7b17810075` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:35.627982 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36015c25-dfe7-41cf-ad89-11bab163546f admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b9a274e84140fc9e7f2e7b17810075)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:35.631188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36015c25-dfe7-41cf-ad89-11bab163546f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:35.638823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec2f16-4cfb-43ec-b88d-4ddad7712715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:35.639725 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec2f16-4cfb-43ec-b88d-4ddad7712715 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:35.640219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec2f16-4cfb-43ec-b88d-4ddad7712715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:35.640633 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec2f16-4cfb-43ec-b88d-4ddad7712715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:35.641734 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec2f16-4cfb-43ec-b88d-4ddad7712715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:35.644565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec2f16-4cfb-43ec-b88d-4ddad7712715 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:35.665800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1283/2525] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:16:35.668027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec2f16-4cfb-43ec-b88d-4ddad7712715 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:35.681413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec2f16-4cfb-43ec-b88d-4ddad7712715 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:35.686561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fde569-cb05-4434-9c1c-7b3809de1fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:35.687303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fde569-cb05-4434-9c1c-7b3809de1fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:35.687590 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fde569-cb05-4434-9c1c-7b3809de1fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:35.688059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fde569-cb05-4434-9c1c-7b3809de1fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:35.688757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fde569-cb05-4434-9c1c-7b3809de1fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:35.690431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fde569-cb05-4434-9c1c-7b3809de1fc6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:35.703028 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1284/2526] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:35.710947 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fde569-cb05-4434-9c1c-7b3809de1fc6 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:35.724164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fde569-cb05-4434-9c1c-7b3809de1fc6 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:35.728973 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b7b0d-13b0-49b6-a843-a79306cdc03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:35.729674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b7b0d-13b0-49b6-a843-a79306cdc03b admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:35.730068 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b7b0d-13b0-49b6-a843-a79306cdc03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:35.730421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b7b0d-13b0-49b6-a843-a79306cdc03b admin admin] PATH_INFO: `/v3/projects/0a22840ade0a4dc69fd95bad86858587/users/e7cc16d1c5b14bfaaa6e2bd0df62ce3f/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:35.747958 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b7b0d-13b0-49b6-a843-a79306cdc03b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a22840ade0a4dc69fd95bad86858587, user_id=e7cc16d1c5b14bfaaa6e2bd0df62ce3f, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:35.776635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b7b0d-13b0-49b6-a843-a79306cdc03b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:35.995334 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1285/2527] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:35 2022] PUT /identity/v3/projects/0a22840ade0a4dc69fd95bad86858587/users/e7cc16d1c5b14bfaaa6e2bd0df62ce3f/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:16:36.010720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16e149-2e9f-435d-9e1b-1dee4ad5b3d6 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:36.010720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16e149-2e9f-435d-9e1b-1dee4ad5b3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:36.010720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16e149-2e9f-435d-9e1b-1dee4ad5b3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:36.035748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1a16e149-2e9f-435d-9e1b-1dee4ad5b3d6 None None] MFA Rules not processed for user `e7cc16d1c5b14bfaaa6e2bd0df62ce3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:36.037003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1a16e149-2e9f-435d-9e1b-1dee4ad5b3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:36.058104 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-36015c25-dfe7-41cf-ad89-11bab163546f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b9a274e84140fc9e7f2e7b17810075'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:36.066069 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-36015c25-dfe7-41cf-ad89-11bab163546f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b9a274e84140fc9e7f2e7b17810075'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:36.071639 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-36015c25-dfe7-41cf-ad89-11bab163546f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b9a274e84140fc9e7f2e7b17810075'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:36.107235 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1286/2528] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:16:36.117493 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16e149-2e9f-435d-9e1b-1dee4ad5b3d6 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:36.208924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16e149-2e9f-435d-9e1b-1dee4ad5b3d6 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:36.215291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443df54-3b33-4311-b477-bd8a21db9bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:36.216677 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443df54-3b33-4311-b477-bd8a21db9bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:36.220685 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443df54-3b33-4311-b477-bd8a21db9bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:36.220685 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443df54-3b33-4311-b477-bd8a21db9bd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:36.221043 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-36015c25-dfe7-41cf-ad89-11bab163546f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b9a274e84140fc9e7f2e7b17810075'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:36.221146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443df54-3b33-4311-b477-bd8a21db9bd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:36.221240 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-36015c25-dfe7-41cf-ad89-11bab163546f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b9a274e84140fc9e7f2e7b17810075'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:36.221326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443df54-3b33-4311-b477-bd8a21db9bd0 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:36.253803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1243/2529] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:16:35 2022] DELETE /identity/v3/users/61b9a274e84140fc9e7f2e7b17810075 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:36.258727 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8388fba-b792-4e6a-bc1c-c5e24a11dde0 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:36.258913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8388fba-b792-4e6a-bc1c-c5e24a11dde0 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:36.259170 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8388fba-b792-4e6a-bc1c-c5e24a11dde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:36.285320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e8388fba-b792-4e6a-bc1c-c5e24a11dde0 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:36.286649 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e8388fba-b792-4e6a-bc1c-c5e24a11dde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:36.318790 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1287/2530] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:16:36 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:16:36.319988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443df54-3b33-4311-b477-bd8a21db9bd0 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:36.321896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e443df54-3b33-4311-b477-bd8a21db9bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:36.366862 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:36.378070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:36.427933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1244/2531] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:36.439935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443df54-3b33-4311-b477-bd8a21db9bd0 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:36.444788 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8388fba-b792-4e6a-bc1c-c5e24a11dde0 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:36.445277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9890f7-488d-4c27-be05-4041ff26c1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:36.446043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9890f7-488d-4c27-be05-4041ff26c1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:36.446360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9890f7-488d-4c27-be05-4041ff26c1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:36.446742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9890f7-488d-4c27-be05-4041ff26c1a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:36.447454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9890f7-488d-4c27-be05-4041ff26c1a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:36.447628 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e8388fba-b792-4e6a-bc1c-c5e24a11dde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:36.450484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9890f7-488d-4c27-be05-4041ff26c1a8 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:36.550341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8388fba-b792-4e6a-bc1c-c5e24a11dde0 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:36.581046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1288/2532] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:16:36 2022] POST /identity/v3/users => generated 296 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:36.592089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9890f7-488d-4c27-be05-4041ff26c1a8 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:36.602396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9890f7-488d-4c27-be05-4041ff26c1a8 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:36.606962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d15333-8c60-4337-a802-d6df133e5602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:36.608985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d15333-8c60-4337-a802-d6df133e5602 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:36.609275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d15333-8c60-4337-a802-d6df133e5602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:36.609552 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d15333-8c60-4337-a802-d6df133e5602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:36.614051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f42ada-9bdc-46b5-b9b8-c2cb4d6dfe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:36.614895 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f42ada-9bdc-46b5-b9b8-c2cb4d6dfe05 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:36.615193 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f42ada-9bdc-46b5-b9b8-c2cb4d6dfe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:36.616117 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f42ada-9bdc-46b5-b9b8-c2cb4d6dfe05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:36.620194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f42ada-9bdc-46b5-b9b8-c2cb4d6dfe05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:36.620194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f42ada-9bdc-46b5-b9b8-c2cb4d6dfe05 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:36.628470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d15333-8c60-4337-a802-d6df133e5602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:36.630405 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d15333-8c60-4337-a802-d6df133e5602 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:36.642799 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1289/2533] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:36.643986 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1245/2534] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:36.647087 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f42ada-9bdc-46b5-b9b8-c2cb4d6dfe05 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:36.658859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f42ada-9bdc-46b5-b9b8-c2cb4d6dfe05 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:36.665266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05cec1-b348-49e0-9701-79be6ccffee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:36.666159 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05cec1-b348-49e0-9701-79be6ccffee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:36.667325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05cec1-b348-49e0-9701-79be6ccffee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:36.667622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05cec1-b348-49e0-9701-79be6ccffee9 admin admin] PATH_INFO: `/v3/projects/83733e2762fe49fdb1150ad3d7b4f4f8/users/4d0da40bca5b45bcb027c657f1487658/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:36.686115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05cec1-b348-49e0-9701-79be6ccffee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83733e2762fe49fdb1150ad3d7b4f4f8, user_id=4d0da40bca5b45bcb027c657f1487658, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:36.689402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05cec1-b348-49e0-9701-79be6ccffee9 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:36.781322 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1290/2535] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:36 2022] PUT /identity/v3/projects/83733e2762fe49fdb1150ad3d7b4f4f8/users/4d0da40bca5b45bcb027c657f1487658/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:16:36.782695 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d15333-8c60-4337-a802-d6df133e5602 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:36.797622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d15333-8c60-4337-a802-d6df133e5602 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:36.875851 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf42047-dc13-4739-a719-c4b7725e6843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:36.876984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf42047-dc13-4739-a719-c4b7725e6843 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:36.877171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf42047-dc13-4739-a719-c4b7725e6843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:36.877461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf42047-dc13-4739-a719-c4b7725e6843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:36.878209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf42047-dc13-4739-a719-c4b7725e6843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:36.880731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf42047-dc13-4739-a719-c4b7725e6843 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:36.898705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1246/2536] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:16:36.903609 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05cec1-b348-49e0-9701-79be6ccffee9 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:36.911378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05cec1-b348-49e0-9701-79be6ccffee9 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:36.916476 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb35fb-ea31-4115-9c61-727337dc78da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:36.917167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb35fb-ea31-4115-9c61-727337dc78da admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:36.917448 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb35fb-ea31-4115-9c61-727337dc78da admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:36.917720 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb35fb-ea31-4115-9c61-727337dc78da admin admin] PATH_INFO: `/v3/projects/83733e2762fe49fdb1150ad3d7b4f4f8/users/4d0da40bca5b45bcb027c657f1487658/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:36.919771 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb35fb-ea31-4115-9c61-727337dc78da admin admin] RBAC: Authorizing `identity:create_grant(project_id=83733e2762fe49fdb1150ad3d7b4f4f8, user_id=4d0da40bca5b45bcb027c657f1487658, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:36.922658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb35fb-ea31-4115-9c61-727337dc78da admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:36.935896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1291/2537] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:36 2022] PUT /identity/v3/projects/83733e2762fe49fdb1150ad3d7b4f4f8/users/4d0da40bca5b45bcb027c657f1487658/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:36.948666 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195069a-af91-4c67-a14d-48bf8e17b9a2 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:36.949296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195069a-af91-4c67-a14d-48bf8e17b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:36.949925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195069a-af91-4c67-a14d-48bf8e17b9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:36.985731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-7195069a-af91-4c67-a14d-48bf8e17b9a2 None None] MFA Rules not processed for user `4d0da40bca5b45bcb027c657f1487658`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:36.987088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7195069a-af91-4c67-a14d-48bf8e17b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:37.075929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1247/2538] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:37.094771 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb35fb-ea31-4115-9c61-727337dc78da admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:37.096859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f4bb35fb-ea31-4115-9c61-727337dc78da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:37.179191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb35fb-ea31-4115-9c61-727337dc78da admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:37.186271 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d15b9-3ce4-4735-8c66-2d6bdf571d0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:37.187227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d15b9-3ce4-4735-8c66-2d6bdf571d0d service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:37.188044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d15b9-3ce4-4735-8c66-2d6bdf571d0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:37.188529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d15b9-3ce4-4735-8c66-2d6bdf571d0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:37.200470 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d15b9-3ce4-4735-8c66-2d6bdf571d0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:37.202183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d15b9-3ce4-4735-8c66-2d6bdf571d0d service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:37.215686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1292/2539] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:37.375266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195069a-af91-4c67-a14d-48bf8e17b9a2 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:37.376711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7195069a-af91-4c67-a14d-48bf8e17b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:37.389312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195069a-af91-4c67-a14d-48bf8e17b9a2 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:37.393066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df473a58-6897-490c-800d-b20be4c110e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:37.393666 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df473a58-6897-490c-800d-b20be4c110e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:37.393948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df473a58-6897-490c-800d-b20be4c110e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:37.394257 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df473a58-6897-490c-800d-b20be4c110e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:37.396050 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-df473a58-6897-490c-800d-b20be4c110e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:37.408498 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d15b9-3ce4-4735-8c66-2d6bdf571d0d service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:37.410368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2d7d15b9-3ce4-4735-8c66-2d6bdf571d0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:37.505477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d15b9-3ce4-4735-8c66-2d6bdf571d0d service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:37.509633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df473a58-6897-490c-800d-b20be4c110e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:37.511771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df473a58-6897-490c-800d-b20be4c110e3 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:37.513127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948260b-2197-42d5-9862-a9681dcb9ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:37.514131 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948260b-2197-42d5-9862-a9681dcb9ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:37.514425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948260b-2197-42d5-9862-a9681dcb9ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:37.514702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948260b-2197-42d5-9862-a9681dcb9ae9 admin admin] PATH_INFO: `/v3/projects/2990c9984a2547d8a01d6daf88d6e024` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:37.516483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948260b-2197-42d5-9862-a9681dcb9ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2990c9984a2547d8a01d6daf88d6e024)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:37.518439 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948260b-2197-42d5-9862-a9681dcb9ae9 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:37.523347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1248/2540] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:37.528372 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:37.876783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6948260b-2197-42d5-9862-a9681dcb9ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2990c9984a2547d8a01d6daf88d6e024', 'request_id': 'req-6948260b-2197-42d5-9862-a9681dcb9ae9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:38.017399 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6948260b-2197-42d5-9862-a9681dcb9ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2990c9984a2547d8a01d6daf88d6e024', 'request_id': 'req-6948260b-2197-42d5-9862-a9681dcb9ae9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:38.024627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6948260b-2197-42d5-9862-a9681dcb9ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2990c9984a2547d8a01d6daf88d6e024', 'request_id': 'req-6948260b-2197-42d5-9862-a9681dcb9ae9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:38.037079 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6948260b-2197-42d5-9862-a9681dcb9ae9 admin admin] The token cache is being invalidate because project 2990c9984a2547d8a01d6daf88d6e024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:16:38.037392 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6948260b-2197-42d5-9862-a9681dcb9ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:38.038149 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6948260b-2197-42d5-9862-a9681dcb9ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:38.039764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1293/2541] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:16:37 2022] DELETE /identity/v3/projects/2990c9984a2547d8a01d6daf88d6e024 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:16:38.043843 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df473a58-6897-490c-800d-b20be4c110e3 service cinder] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:38.054577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df473a58-6897-490c-800d-b20be4c110e3 service cinder] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:38.111790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15711bc3-455e-4744-a756-c1643df427ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:38.112386 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15711bc3-455e-4744-a756-c1643df427ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:38.112673 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15711bc3-455e-4744-a756-c1643df427ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:38.112951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15711bc3-455e-4744-a756-c1643df427ad admin admin] PATH_INFO: `/v3/users/fcfded761fdb44b488171f3bc2a4c340` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:38.114109 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15711bc3-455e-4744-a756-c1643df427ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcfded761fdb44b488171f3bc2a4c340)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:38.116153 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15711bc3-455e-4744-a756-c1643df427ad admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:38.234713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:38.375672 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948260b-2197-42d5-9862-a9681dcb9ae9 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:38.377134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6948260b-2197-42d5-9862-a9681dcb9ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:38.442804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948260b-2197-42d5-9862-a9681dcb9ae9 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:38.446950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab7960-b37d-4951-864e-d507f627f325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:38.447603 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab7960-b37d-4951-864e-d507f627f325 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:38.448682 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab7960-b37d-4951-864e-d507f627f325 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:38.448906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab7960-b37d-4951-864e-d507f627f325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:38.450751 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e9ab7960-b37d-4951-864e-d507f627f325 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:38.511623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-15711bc3-455e-4744-a756-c1643df427ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcfded761fdb44b488171f3bc2a4c340'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:38.511623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-15711bc3-455e-4744-a756-c1643df427ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcfded761fdb44b488171f3bc2a4c340'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:38.518492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-15711bc3-455e-4744-a756-c1643df427ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcfded761fdb44b488171f3bc2a4c340'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:38.541307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab7960-b37d-4951-864e-d507f627f325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:38.543372 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab7960-b37d-4951-864e-d507f627f325 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:38.555695 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1294/2542] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:16:38.661149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-15711bc3-455e-4744-a756-c1643df427ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcfded761fdb44b488171f3bc2a4c340'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:38.661825 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-15711bc3-455e-4744-a756-c1643df427ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcfded761fdb44b488171f3bc2a4c340'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:38.681910 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1249/2543] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:16:38 2022] DELETE /identity/v3/users/fcfded761fdb44b488171f3bc2a4c340 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:39.029570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:39.396074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab7960-b37d-4951-864e-d507f627f325 service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:39.399311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e9ab7960-b37d-4951-864e-d507f627f325 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:39.412114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab7960-b37d-4951-864e-d507f627f325 service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:39.453349 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:39.479399 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d91359-5ee4-47e8-99f3-da3ccdc7e32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:39.480092 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d91359-5ee4-47e8-99f3-da3ccdc7e32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:39.480377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d91359-5ee4-47e8-99f3-da3ccdc7e32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:39.480674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d91359-5ee4-47e8-99f3-da3ccdc7e32a admin admin] PATH_INFO: `/v3/projects/e2799959819d4ea6aadd55ab6b978a08` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:39.481887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d91359-5ee4-47e8-99f3-da3ccdc7e32a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2799959819d4ea6aadd55ab6b978a08)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:39.483978 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d91359-5ee4-47e8-99f3-da3ccdc7e32a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:39.669143 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a5d91359-5ee4-47e8-99f3-da3ccdc7e32a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2799959819d4ea6aadd55ab6b978a08', 'request_id': 'req-a5d91359-5ee4-47e8-99f3-da3ccdc7e32a'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:39.805465 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a5d91359-5ee4-47e8-99f3-da3ccdc7e32a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2799959819d4ea6aadd55ab6b978a08', 'request_id': 'req-a5d91359-5ee4-47e8-99f3-da3ccdc7e32a'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:39.813280 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a5d91359-5ee4-47e8-99f3-da3ccdc7e32a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2799959819d4ea6aadd55ab6b978a08', 'request_id': 'req-a5d91359-5ee4-47e8-99f3-da3ccdc7e32a'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:39.824811 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a5d91359-5ee4-47e8-99f3-da3ccdc7e32a admin admin] The token cache is being invalidate because project e2799959819d4ea6aadd55ab6b978a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:16:39.825104 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a5d91359-5ee4-47e8-99f3-da3ccdc7e32a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:39.825751 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a5d91359-5ee4-47e8-99f3-da3ccdc7e32a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:39.827253 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1295/2544] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:16:39 2022] DELETE /identity/v3/projects/e2799959819d4ea6aadd55ab6b978a08 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:39.832721 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d06a8-3aee-4a6d-8a6c-ca44fa60ae5d None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:39.833681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d06a8-3aee-4a6d-8a6c-ca44fa60ae5d None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:39.833960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d06a8-3aee-4a6d-8a6c-ca44fa60ae5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:39.853331 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-547d06a8-3aee-4a6d-8a6c-ca44fa60ae5d None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:39.854553 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-547d06a8-3aee-4a6d-8a6c-ca44fa60ae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:39.913512 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1250/2545] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:39.980091 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a9d8-257d-42f8-915f-932ad63b7742 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:39.980382 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a9d8-257d-42f8-915f-932ad63b7742 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:39.980660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369a9d8-257d-42f8-915f-932ad63b7742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:40.000787 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-6369a9d8-257d-42f8-915f-932ad63b7742 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:40.002000 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6369a9d8-257d-42f8-915f-932ad63b7742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:40.011171 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1296/2546] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:40.016003 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d06a8-3aee-4a6d-8a6c-ca44fa60ae5d None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:40.025601 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d06a8-3aee-4a6d-8a6c-ca44fa60ae5d None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:40.031979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c3b22-a451-4078-951a-0a179409db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:40.032220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c3b22-a451-4078-951a-0a179409db13 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:40.032576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c3b22-a451-4078-951a-0a179409db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:40.032913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c3b22-a451-4078-951a-0a179409db13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:40.033664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c3b22-a451-4078-951a-0a179409db13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:16:40.034031 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c3b22-a451-4078-951a-0a179409db13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:40.036083 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c3b22-a451-4078-951a-0a179409db13 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:40.050364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1251/2547] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:16:40.058038 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369a9d8-257d-42f8-915f-932ad63b7742 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:40.068109 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369a9d8-257d-42f8-915f-932ad63b7742 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:40.073110 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b63669-9ac6-4874-90d0-41df28b08559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:40.076081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b63669-9ac6-4874-90d0-41df28b08559 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:40.076081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b63669-9ac6-4874-90d0-41df28b08559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:40.076081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b63669-9ac6-4874-90d0-41df28b08559 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:40.076081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b63669-9ac6-4874-90d0-41df28b08559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:40.077217 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b63669-9ac6-4874-90d0-41df28b08559 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:40.233171 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1297/2548] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:16:40 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:16:40.235503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c3b22-a451-4078-951a-0a179409db13 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:40.246219 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c3b22-a451-4078-951a-0a179409db13 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:40.305692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca7987-95cf-4fe2-978d-c873cb1562f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:40.306336 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca7987-95cf-4fe2-978d-c873cb1562f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:40.306776 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca7987-95cf-4fe2-978d-c873cb1562f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:40.307015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca7987-95cf-4fe2-978d-c873cb1562f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:40.307686 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca7987-95cf-4fe2-978d-c873cb1562f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:40.309671 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca7987-95cf-4fe2-978d-c873cb1562f5 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:40.469803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1252/2549] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:16:40 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:40.473912 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b63669-9ac6-4874-90d0-41df28b08559 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:40.484890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b63669-9ac6-4874-90d0-41df28b08559 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:40.489893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f6f0a-3be4-4725-9d65-e933199356c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:40.490513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f6f0a-3be4-4725-9d65-e933199356c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:40.490798 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f6f0a-3be4-4725-9d65-e933199356c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:40.491203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f6f0a-3be4-4725-9d65-e933199356c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:40.491913 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f6f0a-3be4-4725-9d65-e933199356c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:40.493626 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f6f0a-3be4-4725-9d65-e933199356c2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:40.504280 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1298/2550] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:40.508452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca7987-95cf-4fe2-978d-c873cb1562f5 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:40.520805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca7987-95cf-4fe2-978d-c873cb1562f5 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:40.525772 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26e568-0fde-462e-b35d-622ad0fd49f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:40.527340 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26e568-0fde-462e-b35d-622ad0fd49f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:40.527648 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26e568-0fde-462e-b35d-622ad0fd49f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:40.527984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26e568-0fde-462e-b35d-622ad0fd49f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:40.528709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26e568-0fde-462e-b35d-622ad0fd49f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:40.530405 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26e568-0fde-462e-b35d-622ad0fd49f1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:40.542984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1253/2551] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:16:40.547764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f6f0a-3be4-4725-9d65-e933199356c2 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:40.558613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f6f0a-3be4-4725-9d65-e933199356c2 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:40.563372 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c5fbb-1184-4745-8b35-9e923887bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:40.564882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c5fbb-1184-4745-8b35-9e923887bf96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:40.564882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c5fbb-1184-4745-8b35-9e923887bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:40.564882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c5fbb-1184-4745-8b35-9e923887bf96 admin admin] PATH_INFO: `/v3/projects/0bddb804c6894987bff0ba49aee103c5/users/447fc8fc12854ecfa34c266e952949b3/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:40.580016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c5fbb-1184-4745-8b35-9e923887bf96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bddb804c6894987bff0ba49aee103c5, user_id=447fc8fc12854ecfa34c266e952949b3, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:40.583056 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c5fbb-1184-4745-8b35-9e923887bf96 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:40.725412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1299/2552] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:40 2022] PUT /identity/v3/projects/0bddb804c6894987bff0ba49aee103c5/users/447fc8fc12854ecfa34c266e952949b3/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:40.736026 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45ba29-499a-47a5-8b4e-b8dccc4decee None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:40.736252 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45ba29-499a-47a5-8b4e-b8dccc4decee None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:40.736526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45ba29-499a-47a5-8b4e-b8dccc4decee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:40.763296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-5e45ba29-499a-47a5-8b4e-b8dccc4decee None None] MFA Rules not processed for user `447fc8fc12854ecfa34c266e952949b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:40.764524 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-5e45ba29-499a-47a5-8b4e-b8dccc4decee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:40.797606 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:40.829464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1254/2553] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:40.842021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c5fbb-1184-4745-8b35-9e923887bf96 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:40.843741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e49c5fbb-1184-4745-8b35-9e923887bf96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:40.903282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c5fbb-1184-4745-8b35-9e923887bf96 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:40.906905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9c5bb-4398-476e-a0b5-8a3fcff4e4c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f750815038d404d9d39a68bf62db8c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:40.907510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9c5bb-4398-476e-a0b5-8a3fcff4e4c5 service glance] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:40.907792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9c5bb-4398-476e-a0b5-8a3fcff4e4c5 service glance] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:40.908096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9c5bb-4398-476e-a0b5-8a3fcff4e4c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:40.916321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9c5bb-4398-476e-a0b5-8a3fcff4e4c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:40.918401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9c5bb-4398-476e-a0b5-8a3fcff4e4c5 service glance] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:40.927343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1300/2554] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:44.122302 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45ba29-499a-47a5-8b4e-b8dccc4decee None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:44.123090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-5e45ba29-499a-47a5-8b4e-b8dccc4decee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:44.195266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45ba29-499a-47a5-8b4e-b8dccc4decee None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:44.200350 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46256740-b1e3-4788-9403-a210d9b5c75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:44.200986 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46256740-b1e3-4788-9403-a210d9b5c75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:44.201266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46256740-b1e3-4788-9403-a210d9b5c75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:44.201540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46256740-b1e3-4788-9403-a210d9b5c75d admin admin] PATH_INFO: `/v3/users/47bcac4ef427421d8476a6c28c2eaabd` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:44.203011 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46256740-b1e3-4788-9403-a210d9b5c75d admin admin] RBAC: Authorizing `identity:delete_user(user_id=47bcac4ef427421d8476a6c28c2eaabd)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:44.204983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46256740-b1e3-4788-9403-a210d9b5c75d admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:44.653738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9c5bb-4398-476e-a0b5-8a3fcff4e4c5 service glance] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:44.655470 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-8fe9c5bb-4398-476e-a0b5-8a3fcff4e4c5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:44.662188 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:44.714664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9c5bb-4398-476e-a0b5-8a3fcff4e4c5 service glance] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:44.717927 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-46256740-b1e3-4788-9403-a210d9b5c75d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47bcac4ef427421d8476a6c28c2eaabd'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:44.718571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-46256740-b1e3-4788-9403-a210d9b5c75d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47bcac4ef427421d8476a6c28c2eaabd'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:44.718735 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c161fc-1e6f-42f7-9194-44676bbe0c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:44.719296 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c161fc-1e6f-42f7-9194-44676bbe0c48 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:44.719580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c161fc-1e6f-42f7-9194-44676bbe0c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:44.719860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c161fc-1e6f-42f7-9194-44676bbe0c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:44.721902 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-99c161fc-1e6f-42f7-9194-44676bbe0c48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:44.731983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-46256740-b1e3-4788-9403-a210d9b5c75d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47bcac4ef427421d8476a6c28c2eaabd'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:44.841159 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c161fc-1e6f-42f7-9194-44676bbe0c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:44.842644 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c161fc-1e6f-42f7-9194-44676bbe0c48 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:44.854688 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1301/2555] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:16:44.962993 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-46256740-b1e3-4788-9403-a210d9b5c75d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47bcac4ef427421d8476a6c28c2eaabd'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:44.963616 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-46256740-b1e3-4788-9403-a210d9b5c75d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47bcac4ef427421d8476a6c28c2eaabd'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:44.977955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1255/2556] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:16:44 2022] DELETE /identity/v3/users/47bcac4ef427421d8476a6c28c2eaabd => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:44.988882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ca9b4-ec13-434c-83a2-45643cd2a96e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:44.989171 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ca9b4-ec13-434c-83a2-45643cd2a96e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:44.989447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ca9b4-ec13-434c-83a2-45643cd2a96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:45.009670 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-091ca9b4-ec13-434c-83a2-45643cd2a96e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:45.010914 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-091ca9b4-ec13-434c-83a2-45643cd2a96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:45.071326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1302/2557] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:16:45.082740 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46256740-b1e3-4788-9403-a210d9b5c75d admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:45.084511 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-46256740-b1e3-4788-9403-a210d9b5c75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:45.145441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46256740-b1e3-4788-9403-a210d9b5c75d admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:45.149630 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee33c0f-5177-4729-9c19-2390a1265988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:45.150250 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee33c0f-5177-4729-9c19-2390a1265988 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:45.151033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee33c0f-5177-4729-9c19-2390a1265988 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:45.151306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee33c0f-5177-4729-9c19-2390a1265988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:45.159384 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:45.162456 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee33c0f-5177-4729-9c19-2390a1265988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:45.164045 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee33c0f-5177-4729-9c19-2390a1265988 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:45.174934 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1256/2558] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:45.643031 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ca9b4-ec13-434c-83a2-45643cd2a96e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:45.644429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-091ca9b4-ec13-434c-83a2-45643cd2a96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:45.658005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ca9b4-ec13-434c-83a2-45643cd2a96e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:45.668182 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:45.668182 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:45.668182 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:45.668182 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6 admin admin] PATH_INFO: `/v3/projects/d1d0287e79ea4f07ae48ff632954a88f` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:45.668562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d0287e79ea4f07ae48ff632954a88f)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:45.668562 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:45.823344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:45.829586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d0287e79ea4f07ae48ff632954a88f', 'request_id': 'req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:45.937451 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d0287e79ea4f07ae48ff632954a88f', 'request_id': 'req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:45.944643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d0287e79ea4f07ae48ff632954a88f', 'request_id': 'req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:45.956371 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6 admin admin] The token cache is being invalidate because project d1d0287e79ea4f07ae48ff632954a88f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:16:45.957066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:45.957797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:45.959577 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1303/2559] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:16:45 2022] DELETE /identity/v3/projects/d1d0287e79ea4f07ae48ff632954a88f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:45.963789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee33c0f-5177-4729-9c19-2390a1265988 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:45.973940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee33c0f-5177-4729-9c19-2390a1265988 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:46.040926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92154c76-f63c-471d-bb93-44781640eeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:46.041735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92154c76-f63c-471d-bb93-44781640eeb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:46.042019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92154c76-f63c-471d-bb93-44781640eeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:46.042294 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92154c76-f63c-471d-bb93-44781640eeb7 admin admin] PATH_INFO: `/v3/users/e7cc16d1c5b14bfaaa6e2bd0df62ce3f` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:46.043424 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92154c76-f63c-471d-bb93-44781640eeb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7cc16d1c5b14bfaaa6e2bd0df62ce3f)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:46.045492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92154c76-f63c-471d-bb93-44781640eeb7 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:46.292618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-92154c76-f63c-471d-bb93-44781640eeb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7cc16d1c5b14bfaaa6e2bd0df62ce3f'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:46.293719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-92154c76-f63c-471d-bb93-44781640eeb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7cc16d1c5b14bfaaa6e2bd0df62ce3f'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:46.308845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-92154c76-f63c-471d-bb93-44781640eeb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7cc16d1c5b14bfaaa6e2bd0df62ce3f'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:46.402936 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-92154c76-f63c-471d-bb93-44781640eeb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7cc16d1c5b14bfaaa6e2bd0df62ce3f'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:46.403702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-92154c76-f63c-471d-bb93-44781640eeb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7cc16d1c5b14bfaaa6e2bd0df62ce3f'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:46.417696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1257/2560] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:16:45 2022] DELETE /identity/v3/users/e7cc16d1c5b14bfaaa6e2bd0df62ce3f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:16:47.048605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:47.049229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:47.065650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c73f4-3563-4c64-a3ff-9cfe33050ed6 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:47.136344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57537259-accc-4392-bb7c-0219750fc6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:47.136996 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57537259-accc-4392-bb7c-0219750fc6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:47.142690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57537259-accc-4392-bb7c-0219750fc6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:47.142690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57537259-accc-4392-bb7c-0219750fc6ff admin admin] PATH_INFO: `/v3/projects/0a22840ade0a4dc69fd95bad86858587` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:47.142690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57537259-accc-4392-bb7c-0219750fc6ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a22840ade0a4dc69fd95bad86858587)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:47.142690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57537259-accc-4392-bb7c-0219750fc6ff admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:47.286820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-57537259-accc-4392-bb7c-0219750fc6ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a22840ade0a4dc69fd95bad86858587', 'request_id': 'req-57537259-accc-4392-bb7c-0219750fc6ff'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:47.397101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-57537259-accc-4392-bb7c-0219750fc6ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a22840ade0a4dc69fd95bad86858587', 'request_id': 'req-57537259-accc-4392-bb7c-0219750fc6ff'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:47.405419 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-57537259-accc-4392-bb7c-0219750fc6ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a22840ade0a4dc69fd95bad86858587', 'request_id': 'req-57537259-accc-4392-bb7c-0219750fc6ff'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:47.417467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-57537259-accc-4392-bb7c-0219750fc6ff admin admin] The token cache is being invalidate because project 0a22840ade0a4dc69fd95bad86858587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:16:47.420152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-57537259-accc-4392-bb7c-0219750fc6ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:47.420965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-57537259-accc-4392-bb7c-0219750fc6ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:47.430443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1304/2561] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:16:47 2022] DELETE /identity/v3/projects/0a22840ade0a4dc69fd95bad86858587 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:47.432714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92154c76-f63c-471d-bb93-44781640eeb7 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:47.434850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-92154c76-f63c-471d-bb93-44781640eeb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:47.449715 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92154c76-f63c-471d-bb93-44781640eeb7 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:47.507951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48560da-5ad3-4cde-85ad-79c46e3219e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:47.508549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48560da-5ad3-4cde-85ad-79c46e3219e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:47.508827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48560da-5ad3-4cde-85ad-79c46e3219e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:47.509098 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48560da-5ad3-4cde-85ad-79c46e3219e2 admin admin] PATH_INFO: `/v3/users/4d0da40bca5b45bcb027c657f1487658` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:47.510832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48560da-5ad3-4cde-85ad-79c46e3219e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0da40bca5b45bcb027c657f1487658)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:47.512785 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48560da-5ad3-4cde-85ad-79c46e3219e2 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:47.528379 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:47.750918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d48560da-5ad3-4cde-85ad-79c46e3219e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0da40bca5b45bcb027c657f1487658'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:47.751572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d48560da-5ad3-4cde-85ad-79c46e3219e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0da40bca5b45bcb027c657f1487658'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:47.763951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d48560da-5ad3-4cde-85ad-79c46e3219e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0da40bca5b45bcb027c657f1487658'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:47.851207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d48560da-5ad3-4cde-85ad-79c46e3219e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0da40bca5b45bcb027c657f1487658'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:47.851973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d48560da-5ad3-4cde-85ad-79c46e3219e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0da40bca5b45bcb027c657f1487658'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:47.865075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1258/2562] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:16:47 2022] DELETE /identity/v3/users/4d0da40bca5b45bcb027c657f1487658 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:16:48.382793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57537259-accc-4392-bb7c-0219750fc6ff admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:48.384337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-57537259-accc-4392-bb7c-0219750fc6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:48.397846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57537259-accc-4392-bb7c-0219750fc6ff admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:48.466044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e3e37-dc8f-4110-8fb3-9a8f4a4e3599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:48.466044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e3e37-dc8f-4110-8fb3-9a8f4a4e3599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:48.466044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e3e37-dc8f-4110-8fb3-9a8f4a4e3599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:48.466044 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e3e37-dc8f-4110-8fb3-9a8f4a4e3599 admin admin] PATH_INFO: `/v3/projects/83733e2762fe49fdb1150ad3d7b4f4f8` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:48.467624 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e3e37-dc8f-4110-8fb3-9a8f4a4e3599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83733e2762fe49fdb1150ad3d7b4f4f8)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:48.469718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e3e37-dc8f-4110-8fb3-9a8f4a4e3599 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:48.471555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:48.749370 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863ddc2-2c15-4b3b-ae60-39edacd24316 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:48.749931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863ddc2-2c15-4b3b-ae60-39edacd24316 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:48.750025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863ddc2-2c15-4b3b-ae60-39edacd24316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:48.772026 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-7863ddc2-2c15-4b3b-ae60-39edacd24316 None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:48.773366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7863ddc2-2c15-4b3b-ae60-39edacd24316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:48.773488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a86e3e37-dc8f-4110-8fb3-9a8f4a4e3599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83733e2762fe49fdb1150ad3d7b4f4f8', 'request_id': 'req-a86e3e37-dc8f-4110-8fb3-9a8f4a4e3599'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:48.829209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1259/2563] 10.222.0.64 () {58 vars in 967 bytes} [Thu Sep 1 14:16:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:16:48.850585 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863ddc2-2c15-4b3b-ae60-39edacd24316 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:48.851966 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7863ddc2-2c15-4b3b-ae60-39edacd24316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:48.922715 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863ddc2-2c15-4b3b-ae60-39edacd24316 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:48.928084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e716de5-4d49-46fb-8775-875ed914d9f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:48.928694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716de5-4d49-46fb-8775-875ed914d9f1 service swift] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:48.929000 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716de5-4d49-46fb-8775-875ed914d9f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:48.929270 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e716de5-4d49-46fb-8775-875ed914d9f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:48.938787 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e716de5-4d49-46fb-8775-875ed914d9f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:48.940621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e716de5-4d49-46fb-8775-875ed914d9f1 service swift] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:48.948621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1260/2564] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:16:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 14:16:48.951046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a86e3e37-dc8f-4110-8fb3-9a8f4a4e3599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83733e2762fe49fdb1150ad3d7b4f4f8', 'request_id': 'req-a86e3e37-dc8f-4110-8fb3-9a8f4a4e3599'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:48.958535 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a86e3e37-dc8f-4110-8fb3-9a8f4a4e3599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83733e2762fe49fdb1150ad3d7b4f4f8', 'request_id': 'req-a86e3e37-dc8f-4110-8fb3-9a8f4a4e3599'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:48.970201 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a86e3e37-dc8f-4110-8fb3-9a8f4a4e3599 admin admin] The token cache is being invalidate because project 83733e2762fe49fdb1150ad3d7b4f4f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:16:48.970500 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a86e3e37-dc8f-4110-8fb3-9a8f4a4e3599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:48.971152 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a86e3e37-dc8f-4110-8fb3-9a8f4a4e3599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:48.972701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1305/2565] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:16:48 2022] DELETE /identity/v3/projects/83733e2762fe49fdb1150ad3d7b4f4f8 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:48.980002 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e3b39-d5b6-438d-9a8c-5d6e0e7a7eaf None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:48.980288 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e3b39-d5b6-438d-9a8c-5d6e0e7a7eaf None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:48.980557 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e3b39-d5b6-438d-9a8c-5d6e0e7a7eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:49.001905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-cc9e3b39-d5b6-438d-9a8c-5d6e0e7a7eaf None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:49.003151 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-cc9e3b39-d5b6-438d-9a8c-5d6e0e7a7eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:49.030249 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:49.064775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1261/2566] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:49.073488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d253b-df86-40b7-9bf0-395831d42c64 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:49.073785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d253b-df86-40b7-9bf0-395831d42c64 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:49.074067 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d253b-df86-40b7-9bf0-395831d42c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:49.094344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1e7d253b-df86-40b7-9bf0-395831d42c64 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:49.095550 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1e7d253b-df86-40b7-9bf0-395831d42c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:49.103440 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1306/2567] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:16:49.108299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e3b39-d5b6-438d-9a8c-5d6e0e7a7eaf None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:49.118069 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e3b39-d5b6-438d-9a8c-5d6e0e7a7eaf None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:49.122672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59abad-7b02-4d0a-842b-34aba6a201ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:49.123266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59abad-7b02-4d0a-842b-34aba6a201ee admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:49.123544 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59abad-7b02-4d0a-842b-34aba6a201ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:49.123814 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59abad-7b02-4d0a-842b-34aba6a201ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:49.124575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59abad-7b02-4d0a-842b-34aba6a201ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:16:49.124925 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59abad-7b02-4d0a-842b-34aba6a201ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:49.126505 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59abad-7b02-4d0a-842b-34aba6a201ee admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:49.142665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1262/2568] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:16:49.143673 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d253b-df86-40b7-9bf0-395831d42c64 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:49.154627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d253b-df86-40b7-9bf0-395831d42c64 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:49.159680 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adf7aa-c354-41cb-ad49-e46be4c33966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:49.160411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adf7aa-c354-41cb-ad49-e46be4c33966 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:49.160930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adf7aa-c354-41cb-ad49-e46be4c33966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:49.161213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adf7aa-c354-41cb-ad49-e46be4c33966 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:49.161856 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41adf7aa-c354-41cb-ad49-e46be4c33966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:49.163853 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41adf7aa-c354-41cb-ad49-e46be4c33966 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:49.321061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1307/2569] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:16:49 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:49.325294 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59abad-7b02-4d0a-842b-34aba6a201ee admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:49.336081 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59abad-7b02-4d0a-842b-34aba6a201ee admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:49.394186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4b4a6-2ef4-4992-87bc-2ee166a02d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:49.394832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b4a6-2ef4-4992-87bc-2ee166a02d77 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:49.395107 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b4a6-2ef4-4992-87bc-2ee166a02d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:49.395423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b4a6-2ef4-4992-87bc-2ee166a02d77 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:49.396092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4b4a6-2ef4-4992-87bc-2ee166a02d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:49.398285 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4b4a6-2ef4-4992-87bc-2ee166a02d77 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:49.515182 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1263/2570] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:16:49 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:16:49.519612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adf7aa-c354-41cb-ad49-e46be4c33966 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:49.530413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adf7aa-c354-41cb-ad49-e46be4c33966 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:49.535079 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850db1ce-f7ec-4726-84fc-9d5eebec0066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:49.535683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850db1ce-f7ec-4726-84fc-9d5eebec0066 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:49.536003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850db1ce-f7ec-4726-84fc-9d5eebec0066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:49.536282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850db1ce-f7ec-4726-84fc-9d5eebec0066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:49.536928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850db1ce-f7ec-4726-84fc-9d5eebec0066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:49.538558 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850db1ce-f7ec-4726-84fc-9d5eebec0066 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:49.549071 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1308/2571] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:49.553043 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4b4a6-2ef4-4992-87bc-2ee166a02d77 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:49.563175 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4b4a6-2ef4-4992-87bc-2ee166a02d77 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:49.567775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba70ca5-399b-41ca-9731-a2d61ea5f3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:49.568406 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba70ca5-399b-41ca-9731-a2d61ea5f3ac admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:49.568688 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba70ca5-399b-41ca-9731-a2d61ea5f3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:49.568958 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba70ca5-399b-41ca-9731-a2d61ea5f3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:49.569667 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba70ca5-399b-41ca-9731-a2d61ea5f3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:49.571439 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba70ca5-399b-41ca-9731-a2d61ea5f3ac admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:49.582329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1264/2572] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:16:49.586464 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850db1ce-f7ec-4726-84fc-9d5eebec0066 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:49.597339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850db1ce-f7ec-4726-84fc-9d5eebec0066 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:49.602039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bd5ee-4b96-4e88-8865-b6c0615e83e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:49.602694 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bd5ee-4b96-4e88-8865-b6c0615e83e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:49.602979 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bd5ee-4b96-4e88-8865-b6c0615e83e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:49.603261 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bd5ee-4b96-4e88-8865-b6c0615e83e3 admin admin] PATH_INFO: `/v3/projects/b12556b6e12c445db7ae781f80468baf/users/28a75b9243d74efe9c0b67cf0c274c19/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:49.623858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bd5ee-4b96-4e88-8865-b6c0615e83e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12556b6e12c445db7ae781f80468baf, user_id=28a75b9243d74efe9c0b67cf0c274c19, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:49.626608 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bd5ee-4b96-4e88-8865-b6c0615e83e3 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:49.745396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1309/2573] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:16:49 2022] PUT /identity/v3/projects/b12556b6e12c445db7ae781f80468baf/users/28a75b9243d74efe9c0b67cf0c274c19/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:49.758442 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09559d03-2efa-4b4f-97e0-fc7ffdb53292 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:49.759017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09559d03-2efa-4b4f-97e0-fc7ffdb53292 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:49.759017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09559d03-2efa-4b4f-97e0-fc7ffdb53292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:49.786965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-09559d03-2efa-4b4f-97e0-fc7ffdb53292 None None] MFA Rules not processed for user `28a75b9243d74efe9c0b67cf0c274c19`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:16:49.788206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-09559d03-2efa-4b4f-97e0-fc7ffdb53292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:49.854665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1265/2574] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:16:49.865471 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bd5ee-4b96-4e88-8865-b6c0615e83e3 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:49.867171 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f79bd5ee-4b96-4e88-8865-b6c0615e83e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:49.927358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bd5ee-4b96-4e88-8865-b6c0615e83e3 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:49.931063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe7e2b-1ade-432a-abe8-984d6ca09430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:49.931707 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe7e2b-1ade-432a-abe8-984d6ca09430 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:49.932128 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe7e2b-1ade-432a-abe8-984d6ca09430 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:49.932494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe7e2b-1ade-432a-abe8-984d6ca09430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:49.941843 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe7e2b-1ade-432a-abe8-984d6ca09430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:49.943288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe7e2b-1ade-432a-abe8-984d6ca09430 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:49.953236 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1310/2575] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:58.698899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09559d03-2efa-4b4f-97e0-fc7ffdb53292 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:58.700398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-09559d03-2efa-4b4f-97e0-fc7ffdb53292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:58.731625 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:58.773564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09559d03-2efa-4b4f-97e0-fc7ffdb53292 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:58.778480 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf0067-6c94-4b3b-87dc-12151d910805 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec4f437077c41039cae3d505b43b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:58.779100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf0067-6c94-4b3b-87dc-12151d910805 service placement] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:58.779384 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf0067-6c94-4b3b-87dc-12151d910805 service placement] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:58.779659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf0067-6c94-4b3b-87dc-12151d910805 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:58.781475 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-babf0067-6c94-4b3b-87dc-12151d910805 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:58.793337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf0067-6c94-4b3b-87dc-12151d910805 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:58.794913 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf0067-6c94-4b3b-87dc-12151d910805 service placement] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:58.804619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1266/2576] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:16:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:16:58.861796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe7e2b-1ade-432a-abe8-984d6ca09430 service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:58.863254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-74fe7e2b-1ade-432a-abe8-984d6ca09430 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:16:58.899198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:58.934425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe7e2b-1ade-432a-abe8-984d6ca09430 service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:58.942600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424e3e7-f340-4d08-827e-61a77bd26460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:58.948058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424e3e7-f340-4d08-827e-61a77bd26460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:58.948058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424e3e7-f340-4d08-827e-61a77bd26460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:58.948058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424e3e7-f340-4d08-827e-61a77bd26460 admin admin] PATH_INFO: `/v3/users/9ca820c9c8634a958981e2e66d0673d3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:58.948058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424e3e7-f340-4d08-827e-61a77bd26460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca820c9c8634a958981e2e66d0673d3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:58.948058 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424e3e7-f340-4d08-827e-61a77bd26460 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:16:59.173468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-b424e3e7-f340-4d08-827e-61a77bd26460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca820c9c8634a958981e2e66d0673d3'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:59.185224 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-b424e3e7-f340-4d08-827e-61a77bd26460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca820c9c8634a958981e2e66d0673d3'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:59.387635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-b424e3e7-f340-4d08-827e-61a77bd26460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca820c9c8634a958981e2e66d0673d3'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:59.396004 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-b424e3e7-f340-4d08-827e-61a77bd26460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca820c9c8634a958981e2e66d0673d3'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:59.396471 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-b424e3e7-f340-4d08-827e-61a77bd26460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca820c9c8634a958981e2e66d0673d3'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:16:59.403405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1311/2577] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:16:58 2022] DELETE /identity/v3/users/9ca820c9c8634a958981e2e66d0673d3 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:16:59.768829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf0067-6c94-4b3b-87dc-12151d910805 service placement] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:16:59.785429 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf0067-6c94-4b3b-87dc-12151d910805 service placement] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:16:59.856766 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568c016-5cd0-4a27-bd50-4677fc7dafcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:16:59.857406 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568c016-5cd0-4a27-bd50-4677fc7dafcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:16:59.857686 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568c016-5cd0-4a27-bd50-4677fc7dafcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:16:59.857959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568c016-5cd0-4a27-bd50-4677fc7dafcb admin admin] PATH_INFO: `/v3/projects/66ec11cfcbf04923a3b109e45e645ab3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:16:59.859088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568c016-5cd0-4a27-bd50-4677fc7dafcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ec11cfcbf04923a3b109e45e645ab3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:16:59.861225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568c016-5cd0-4a27-bd50-4677fc7dafcb admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:00.026665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2568c016-5cd0-4a27-bd50-4677fc7dafcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ec11cfcbf04923a3b109e45e645ab3', 'request_id': 'req-2568c016-5cd0-4a27-bd50-4677fc7dafcb'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:00.033197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2568c016-5cd0-4a27-bd50-4677fc7dafcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ec11cfcbf04923a3b109e45e645ab3', 'request_id': 'req-2568c016-5cd0-4a27-bd50-4677fc7dafcb'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:00.136893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2568c016-5cd0-4a27-bd50-4677fc7dafcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ec11cfcbf04923a3b109e45e645ab3', 'request_id': 'req-2568c016-5cd0-4a27-bd50-4677fc7dafcb'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:00.150630 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2568c016-5cd0-4a27-bd50-4677fc7dafcb admin admin] The token cache is being invalidate because project 66ec11cfcbf04923a3b109e45e645ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:00.151076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2568c016-5cd0-4a27-bd50-4677fc7dafcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:00.151909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-2568c016-5cd0-4a27-bd50-4677fc7dafcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:00.153869 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1267/2578] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:16:59 2022] DELETE /identity/v3/projects/66ec11cfcbf04923a3b109e45e645ab3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:00.157875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424e3e7-f340-4d08-827e-61a77bd26460 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:00.159850 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b424e3e7-f340-4d08-827e-61a77bd26460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:00.174435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424e3e7-f340-4d08-827e-61a77bd26460 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:00.238287 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc1735-37dd-4553-914d-b07967ab0f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:00.238919 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc1735-37dd-4553-914d-b07967ab0f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:00.239200 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc1735-37dd-4553-914d-b07967ab0f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:00.244467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc1735-37dd-4553-914d-b07967ab0f91 admin admin] PATH_INFO: `/v3/users/8c51252fb49a4d29a586596aeeeb668c` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:00.244467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc1735-37dd-4553-914d-b07967ab0f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c51252fb49a4d29a586596aeeeb668c)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:00.244467 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc1735-37dd-4553-914d-b07967ab0f91 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:00.568723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f0cc1735-37dd-4553-914d-b07967ab0f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c51252fb49a4d29a586596aeeeb668c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:00.570608 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:00.581996 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f0cc1735-37dd-4553-914d-b07967ab0f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c51252fb49a4d29a586596aeeeb668c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:00.714347 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f0cc1735-37dd-4553-914d-b07967ab0f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c51252fb49a4d29a586596aeeeb668c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:00.723931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f0cc1735-37dd-4553-914d-b07967ab0f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c51252fb49a4d29a586596aeeeb668c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:00.724791 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f0cc1735-37dd-4553-914d-b07967ab0f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c51252fb49a4d29a586596aeeeb668c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:00.732475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1312/2579] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:17:00 2022] DELETE /identity/v3/users/8c51252fb49a4d29a586596aeeeb668c => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:01.029415 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568c016-5cd0-4a27-bd50-4677fc7dafcb admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:01.031236 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2568c016-5cd0-4a27-bd50-4677fc7dafcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:01.054963 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568c016-5cd0-4a27-bd50-4677fc7dafcb admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:01.106989 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:01.121641 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c745d-469f-4195-8379-423eb7dc3cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:01.122292 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c745d-469f-4195-8379-423eb7dc3cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:01.122569 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c745d-469f-4195-8379-423eb7dc3cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:01.122842 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c745d-469f-4195-8379-423eb7dc3cbb admin admin] PATH_INFO: `/v3/projects/55f0edd6f5664c9ead4abc22949dd34c` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:01.123992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c745d-469f-4195-8379-423eb7dc3cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f0edd6f5664c9ead4abc22949dd34c)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:01.125910 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c745d-469f-4195-8379-423eb7dc3cbb admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:01.274684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ac8c745d-469f-4195-8379-423eb7dc3cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f0edd6f5664c9ead4abc22949dd34c', 'request_id': 'req-ac8c745d-469f-4195-8379-423eb7dc3cbb'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:01.281071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ac8c745d-469f-4195-8379-423eb7dc3cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f0edd6f5664c9ead4abc22949dd34c', 'request_id': 'req-ac8c745d-469f-4195-8379-423eb7dc3cbb'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:01.395024 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ac8c745d-469f-4195-8379-423eb7dc3cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f0edd6f5664c9ead4abc22949dd34c', 'request_id': 'req-ac8c745d-469f-4195-8379-423eb7dc3cbb'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:01.408786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ac8c745d-469f-4195-8379-423eb7dc3cbb admin admin] The token cache is being invalidate because project 55f0edd6f5664c9ead4abc22949dd34c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:01.408786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ac8c745d-469f-4195-8379-423eb7dc3cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:01.411301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ac8c745d-469f-4195-8379-423eb7dc3cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:01.411301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1268/2580] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:17:01 2022] DELETE /identity/v3/projects/55f0edd6f5664c9ead4abc22949dd34c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:05.395455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc1735-37dd-4553-914d-b07967ab0f91 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:05.395455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f0cc1735-37dd-4553-914d-b07967ab0f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:05.475691 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc1735-37dd-4553-914d-b07967ab0f91 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:05.543995 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbc072-fc96-4145-b11a-a9b9211d0dd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:05.544625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbc072-fc96-4145-b11a-a9b9211d0dd7 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:05.544929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbc072-fc96-4145-b11a-a9b9211d0dd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:05.545189 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbc072-fc96-4145-b11a-a9b9211d0dd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:05.546961 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6ffbc072-fc96-4145-b11a-a9b9211d0dd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:05.611346 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:05.627565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbc072-fc96-4145-b11a-a9b9211d0dd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:05.630097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbc072-fc96-4145-b11a-a9b9211d0dd7 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:05.647932 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1313/2581] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:05.808289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c745d-469f-4195-8379-423eb7dc3cbb admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:05.812296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ac8c745d-469f-4195-8379-423eb7dc3cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:05.876905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c745d-469f-4195-8379-423eb7dc3cbb admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:05.881525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff983b45-0040-4249-9c51-48a6487ab719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:05.882167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff983b45-0040-4249-9c51-48a6487ab719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:05.882446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff983b45-0040-4249-9c51-48a6487ab719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:05.882725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff983b45-0040-4249-9c51-48a6487ab719 admin admin] PATH_INFO: `/v3/users/28a75b9243d74efe9c0b67cf0c274c19` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:05.883934 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff983b45-0040-4249-9c51-48a6487ab719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a75b9243d74efe9c0b67cf0c274c19)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:05.886418 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff983b45-0040-4249-9c51-48a6487ab719 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:06.132899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ff983b45-0040-4249-9c51-48a6487ab719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a75b9243d74efe9c0b67cf0c274c19'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:06.133587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ff983b45-0040-4249-9c51-48a6487ab719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a75b9243d74efe9c0b67cf0c274c19'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:06.147029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ff983b45-0040-4249-9c51-48a6487ab719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a75b9243d74efe9c0b67cf0c274c19'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:06.256305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ff983b45-0040-4249-9c51-48a6487ab719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a75b9243d74efe9c0b67cf0c274c19'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:06.257087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ff983b45-0040-4249-9c51-48a6487ab719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a75b9243d74efe9c0b67cf0c274c19'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:06.261988 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:06.270470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1269/2582] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:17:05 2022] DELETE /identity/v3/users/28a75b9243d74efe9c0b67cf0c274c19 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:06.274933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc6171-1bdd-4f61-a685-72811a6641f3 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:06.275250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc6171-1bdd-4f61-a685-72811a6641f3 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:06.275543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc6171-1bdd-4f61-a685-72811a6641f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:06.294879 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-a3cc6171-1bdd-4f61-a685-72811a6641f3 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:06.296125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a3cc6171-1bdd-4f61-a685-72811a6641f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:06.355853 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1314/2583] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:06.365750 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff983b45-0040-4249-9c51-48a6487ab719 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:06.367316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ff983b45-0040-4249-9c51-48a6487ab719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:06.432972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff983b45-0040-4249-9c51-48a6487ab719 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:06.438024 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546156c-e875-41bb-aafa-3e634c241dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:06.439245 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546156c-e875-41bb-aafa-3e634c241dce service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:06.439661 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546156c-e875-41bb-aafa-3e634c241dce service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:06.439974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546156c-e875-41bb-aafa-3e634c241dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:06.451946 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546156c-e875-41bb-aafa-3e634c241dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:06.453096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546156c-e875-41bb-aafa-3e634c241dce service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:06.464819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1270/2584] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:06.956908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc6171-1bdd-4f61-a685-72811a6641f3 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:06.958345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a3cc6171-1bdd-4f61-a685-72811a6641f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:06.971005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc6171-1bdd-4f61-a685-72811a6641f3 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:06.975660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b4b88-1eaf-49c4-a5d8-ecef09a65b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:06.976273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b4b88-1eaf-49c4-a5d8-ecef09a65b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:06.976554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b4b88-1eaf-49c4-a5d8-ecef09a65b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:06.976826 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b4b88-1eaf-49c4-a5d8-ecef09a65b00 admin admin] PATH_INFO: `/v3/projects/b12556b6e12c445db7ae781f80468baf` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:06.977993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b4b88-1eaf-49c4-a5d8-ecef09a65b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b12556b6e12c445db7ae781f80468baf)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:06.979951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b4b88-1eaf-49c4-a5d8-ecef09a65b00 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:07.125613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-245b4b88-1eaf-49c4-a5d8-ecef09a65b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12556b6e12c445db7ae781f80468baf', 'request_id': 'req-245b4b88-1eaf-49c4-a5d8-ecef09a65b00'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:07.193453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-245b4b88-1eaf-49c4-a5d8-ecef09a65b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12556b6e12c445db7ae781f80468baf', 'request_id': 'req-245b4b88-1eaf-49c4-a5d8-ecef09a65b00'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:07.202888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-245b4b88-1eaf-49c4-a5d8-ecef09a65b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12556b6e12c445db7ae781f80468baf', 'request_id': 'req-245b4b88-1eaf-49c4-a5d8-ecef09a65b00'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:07.216489 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-245b4b88-1eaf-49c4-a5d8-ecef09a65b00 admin admin] The token cache is being invalidate because project b12556b6e12c445db7ae781f80468baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:07.216792 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-245b4b88-1eaf-49c4-a5d8-ecef09a65b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:07.217601 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-245b4b88-1eaf-49c4-a5d8-ecef09a65b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:07.219189 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1315/2585] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:17:06 2022] DELETE /identity/v3/projects/b12556b6e12c445db7ae781f80468baf => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:07.224337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa0378-e2ef-4977-be86-9e5876946001 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:07.224858 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa0378-e2ef-4977-be86-9e5876946001 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:07.225183 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa0378-e2ef-4977-be86-9e5876946001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:07.247309 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-0eaa0378-e2ef-4977-be86-9e5876946001 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:07.248617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-0eaa0378-e2ef-4977-be86-9e5876946001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:07.309160 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1271/2586] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:07.317091 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec4217-c376-4c7e-9964-8f497d1749d5 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:07.317385 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec4217-c376-4c7e-9964-8f497d1749d5 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:07.317667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec4217-c376-4c7e-9964-8f497d1749d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:07.339033 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-5dec4217-c376-4c7e-9964-8f497d1749d5 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:07.340285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-5dec4217-c376-4c7e-9964-8f497d1749d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:07.348266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1316/2587] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:07.352756 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa0378-e2ef-4977-be86-9e5876946001 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:07.362503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa0378-e2ef-4977-be86-9e5876946001 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:07.367590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eef0c3-f269-414a-9f3b-2f1d12a58392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:07.368247 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eef0c3-f269-414a-9f3b-2f1d12a58392 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:07.368998 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eef0c3-f269-414a-9f3b-2f1d12a58392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:07.369265 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eef0c3-f269-414a-9f3b-2f1d12a58392 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:07.369893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eef0c3-f269-414a-9f3b-2f1d12a58392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:17:07.370193 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eef0c3-f269-414a-9f3b-2f1d12a58392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:07.371773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eef0c3-f269-414a-9f3b-2f1d12a58392 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:07.383425 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1272/2588] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:17:07.388701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec4217-c376-4c7e-9964-8f497d1749d5 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:07.397998 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec4217-c376-4c7e-9964-8f497d1749d5 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:07.402804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadef80-0a76-4ef8-962d-2d3cb06d6307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:07.404536 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadef80-0a76-4ef8-962d-2d3cb06d6307 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:07.404536 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadef80-0a76-4ef8-962d-2d3cb06d6307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:07.404536 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadef80-0a76-4ef8-962d-2d3cb06d6307 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:07.404830 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadef80-0a76-4ef8-962d-2d3cb06d6307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:07.406561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadef80-0a76-4ef8-962d-2d3cb06d6307 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:07.490393 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1317/2589] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:17:07 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:07.497391 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eef0c3-f269-414a-9f3b-2f1d12a58392 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:07.507849 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eef0c3-f269-414a-9f3b-2f1d12a58392 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:07.571969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c04a4-efa4-4ed2-8123-24cbad6d9666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:07.572607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c04a4-efa4-4ed2-8123-24cbad6d9666 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:07.572890 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c04a4-efa4-4ed2-8123-24cbad6d9666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:07.573160 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c04a4-efa4-4ed2-8123-24cbad6d9666 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:07.573794 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c04a4-efa4-4ed2-8123-24cbad6d9666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:07.575743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c04a4-efa4-4ed2-8123-24cbad6d9666 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:07.673698 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1273/2590] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:17:07 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:17:07.678471 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadef80-0a76-4ef8-962d-2d3cb06d6307 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:07.689690 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadef80-0a76-4ef8-962d-2d3cb06d6307 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:07.694438 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30fe6e-049c-4af7-a5e7-5afc478d6e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:07.695036 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30fe6e-049c-4af7-a5e7-5afc478d6e85 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:07.695319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30fe6e-049c-4af7-a5e7-5afc478d6e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:07.695679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30fe6e-049c-4af7-a5e7-5afc478d6e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:07.696323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30fe6e-049c-4af7-a5e7-5afc478d6e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:07.698007 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30fe6e-049c-4af7-a5e7-5afc478d6e85 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:07.708795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1318/2591] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:07.715398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c04a4-efa4-4ed2-8123-24cbad6d9666 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:07.725543 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c04a4-efa4-4ed2-8123-24cbad6d9666 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:07.730988 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3b229-3939-4cb3-a2bb-848993928288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:07.731575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3b229-3939-4cb3-a2bb-848993928288 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:07.731853 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3b229-3939-4cb3-a2bb-848993928288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:07.732149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3b229-3939-4cb3-a2bb-848993928288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:07.732781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3b229-3939-4cb3-a2bb-848993928288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:07.734407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3b229-3939-4cb3-a2bb-848993928288 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:07.745610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1274/2592] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:07.750671 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30fe6e-049c-4af7-a5e7-5afc478d6e85 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:07.761616 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30fe6e-049c-4af7-a5e7-5afc478d6e85 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:07.766675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b20b3-4a65-4ca0-b3f7-e3b5fd38f0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:07.767336 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b20b3-4a65-4ca0-b3f7-e3b5fd38f0c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:07.767623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b20b3-4a65-4ca0-b3f7-e3b5fd38f0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:07.767935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b20b3-4a65-4ca0-b3f7-e3b5fd38f0c6 admin admin] PATH_INFO: `/v3/projects/9088bbf5d43c4e25a470455563fede6c/users/9cec9fa4375e48498e11c53f7faa540b/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:07.783518 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b20b3-4a65-4ca0-b3f7-e3b5fd38f0c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9088bbf5d43c4e25a470455563fede6c, user_id=9cec9fa4375e48498e11c53f7faa540b, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:07.786223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b20b3-4a65-4ca0-b3f7-e3b5fd38f0c6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:07.788459 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:07.935016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1319/2593] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:07 2022] PUT /identity/v3/projects/9088bbf5d43c4e25a470455563fede6c/users/9cec9fa4375e48498e11c53f7faa540b/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:07.945316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5f3c1-a181-4fa5-a3c3-546a1da2a32c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:07.947421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5f3c1-a181-4fa5-a3c3-546a1da2a32c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:07.947421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5f3c1-a181-4fa5-a3c3-546a1da2a32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:07.953849 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:07.974656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-94a5f3c1-a181-4fa5-a3c3-546a1da2a32c None None] MFA Rules not processed for user `9cec9fa4375e48498e11c53f7faa540b`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:07.975933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-94a5f3c1-a181-4fa5-a3c3-546a1da2a32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:08.039203 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1275/2594] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:17:08.050030 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b20b3-4a65-4ca0-b3f7-e3b5fd38f0c6 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:08.051819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-469b20b3-4a65-4ca0-b3f7-e3b5fd38f0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:08.109603 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b20b3-4a65-4ca0-b3f7-e3b5fd38f0c6 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:08.113307 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1132e19-e930-4d1b-858f-27217dcc3255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:08.113913 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1132e19-e930-4d1b-858f-27217dcc3255 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:08.114198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1132e19-e930-4d1b-858f-27217dcc3255 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:08.114474 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1132e19-e930-4d1b-858f-27217dcc3255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:08.123050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1132e19-e930-4d1b-858f-27217dcc3255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:08.124525 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1132e19-e930-4d1b-858f-27217dcc3255 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:08.133443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1320/2595] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:11.264190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb6132-e242-4d47-b52e-4d89ad56c6a3 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:11.264743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb6132-e242-4d47-b52e-4d89ad56c6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:11.264743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb6132-e242-4d47-b52e-4d89ad56c6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:11.284110 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6adb6132-e242-4d47-b52e-4d89ad56c6a3 None None] MFA Rules not processed for user `9cec9fa4375e48498e11c53f7faa540b`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:11.285394 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6adb6132-e242-4d47-b52e-4d89ad56c6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:11.297773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1276/2596] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:11.374510 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1132e19-e930-4d1b-858f-27217dcc3255 service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:11.376661 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e1132e19-e930-4d1b-858f-27217dcc3255 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:11.437273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1132e19-e930-4d1b-858f-27217dcc3255 service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:11.440996 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760ee60-49dc-45ef-b48a-a002353e3107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:11.441603 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760ee60-49dc-45ef-b48a-a002353e3107 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:11.441989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760ee60-49dc-45ef-b48a-a002353e3107 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:11.442279 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760ee60-49dc-45ef-b48a-a002353e3107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:11.444165 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d760ee60-49dc-45ef-b48a-a002353e3107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:11.508407 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760ee60-49dc-45ef-b48a-a002353e3107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:11.509871 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760ee60-49dc-45ef-b48a-a002353e3107 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:11.519706 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1321/2597] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:15.629893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb6132-e242-4d47-b52e-4d89ad56c6a3 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:15.631477 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6adb6132-e242-4d47-b52e-4d89ad56c6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:15.652533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb6132-e242-4d47-b52e-4d89ad56c6a3 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:15.657814 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896577b5-cd38-4415-b8c5-6f73e564ecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:15.658482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896577b5-cd38-4415-b8c5-6f73e564ecc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:15.658765 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896577b5-cd38-4415-b8c5-6f73e564ecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:15.659046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896577b5-cd38-4415-b8c5-6f73e564ecc8 admin admin] PATH_INFO: `/v3/users/9b6dee114b0b4db3ac98075847d613c5` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:15.660202 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896577b5-cd38-4415-b8c5-6f73e564ecc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6dee114b0b4db3ac98075847d613c5)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:15.662171 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896577b5-cd38-4415-b8c5-6f73e564ecc8 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:16.034755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-896577b5-cd38-4415-b8c5-6f73e564ecc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6dee114b0b4db3ac98075847d613c5'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:16.035405 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-896577b5-cd38-4415-b8c5-6f73e564ecc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6dee114b0b4db3ac98075847d613c5'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:16.047613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-896577b5-cd38-4415-b8c5-6f73e564ecc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6dee114b0b4db3ac98075847d613c5'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:16.136259 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-896577b5-cd38-4415-b8c5-6f73e564ecc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6dee114b0b4db3ac98075847d613c5'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:16.136984 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-896577b5-cd38-4415-b8c5-6f73e564ecc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6dee114b0b4db3ac98075847d613c5'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:16.170237 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1277/2598] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:17:15 2022] DELETE /identity/v3/users/9b6dee114b0b4db3ac98075847d613c5 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:16.361948 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760ee60-49dc-45ef-b48a-a002353e3107 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:16.363424 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d760ee60-49dc-45ef-b48a-a002353e3107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:16.375619 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760ee60-49dc-45ef-b48a-a002353e3107 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:16.425908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:16.433513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84da5f-041c-41e4-b43e-dc7867004ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:16.434488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84da5f-041c-41e4-b43e-dc7867004ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:16.435026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84da5f-041c-41e4-b43e-dc7867004ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:16.435519 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84da5f-041c-41e4-b43e-dc7867004ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:16.437665 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1a84da5f-041c-41e4-b43e-dc7867004ae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:16.451240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84da5f-041c-41e4-b43e-dc7867004ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:16.452985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84da5f-041c-41e4-b43e-dc7867004ae3 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:16.464714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1322/2599] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:16.475497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896577b5-cd38-4415-b8c5-6f73e564ecc8 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:16.477347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-896577b5-cd38-4415-b8c5-6f73e564ecc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:16.557413 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:16.561167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896577b5-cd38-4415-b8c5-6f73e564ecc8 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:16.566091 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de357d-7650-4650-9b3d-bf1c4d9e36ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:16.570120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de357d-7650-4650-9b3d-bf1c4d9e36ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:16.570120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de357d-7650-4650-9b3d-bf1c4d9e36ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:16.570120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de357d-7650-4650-9b3d-bf1c4d9e36ca admin admin] PATH_INFO: `/v3/projects/ec831d080adc4d5cabe9df5b81a81958` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:16.570120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de357d-7650-4650-9b3d-bf1c4d9e36ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec831d080adc4d5cabe9df5b81a81958)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:16.570781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de357d-7650-4650-9b3d-bf1c4d9e36ca admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:16.688450 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d0de357d-7650-4650-9b3d-bf1c4d9e36ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec831d080adc4d5cabe9df5b81a81958', 'request_id': 'req-d0de357d-7650-4650-9b3d-bf1c4d9e36ca'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:16.696091 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d0de357d-7650-4650-9b3d-bf1c4d9e36ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec831d080adc4d5cabe9df5b81a81958', 'request_id': 'req-d0de357d-7650-4650-9b3d-bf1c4d9e36ca'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:16.759432 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d0de357d-7650-4650-9b3d-bf1c4d9e36ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec831d080adc4d5cabe9df5b81a81958', 'request_id': 'req-d0de357d-7650-4650-9b3d-bf1c4d9e36ca'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:16.771149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d0de357d-7650-4650-9b3d-bf1c4d9e36ca admin admin] The token cache is being invalidate because project ec831d080adc4d5cabe9df5b81a81958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:16.771441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d0de357d-7650-4650-9b3d-bf1c4d9e36ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:16.772129 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d0de357d-7650-4650-9b3d-bf1c4d9e36ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:16.773620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1278/2600] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:17:16 2022] DELETE /identity/v3/projects/ec831d080adc4d5cabe9df5b81a81958 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:16.778671 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaff982-6c98-4639-934c-099dad5ecc5c None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:16.782522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaff982-6c98-4639-934c-099dad5ecc5c None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:16.782522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaff982-6c98-4639-934c-099dad5ecc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:16.799493 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-efaff982-6c98-4639-934c-099dad5ecc5c None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:16.800912 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-efaff982-6c98-4639-934c-099dad5ecc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:16.861303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1323/2601] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:16.869991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda9be4-fb05-4a66-bb91-8c2424712666 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:16.870303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda9be4-fb05-4a66-bb91-8c2424712666 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:16.870602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda9be4-fb05-4a66-bb91-8c2424712666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:16.891358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-6bda9be4-fb05-4a66-bb91-8c2424712666 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:16.892623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6bda9be4-fb05-4a66-bb91-8c2424712666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:16.901541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1279/2602] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:16.906223 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaff982-6c98-4639-934c-099dad5ecc5c None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:16.916927 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaff982-6c98-4639-934c-099dad5ecc5c None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:16.921964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12b8e9-802d-4221-91b2-6ecb4ddde24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:16.922794 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12b8e9-802d-4221-91b2-6ecb4ddde24f admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:16.923183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12b8e9-802d-4221-91b2-6ecb4ddde24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:16.923560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12b8e9-802d-4221-91b2-6ecb4ddde24f admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:16.924269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12b8e9-802d-4221-91b2-6ecb4ddde24f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:17:16.924602 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12b8e9-802d-4221-91b2-6ecb4ddde24f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:16.926227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12b8e9-802d-4221-91b2-6ecb4ddde24f admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:16.942529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1324/2603] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:17:16.943602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda9be4-fb05-4a66-bb91-8c2424712666 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:16.956617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda9be4-fb05-4a66-bb91-8c2424712666 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:16.961380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fd657-a64f-4acd-af3f-ac841c4ec36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:16.962031 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fd657-a64f-4acd-af3f-ac841c4ec36f admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:16.962311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fd657-a64f-4acd-af3f-ac841c4ec36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:16.962612 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fd657-a64f-4acd-af3f-ac841c4ec36f admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:16.963255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fd657-a64f-4acd-af3f-ac841c4ec36f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:16.965228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fd657-a64f-4acd-af3f-ac841c4ec36f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:17.076373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1280/2604] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:17:16 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:17:17.081801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12b8e9-802d-4221-91b2-6ecb4ddde24f admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:17.092524 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12b8e9-802d-4221-91b2-6ecb4ddde24f admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:17.157749 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650aba9-407e-4f69-8262-30290aef7960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:17.158401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650aba9-407e-4f69-8262-30290aef7960 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:17.158710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650aba9-407e-4f69-8262-30290aef7960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:17.158983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650aba9-407e-4f69-8262-30290aef7960 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:17.159762 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650aba9-407e-4f69-8262-30290aef7960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:17.161753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650aba9-407e-4f69-8262-30290aef7960 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:17.242703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1325/2605] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:17:17 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:17.247308 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fd657-a64f-4acd-af3f-ac841c4ec36f admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:17.259965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fd657-a64f-4acd-af3f-ac841c4ec36f admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:17.260997 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650aba9-407e-4f69-8262-30290aef7960 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:17.263852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-7650aba9-407e-4f69-8262-30290aef7960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:17.265008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c3199-2d82-46be-8f6c-46907c2726be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:17.265622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c3199-2d82-46be-8f6c-46907c2726be admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:17.265906 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c3199-2d82-46be-8f6c-46907c2726be admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:17.266219 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c3199-2d82-46be-8f6c-46907c2726be admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:17.266871 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c3199-2d82-46be-8f6c-46907c2726be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:17.268519 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c3199-2d82-46be-8f6c-46907c2726be admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:17.280438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1281/2606] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:17.284162 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c3199-2d82-46be-8f6c-46907c2726be admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:17.295239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c3199-2d82-46be-8f6c-46907c2726be admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:17.301556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea0bb1-23f1-4277-9ef5-04c6b40ab278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:17.302180 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea0bb1-23f1-4277-9ef5-04c6b40ab278 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:17.302468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea0bb1-23f1-4277-9ef5-04c6b40ab278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:17.302753 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea0bb1-23f1-4277-9ef5-04c6b40ab278 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:17.303399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea0bb1-23f1-4277-9ef5-04c6b40ab278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:17.305103 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea0bb1-23f1-4277-9ef5-04c6b40ab278 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:17.319073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1282/2607] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:17:17.320287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea0bb1-23f1-4277-9ef5-04c6b40ab278 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:17.331505 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea0bb1-23f1-4277-9ef5-04c6b40ab278 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:17.336926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad84a08-7d03-41ad-a00d-75af87ba03dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:17.337232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad84a08-7d03-41ad-a00d-75af87ba03dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:17.337515 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad84a08-7d03-41ad-a00d-75af87ba03dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:17.337786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad84a08-7d03-41ad-a00d-75af87ba03dc admin admin] PATH_INFO: `/v3/projects/939a6c4d2d784e8fb30ca1e0f3df538a/users/c2625253fd424419bf9693379fa93dd6/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:17.346539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650aba9-407e-4f69-8262-30290aef7960 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:17.352343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05b4bf-2dbb-4db5-9883-17c2e1193d36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:17.353555 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05b4bf-2dbb-4db5-9883-17c2e1193d36 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:17.353947 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05b4bf-2dbb-4db5-9883-17c2e1193d36 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:17.354255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05b4bf-2dbb-4db5-9883-17c2e1193d36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:17.355068 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad84a08-7d03-41ad-a00d-75af87ba03dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=939a6c4d2d784e8fb30ca1e0f3df538a, user_id=c2625253fd424419bf9693379fa93dd6, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:17.356107 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-5b05b4bf-2dbb-4db5-9883-17c2e1193d36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:17.358075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad84a08-7d03-41ad-a00d-75af87ba03dc admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:17.369353 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05b4bf-2dbb-4db5-9883-17c2e1193d36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:17.371011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05b4bf-2dbb-4db5-9883-17c2e1193d36 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:17.382069 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1326/2608] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:17.473828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1283/2609] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:17 2022] PUT /identity/v3/projects/939a6c4d2d784e8fb30ca1e0f3df538a/users/c2625253fd424419bf9693379fa93dd6/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:17.484284 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ba56a-2203-4b7e-8e71-9dbf6fd14fc2 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:17.484573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ba56a-2203-4b7e-8e71-9dbf6fd14fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:17.484971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ba56a-2203-4b7e-8e71-9dbf6fd14fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:17.514629 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-793ba56a-2203-4b7e-8e71-9dbf6fd14fc2 None None] MFA Rules not processed for user `c2625253fd424419bf9693379fa93dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:17.515860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-793ba56a-2203-4b7e-8e71-9dbf6fd14fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:17.585376 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1327/2610] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:17.590699 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad84a08-7d03-41ad-a00d-75af87ba03dc admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:17.671665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad84a08-7d03-41ad-a00d-75af87ba03dc admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:17.676995 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82bb1a-010b-4876-bc0c-1301a9addb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:17.677621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82bb1a-010b-4876-bc0c-1301a9addb8e admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:17.677905 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82bb1a-010b-4876-bc0c-1301a9addb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:17.678181 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82bb1a-010b-4876-bc0c-1301a9addb8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:17.678873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82bb1a-010b-4876-bc0c-1301a9addb8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:17.681383 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82bb1a-010b-4876-bc0c-1301a9addb8e admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:17.852886 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1284/2611] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:17:17 2022] POST /identity/v3/projects => generated 379 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:17.854052 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ba56a-2203-4b7e-8e71-9dbf6fd14fc2 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:17.865920 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ba56a-2203-4b7e-8e71-9dbf6fd14fc2 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:17.872611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:17.929661 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d41e7-9e69-4c82-8b0b-989b05a3de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:17.930269 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d41e7-9e69-4c82-8b0b-989b05a3de92 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:17.931263 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d41e7-9e69-4c82-8b0b-989b05a3de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:17.931534 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d41e7-9e69-4c82-8b0b-989b05a3de92 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:17.932211 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d41e7-9e69-4c82-8b0b-989b05a3de92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:17.934094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d41e7-9e69-4c82-8b0b-989b05a3de92 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:18.090657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1328/2612] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:17:17 2022] POST /identity/v3/users => generated 296 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:17:18.094704 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82bb1a-010b-4876-bc0c-1301a9addb8e admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:18.104963 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82bb1a-010b-4876-bc0c-1301a9addb8e admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:18.109325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdd7f4-f343-4ad2-b5ae-0953fad10a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:18.109917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdd7f4-f343-4ad2-b5ae-0953fad10a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:18.110194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdd7f4-f343-4ad2-b5ae-0953fad10a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:18.110467 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdd7f4-f343-4ad2-b5ae-0953fad10a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:18.111214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdd7f4-f343-4ad2-b5ae-0953fad10a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:18.112884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdd7f4-f343-4ad2-b5ae-0953fad10a28 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:18.123791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1285/2613] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:18.128125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d41e7-9e69-4c82-8b0b-989b05a3de92 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:18.138779 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d41e7-9e69-4c82-8b0b-989b05a3de92 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:18.143389 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd1e86-b379-4e99-90a0-e8ff13da8f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:18.144130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd1e86-b379-4e99-90a0-e8ff13da8f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:18.144418 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd1e86-b379-4e99-90a0-e8ff13da8f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:18.144712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd1e86-b379-4e99-90a0-e8ff13da8f7e admin admin] PATH_INFO: `/v3/projects/ed3c030a8e99484badb166ae2abd6333/users/83a5a490601e453b86b0af7709eb4232/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:18.160256 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd1e86-b379-4e99-90a0-e8ff13da8f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3c030a8e99484badb166ae2abd6333, user_id=83a5a490601e453b86b0af7709eb4232, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:18.162930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd1e86-b379-4e99-90a0-e8ff13da8f7e admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:18.262887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1329/2614] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:18 2022] PUT /identity/v3/projects/ed3c030a8e99484badb166ae2abd6333/users/83a5a490601e453b86b0af7709eb4232/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:18.267038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdd7f4-f343-4ad2-b5ae-0953fad10a28 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:18.277692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdd7f4-f343-4ad2-b5ae-0953fad10a28 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:18.345673 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b35b73-cfc0-495c-a113-9af1405f630c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:18.346304 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b35b73-cfc0-495c-a113-9af1405f630c admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:18.346596 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b35b73-cfc0-495c-a113-9af1405f630c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:18.346873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b35b73-cfc0-495c-a113-9af1405f630c admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:18.347549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b35b73-cfc0-495c-a113-9af1405f630c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:18.349253 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b35b73-cfc0-495c-a113-9af1405f630c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:18.360225 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1286/2615] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:18.364519 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd1e86-b379-4e99-90a0-e8ff13da8f7e admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:18.375100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd1e86-b379-4e99-90a0-e8ff13da8f7e admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:18.379890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffebda-cbf9-46c6-aaea-5530bb863567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:18.381042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffebda-cbf9-46c6-aaea-5530bb863567 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:18.381042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffebda-cbf9-46c6-aaea-5530bb863567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:18.381042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffebda-cbf9-46c6-aaea-5530bb863567 admin admin] PATH_INFO: `/v3/projects/ed3c030a8e99484badb166ae2abd6333/users/83a5a490601e453b86b0af7709eb4232/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:18.383083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffebda-cbf9-46c6-aaea-5530bb863567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3c030a8e99484badb166ae2abd6333, user_id=83a5a490601e453b86b0af7709eb4232, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:18.386401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffebda-cbf9-46c6-aaea-5530bb863567 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:18.397812 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1330/2616] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:18 2022] PUT /identity/v3/projects/ed3c030a8e99484badb166ae2abd6333/users/83a5a490601e453b86b0af7709eb4232/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:18.410098 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff482a-1826-4caa-a958-1221193b4f86 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:18.410429 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff482a-1826-4caa-a958-1221193b4f86 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:18.410729 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff482a-1826-4caa-a958-1221193b4f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:18.438938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-1fff482a-1826-4caa-a958-1221193b4f86 None None] MFA Rules not processed for user `83a5a490601e453b86b0af7709eb4232`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:18.440232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1fff482a-1826-4caa-a958-1221193b4f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:18.507570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1287/2617] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:18.520820 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffebda-cbf9-46c6-aaea-5530bb863567 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:18.522507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d9ffebda-cbf9-46c6-aaea-5530bb863567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:18.581845 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffebda-cbf9-46c6-aaea-5530bb863567 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:18.585535 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041db96-a0cd-4cfd-bb06-02866b7eeeae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:18.586148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041db96-a0cd-4cfd-bb06-02866b7eeeae service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:18.586431 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041db96-a0cd-4cfd-bb06-02866b7eeeae service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:18.586705 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041db96-a0cd-4cfd-bb06-02866b7eeeae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:18.595613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041db96-a0cd-4cfd-bb06-02866b7eeeae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:18.597072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041db96-a0cd-4cfd-bb06-02866b7eeeae service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:18.606585 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1331/2618] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:18.628275 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:18.958376 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:19.874269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff482a-1826-4caa-a958-1221193b4f86 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:19.883410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff482a-1826-4caa-a958-1221193b4f86 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:19.888152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937fe95-f836-43f4-929c-c383ff2f9d90 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a5a490601e453b86b0af7709eb4232', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed3c030a8e99484badb166ae2abd6333', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:19.888765 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937fe95-f836-43f4-929c-c383ff2f9d90 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:19.889043 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937fe95-f836-43f4-929c-c383ff2f9d90 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:19.889319 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937fe95-f836-43f4-929c-c383ff2f9d90 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:19.889955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937fe95-f836-43f4-929c-c383ff2f9d90 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:17:19.890379 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937fe95-f836-43f4-929c-c383ff2f9d90 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:19.891995 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937fe95-f836-43f4-929c-c383ff2f9d90 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:19.904124 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1288/2619] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:17:19.908254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041db96-a0cd-4cfd-bb06-02866b7eeeae service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:19.918030 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041db96-a0cd-4cfd-bb06-02866b7eeeae service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:19.922941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da99bd-a578-4529-8d43-d262f47409c3 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a5a490601e453b86b0af7709eb4232', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed3c030a8e99484badb166ae2abd6333', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:19.925566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da99bd-a578-4529-8d43-d262f47409c3 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:19.925566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da99bd-a578-4529-8d43-d262f47409c3 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:19.925566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da99bd-a578-4529-8d43-d262f47409c3 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:19.925566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da99bd-a578-4529-8d43-d262f47409c3 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:19.926775 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da99bd-a578-4529-8d43-d262f47409c3 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:20.076202 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1332/2620] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:17:19 2022] POST /identity/v3/projects => generated 353 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:20.080542 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937fe95-f836-43f4-929c-c383ff2f9d90 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:20.091590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937fe95-f836-43f4-929c-c383ff2f9d90 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:20.142989 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:20.151123 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2f217-ee6b-4602-b863-e559d243fe00 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a5a490601e453b86b0af7709eb4232', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed3c030a8e99484badb166ae2abd6333', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:20.151954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2f217-ee6b-4602-b863-e559d243fe00 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:20.152247 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2f217-ee6b-4602-b863-e559d243fe00 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:20.152595 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2f217-ee6b-4602-b863-e559d243fe00 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:20.153321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2f217-ee6b-4602-b863-e559d243fe00 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:17:20.153715 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2f217-ee6b-4602-b863-e559d243fe00 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:20.155503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2f217-ee6b-4602-b863-e559d243fe00 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:20.170414 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1289/2621] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:17:20.207503 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da99bd-a578-4529-8d43-d262f47409c3 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:20.219004 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da99bd-a578-4529-8d43-d262f47409c3 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:20.223179 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56b998-8d73-487b-ad32-303c8fe1b20c tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83a5a490601e453b86b0af7709eb4232', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed3c030a8e99484badb166ae2abd6333', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:20.223805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56b998-8d73-487b-ad32-303c8fe1b20c tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:20.224125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56b998-8d73-487b-ad32-303c8fe1b20c tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:20.224398 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56b998-8d73-487b-ad32-303c8fe1b20c tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] PATH_INFO: `/v3/projects/75d40889c39f4fb29f29003162e90538` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:20.225525 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56b998-8d73-487b-ad32-303c8fe1b20c tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] RBAC: Authorizing `identity:delete_project(project_id=75d40889c39f4fb29f29003162e90538)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:20.227653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56b998-8d73-487b-ad32-303c8fe1b20c tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:20.287000 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2f217-ee6b-4602-b863-e559d243fe00 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:20.288872 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-52f2f217-ee6b-4602-b863-e559d243fe00 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:20.353732 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2f217-ee6b-4602-b863-e559d243fe00 tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:20.358329 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f34d0-8b24-43a5-bd59-59b1d9d07df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:20.358956 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f34d0-8b24-43a5-bd59-59b1d9d07df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:20.359239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f34d0-8b24-43a5-bd59-59b1d9d07df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:20.359513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f34d0-8b24-43a5-bd59-59b1d9d07df2 admin admin] PATH_INFO: `/v3/users/447fc8fc12854ecfa34c266e952949b3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:20.360682 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f34d0-8b24-43a5-bd59-59b1d9d07df2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=447fc8fc12854ecfa34c266e952949b3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:20.362608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f34d0-8b24-43a5-bd59-59b1d9d07df2 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:20.393714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3b56b998-8d73-487b-ad32-303c8fe1b20c tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d40889c39f4fb29f29003162e90538', 'request_id': 'req-3b56b998-8d73-487b-ad32-303c8fe1b20c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:20.545196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3b56b998-8d73-487b-ad32-303c8fe1b20c tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d40889c39f4fb29f29003162e90538', 'request_id': 'req-3b56b998-8d73-487b-ad32-303c8fe1b20c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:20.549723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3b56b998-8d73-487b-ad32-303c8fe1b20c tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d40889c39f4fb29f29003162e90538', 'request_id': 'req-3b56b998-8d73-487b-ad32-303c8fe1b20c'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:20.560608 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3b56b998-8d73-487b-ad32-303c8fe1b20c tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] The token cache is being invalidate because project 75d40889c39f4fb29f29003162e90538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:20.560903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3b56b998-8d73-487b-ad32-303c8fe1b20c tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:20.561574 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3b56b998-8d73-487b-ad32-303c8fe1b20c tempest-VolumeQuotaClassesTest-429640504 tempest-VolumeQuotaClassesTest-429640504-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:20.563310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1333/2622] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:17:20 2022] DELETE /identity/v3/projects/75d40889c39f4fb29f29003162e90538 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:20.647510 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-141f34d0-8b24-43a5-bd59-59b1d9d07df2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '447fc8fc12854ecfa34c266e952949b3'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:20.648198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-141f34d0-8b24-43a5-bd59-59b1d9d07df2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '447fc8fc12854ecfa34c266e952949b3'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:20.661632 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-141f34d0-8b24-43a5-bd59-59b1d9d07df2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '447fc8fc12854ecfa34c266e952949b3'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:20.807803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-141f34d0-8b24-43a5-bd59-59b1d9d07df2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '447fc8fc12854ecfa34c266e952949b3'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:20.808505 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-141f34d0-8b24-43a5-bd59-59b1d9d07df2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '447fc8fc12854ecfa34c266e952949b3'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:20.822222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1290/2623] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:17:20 2022] DELETE /identity/v3/users/447fc8fc12854ecfa34c266e952949b3 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:17:20.826843 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d61413-30b6-4b8f-9b6c-b13cee5529e2 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:20.827134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d61413-30b6-4b8f-9b6c-b13cee5529e2 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:20.827413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d61413-30b6-4b8f-9b6c-b13cee5529e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:20.847104 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-f9d61413-30b6-4b8f-9b6c-b13cee5529e2 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:20.848074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f9d61413-30b6-4b8f-9b6c-b13cee5529e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:20.913560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1334/2624] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:17:20.923587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f34d0-8b24-43a5-bd59-59b1d9d07df2 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:20.925052 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-141f34d0-8b24-43a5-bd59-59b1d9d07df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:20.986908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f34d0-8b24-43a5-bd59-59b1d9d07df2 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:20.990719 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36ee8b-3dad-4c31-b31e-9616ac08cdc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:20.991338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36ee8b-3dad-4c31-b31e-9616ac08cdc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:20.991614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36ee8b-3dad-4c31-b31e-9616ac08cdc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:20.991901 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36ee8b-3dad-4c31-b31e-9616ac08cdc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:21.001948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36ee8b-3dad-4c31-b31e-9616ac08cdc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:21.003375 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36ee8b-3dad-4c31-b31e-9616ac08cdc5 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:21.013200 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1291/2625] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:21.456183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d61413-30b6-4b8f-9b6c-b13cee5529e2 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:21.467990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f9d61413-30b6-4b8f-9b6c-b13cee5529e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:21.471291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d61413-30b6-4b8f-9b6c-b13cee5529e2 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:21.476060 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f385a7-9ae6-4898-9148-1df36a2381e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:21.476698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f385a7-9ae6-4898-9148-1df36a2381e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:21.477113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f385a7-9ae6-4898-9148-1df36a2381e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:21.477432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f385a7-9ae6-4898-9148-1df36a2381e2 admin admin] PATH_INFO: `/v3/users/c2625253fd424419bf9693379fa93dd6` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:21.478582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f385a7-9ae6-4898-9148-1df36a2381e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2625253fd424419bf9693379fa93dd6)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:21.480601 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f385a7-9ae6-4898-9148-1df36a2381e2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:21.615488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36ee8b-3dad-4c31-b31e-9616ac08cdc5 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:21.616987 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1a36ee8b-3dad-4c31-b31e-9616ac08cdc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:21.630705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36ee8b-3dad-4c31-b31e-9616ac08cdc5 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:21.636142 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb7608-00e3-4a69-996c-3affaa2dc765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:21.636798 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb7608-00e3-4a69-996c-3affaa2dc765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:21.637076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb7608-00e3-4a69-996c-3affaa2dc765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:21.637345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb7608-00e3-4a69-996c-3affaa2dc765 admin admin] PATH_INFO: `/v3/projects/0bddb804c6894987bff0ba49aee103c5` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:21.638473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb7608-00e3-4a69-996c-3affaa2dc765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bddb804c6894987bff0ba49aee103c5)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:21.640446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb7608-00e3-4a69-996c-3affaa2dc765 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:21.647148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:21.781265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:21.795042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c1f385a7-9ae6-4898-9148-1df36a2381e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2625253fd424419bf9693379fa93dd6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:21.798748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-8fbb7608-00e3-4a69-996c-3affaa2dc765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bddb804c6894987bff0ba49aee103c5', 'request_id': 'req-8fbb7608-00e3-4a69-996c-3affaa2dc765'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:21.804241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-8fbb7608-00e3-4a69-996c-3affaa2dc765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bddb804c6894987bff0ba49aee103c5', 'request_id': 'req-8fbb7608-00e3-4a69-996c-3affaa2dc765'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:21.808571 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c1f385a7-9ae6-4898-9148-1df36a2381e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2625253fd424419bf9693379fa93dd6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:21.936188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-8fbb7608-00e3-4a69-996c-3affaa2dc765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bddb804c6894987bff0ba49aee103c5', 'request_id': 'req-8fbb7608-00e3-4a69-996c-3affaa2dc765'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:21.947887 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-8fbb7608-00e3-4a69-996c-3affaa2dc765 admin admin] The token cache is being invalidate because project 0bddb804c6894987bff0ba49aee103c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:21.948186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-8fbb7608-00e3-4a69-996c-3affaa2dc765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:21.948817 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-8fbb7608-00e3-4a69-996c-3affaa2dc765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:21.950299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1292/2626] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:17:21 2022] DELETE /identity/v3/projects/0bddb804c6894987bff0ba49aee103c5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:17:21.955321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c614c63-5bb8-445d-9311-e6dce67851ce None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:21.955609 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c614c63-5bb8-445d-9311-e6dce67851ce None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:21.955912 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c614c63-5bb8-445d-9311-e6dce67851ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:21.976538 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-5c614c63-5bb8-445d-9311-e6dce67851ce None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:21.976942 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-5c614c63-5bb8-445d-9311-e6dce67851ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:22.039215 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c1f385a7-9ae6-4898-9148-1df36a2381e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2625253fd424419bf9693379fa93dd6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:22.042633 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1293/2627] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:17:22.049575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c1f385a7-9ae6-4898-9148-1df36a2381e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2625253fd424419bf9693379fa93dd6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:22.050814 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c1f385a7-9ae6-4898-9148-1df36a2381e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2625253fd424419bf9693379fa93dd6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:22.051513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ac312-8353-4d8d-862f-3e51f725111b None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:22.053153 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ac312-8353-4d8d-862f-3e51f725111b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:22.053486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ac312-8353-4d8d-862f-3e51f725111b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:22.061103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1335/2628] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:17:21 2022] DELETE /identity/v3/users/c2625253fd424419bf9693379fa93dd6 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:17:22.062869 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df91770-f7b1-478f-8e07-0b7e9f410c1e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:22.063168 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df91770-f7b1-478f-8e07-0b7e9f410c1e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:22.063449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df91770-f7b1-478f-8e07-0b7e9f410c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:22.076262 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-169ac312-8353-4d8d-862f-3e51f725111b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:22.077478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-169ac312-8353-4d8d-862f-3e51f725111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:22.088016 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-2df91770-f7b1-478f-8e07-0b7e9f410c1e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:22.089234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2df91770-f7b1-478f-8e07-0b7e9f410c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:22.143926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1294/2629] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:22.148239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ac312-8353-4d8d-862f-3e51f725111b None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:22.154708 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1336/2630] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:17:22.160791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ac312-8353-4d8d-862f-3e51f725111b None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:22.167978 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df91770-f7b1-478f-8e07-0b7e9f410c1e None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:22.168951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff9a6b-9940-415d-bdeb-d137b34288e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:22.169461 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2df91770-f7b1-478f-8e07-0b7e9f410c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:22.169779 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff9a6b-9940-415d-bdeb-d137b34288e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:22.170072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff9a6b-9940-415d-bdeb-d137b34288e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:22.170348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff9a6b-9940-415d-bdeb-d137b34288e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:22.172364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff9a6b-9940-415d-bdeb-d137b34288e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:17:22.172716 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff9a6b-9940-415d-bdeb-d137b34288e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:22.174363 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff9a6b-9940-415d-bdeb-d137b34288e8 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:22.194763 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1295/2631] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:17:22.196334 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff9a6b-9940-415d-bdeb-d137b34288e8 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:22.207362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff9a6b-9940-415d-bdeb-d137b34288e8 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:22.213038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6e1f1-0409-466e-b639-0538817b326a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:22.213764 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6e1f1-0409-466e-b639-0538817b326a admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:22.214149 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6e1f1-0409-466e-b639-0538817b326a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:22.214526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6e1f1-0409-466e-b639-0538817b326a admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:22.215261 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6e1f1-0409-466e-b639-0538817b326a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:22.217334 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6e1f1-0409-466e-b639-0538817b326a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:22.230918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df91770-f7b1-478f-8e07-0b7e9f410c1e None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:22.234515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf925e30-45e1-485a-9df8-c7f7d97595dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:22.235702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf925e30-45e1-485a-9df8-c7f7d97595dc service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:22.236035 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf925e30-45e1-485a-9df8-c7f7d97595dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:22.236314 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf925e30-45e1-485a-9df8-c7f7d97595dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:22.246644 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf925e30-45e1-485a-9df8-c7f7d97595dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:22.248125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf925e30-45e1-485a-9df8-c7f7d97595dc service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:22.257580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1337/2632] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:17:22.357893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:22.365120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1296/2633] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:17:22 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:22.369302 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf925e30-45e1-485a-9df8-c7f7d97595dc service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:22.379175 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf925e30-45e1-485a-9df8-c7f7d97595dc service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:22.427975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:22.437157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb9b94-5a58-4aac-90b4-8beca6f8a84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:22.437773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb9b94-5a58-4aac-90b4-8beca6f8a84c admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:22.438081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb9b94-5a58-4aac-90b4-8beca6f8a84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:22.438359 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb9b94-5a58-4aac-90b4-8beca6f8a84c admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:22.439013 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb9b94-5a58-4aac-90b4-8beca6f8a84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:22.440971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb9b94-5a58-4aac-90b4-8beca6f8a84c admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:22.525634 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1338/2634] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:17:22 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:22.530101 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6e1f1-0409-466e-b639-0538817b326a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:22.544781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6e1f1-0409-466e-b639-0538817b326a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:22.550233 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b23a2-3380-4742-8e37-04aaa02b54bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:22.550854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b23a2-3380-4742-8e37-04aaa02b54bd admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:22.551270 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b23a2-3380-4742-8e37-04aaa02b54bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:22.551542 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b23a2-3380-4742-8e37-04aaa02b54bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:22.552879 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b23a2-3380-4742-8e37-04aaa02b54bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:22.554728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b23a2-3380-4742-8e37-04aaa02b54bd admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:22.566393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1297/2635] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:22.570556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb9b94-5a58-4aac-90b4-8beca6f8a84c admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:22.582259 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb9b94-5a58-4aac-90b4-8beca6f8a84c admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:22.588045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6b4eb-e1ab-4c75-aab3-19ff7f88aaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:22.588664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6b4eb-e1ab-4c75-aab3-19ff7f88aaea admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:22.588949 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6b4eb-e1ab-4c75-aab3-19ff7f88aaea admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:22.589226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6b4eb-e1ab-4c75-aab3-19ff7f88aaea admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:22.589881 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6b4eb-e1ab-4c75-aab3-19ff7f88aaea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:22.591480 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6b4eb-e1ab-4c75-aab3-19ff7f88aaea admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:22.604614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1339/2636] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:22.608049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b23a2-3380-4742-8e37-04aaa02b54bd admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:22.624417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b23a2-3380-4742-8e37-04aaa02b54bd admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:22.629909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec08a93-f468-43f6-99dd-d66cbd9f4a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:22.631042 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec08a93-f468-43f6-99dd-d66cbd9f4a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:22.632230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec08a93-f468-43f6-99dd-d66cbd9f4a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:22.633142 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec08a93-f468-43f6-99dd-d66cbd9f4a13 admin admin] PATH_INFO: `/v3/projects/b6620948d9e54389a9fd5db27405c929/users/e33026468b9e4ff9b5e9af74886396d9/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:22.649349 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec08a93-f468-43f6-99dd-d66cbd9f4a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6620948d9e54389a9fd5db27405c929, user_id=e33026468b9e4ff9b5e9af74886396d9, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:22.652918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec08a93-f468-43f6-99dd-d66cbd9f4a13 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:22.747076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1298/2637] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:22 2022] PUT /identity/v3/projects/b6620948d9e54389a9fd5db27405c929/users/e33026468b9e4ff9b5e9af74886396d9/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:17:22.756489 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6b4eb-e1ab-4c75-aab3-19ff7f88aaea admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:22.756489 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b7d6b4eb-e1ab-4c75-aab3-19ff7f88aaea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:22.757461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f6e36-a1d6-422c-a191-05456c4d6d68 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:22.757794 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f6e36-a1d6-422c-a191-05456c4d6d68 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:22.758074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f6e36-a1d6-422c-a191-05456c4d6d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:22.763371 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6b4eb-e1ab-4c75-aab3-19ff7f88aaea admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:22.790084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-938f6e36-a1d6-422c-a191-05456c4d6d68 None None] MFA Rules not processed for user `e33026468b9e4ff9b5e9af74886396d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:22.791311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-938f6e36-a1d6-422c-a191-05456c4d6d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:22.822397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf0911-debb-4861-a999-5ad8feae937a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:22.823031 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf0911-debb-4861-a999-5ad8feae937a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:22.823311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf0911-debb-4861-a999-5ad8feae937a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:22.823583 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf0911-debb-4861-a999-5ad8feae937a admin admin] PATH_INFO: `/v3/projects/939a6c4d2d784e8fb30ca1e0f3df538a` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:22.824742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf0911-debb-4861-a999-5ad8feae937a admin admin] RBAC: Authorizing `identity:delete_project(project_id=939a6c4d2d784e8fb30ca1e0f3df538a)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:22.826696 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf0911-debb-4861-a999-5ad8feae937a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:22.857103 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1299/2638] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:17:22.869361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f6e36-a1d6-422c-a191-05456c4d6d68 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:22.870745 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-938f6e36-a1d6-422c-a191-05456c4d6d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:22.930755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f6e36-a1d6-422c-a191-05456c4d6d68 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:22.941453 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-acaf0911-debb-4861-a999-5ad8feae937a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939a6c4d2d784e8fb30ca1e0f3df538a', 'request_id': 'req-acaf0911-debb-4861-a999-5ad8feae937a'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:22.985722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa652f-07e8-4dd3-8c99-b9501b0ca352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:22.986346 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa652f-07e8-4dd3-8c99-b9501b0ca352 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:22.986642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa652f-07e8-4dd3-8c99-b9501b0ca352 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:22.986962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa652f-07e8-4dd3-8c99-b9501b0ca352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:23.013607 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:23.042096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-acaf0911-debb-4861-a999-5ad8feae937a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939a6c4d2d784e8fb30ca1e0f3df538a', 'request_id': 'req-acaf0911-debb-4861-a999-5ad8feae937a'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:23.044532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa652f-07e8-4dd3-8c99-b9501b0ca352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:23.046088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa652f-07e8-4dd3-8c99-b9501b0ca352 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:23.050199 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-acaf0911-debb-4861-a999-5ad8feae937a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939a6c4d2d784e8fb30ca1e0f3df538a', 'request_id': 'req-acaf0911-debb-4861-a999-5ad8feae937a'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:23.056851 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1300/2639] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:17:23.062096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-acaf0911-debb-4861-a999-5ad8feae937a admin admin] The token cache is being invalidate because project 939a6c4d2d784e8fb30ca1e0f3df538a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:23.062409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-acaf0911-debb-4861-a999-5ad8feae937a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:23.063050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-acaf0911-debb-4861-a999-5ad8feae937a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:23.064751 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1340/2640] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:17:22 2022] DELETE /identity/v3/projects/939a6c4d2d784e8fb30ca1e0f3df538a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:17:23.068696 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa652f-07e8-4dd3-8c99-b9501b0ca352 service cinder] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:23.131594 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa652f-07e8-4dd3-8c99-b9501b0ca352 service cinder] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:23.136332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6cbae-2716-4ca4-bce0-525053c879e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:23.137000 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6cbae-2716-4ca4-bce0-525053c879e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:23.137299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6cbae-2716-4ca4-bce0-525053c879e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:23.137550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6cbae-2716-4ca4-bce0-525053c879e4 admin admin] PATH_INFO: `/v3/users/83a5a490601e453b86b0af7709eb4232` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:23.138954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6cbae-2716-4ca4-bce0-525053c879e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a5a490601e453b86b0af7709eb4232)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:23.140920 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6cbae-2716-4ca4-bce0-525053c879e4 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:23.374918 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b5b6cbae-2716-4ca4-bce0-525053c879e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a5a490601e453b86b0af7709eb4232'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:23.375532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b5b6cbae-2716-4ca4-bce0-525053c879e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a5a490601e453b86b0af7709eb4232'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:23.387526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b5b6cbae-2716-4ca4-bce0-525053c879e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a5a490601e453b86b0af7709eb4232'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:23.495793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b5b6cbae-2716-4ca4-bce0-525053c879e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a5a490601e453b86b0af7709eb4232'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:23.496453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-b5b6cbae-2716-4ca4-bce0-525053c879e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a5a490601e453b86b0af7709eb4232'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:23.511785 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1301/2641] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:17:23 2022] DELETE /identity/v3/users/83a5a490601e453b86b0af7709eb4232 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:17:24.099343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf0911-debb-4861-a999-5ad8feae937a admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:24.099343 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-acaf0911-debb-4861-a999-5ad8feae937a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:24.109052 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf0911-debb-4861-a999-5ad8feae937a admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:24.170623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df8802-d60d-4af2-a09c-3fb8bfe134d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:24.171262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df8802-d60d-4af2-a09c-3fb8bfe134d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:24.171539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df8802-d60d-4af2-a09c-3fb8bfe134d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:24.172255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df8802-d60d-4af2-a09c-3fb8bfe134d6 admin admin] PATH_INFO: `/v3/projects/ed3c030a8e99484badb166ae2abd6333` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:24.172952 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df8802-d60d-4af2-a09c-3fb8bfe134d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3c030a8e99484badb166ae2abd6333)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:24.174942 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df8802-d60d-4af2-a09c-3fb8bfe134d6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:24.177330 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:24.368801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-12df8802-d60d-4af2-a09c-3fb8bfe134d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3c030a8e99484badb166ae2abd6333', 'request_id': 'req-12df8802-d60d-4af2-a09c-3fb8bfe134d6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:24.499549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-12df8802-d60d-4af2-a09c-3fb8bfe134d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3c030a8e99484badb166ae2abd6333', 'request_id': 'req-12df8802-d60d-4af2-a09c-3fb8bfe134d6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:24.506997 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-12df8802-d60d-4af2-a09c-3fb8bfe134d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3c030a8e99484badb166ae2abd6333', 'request_id': 'req-12df8802-d60d-4af2-a09c-3fb8bfe134d6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:24.518593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-12df8802-d60d-4af2-a09c-3fb8bfe134d6 admin admin] The token cache is being invalidate because project ed3c030a8e99484badb166ae2abd6333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:24.518886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-12df8802-d60d-4af2-a09c-3fb8bfe134d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:24.519550 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-12df8802-d60d-4af2-a09c-3fb8bfe134d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:24.521127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1341/2642] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:17:24 2022] DELETE /identity/v3/projects/ed3c030a8e99484badb166ae2abd6333 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:24.526116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91431b19-e7eb-4761-a8dc-b6f4bec90569 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:24.526590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91431b19-e7eb-4761-a8dc-b6f4bec90569 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:24.526713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91431b19-e7eb-4761-a8dc-b6f4bec90569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:24.546723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-91431b19-e7eb-4761-a8dc-b6f4bec90569 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:24.548005 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-91431b19-e7eb-4761-a8dc-b6f4bec90569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:24.593043 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:24.611298 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1302/2643] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:17:24.619563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800f3ef-859c-4ae6-9a8f-b6b99b73e3c0 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:24.622081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800f3ef-859c-4ae6-9a8f-b6b99b73e3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:24.622081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800f3ef-859c-4ae6-9a8f-b6b99b73e3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:24.641887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-6800f3ef-859c-4ae6-9a8f-b6b99b73e3c0 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:24.643114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6800f3ef-859c-4ae6-9a8f-b6b99b73e3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:24.651161 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1342/2644] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:24.655514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91431b19-e7eb-4761-a8dc-b6f4bec90569 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:24.665188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91431b19-e7eb-4761-a8dc-b6f4bec90569 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:24.669837 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f950f-ab08-48d5-a89a-5e353b67051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:24.670414 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f950f-ab08-48d5-a89a-5e353b67051a admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:24.670693 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f950f-ab08-48d5-a89a-5e353b67051a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:24.670966 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f950f-ab08-48d5-a89a-5e353b67051a admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:24.671657 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f950f-ab08-48d5-a89a-5e353b67051a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:17:24.671944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f950f-ab08-48d5-a89a-5e353b67051a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:24.673539 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f950f-ab08-48d5-a89a-5e353b67051a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:24.685575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1303/2645] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:17:24.690003 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800f3ef-859c-4ae6-9a8f-b6b99b73e3c0 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:24.699924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800f3ef-859c-4ae6-9a8f-b6b99b73e3c0 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:24.704696 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601203a-e465-4617-a2d8-e30c52c5d7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:24.705340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601203a-e465-4617-a2d8-e30c52c5d7cb admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:24.705618 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601203a-e465-4617-a2d8-e30c52c5d7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:24.706134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601203a-e465-4617-a2d8-e30c52c5d7cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:24.706769 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601203a-e465-4617-a2d8-e30c52c5d7cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:24.708685 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601203a-e465-4617-a2d8-e30c52c5d7cb admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:24.876369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1343/2646] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:17:24 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:24.877415 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f950f-ab08-48d5-a89a-5e353b67051a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:24.889419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f950f-ab08-48d5-a89a-5e353b67051a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:24.961447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001eb148-409e-4bb4-abfe-197856f70b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:24.962058 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eb148-409e-4bb4-abfe-197856f70b09 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:24.962339 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eb148-409e-4bb4-abfe-197856f70b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:24.962612 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eb148-409e-4bb4-abfe-197856f70b09 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:24.963270 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001eb148-409e-4bb4-abfe-197856f70b09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:24.965216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001eb148-409e-4bb4-abfe-197856f70b09 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:25.096039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1304/2647] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:17:24 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:17:25.100241 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601203a-e465-4617-a2d8-e30c52c5d7cb admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:25.110462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601203a-e465-4617-a2d8-e30c52c5d7cb admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:25.114987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf14bdf-f2b6-40d2-adb2-60a0ca7036c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:25.115585 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf14bdf-f2b6-40d2-adb2-60a0ca7036c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:25.115885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf14bdf-f2b6-40d2-adb2-60a0ca7036c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:25.116162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf14bdf-f2b6-40d2-adb2-60a0ca7036c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:25.116804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf14bdf-f2b6-40d2-adb2-60a0ca7036c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:25.118397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf14bdf-f2b6-40d2-adb2-60a0ca7036c6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:25.128218 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1344/2648] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:25.132458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001eb148-409e-4bb4-abfe-197856f70b09 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:25.142971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001eb148-409e-4bb4-abfe-197856f70b09 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:25.147772 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eea0a5-b7f7-455b-b653-841716ea5458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:25.148409 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eea0a5-b7f7-455b-b653-841716ea5458 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:25.148714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eea0a5-b7f7-455b-b653-841716ea5458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:25.148999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eea0a5-b7f7-455b-b653-841716ea5458 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:25.150174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eea0a5-b7f7-455b-b653-841716ea5458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:25.151815 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eea0a5-b7f7-455b-b653-841716ea5458 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:25.163286 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1305/2649] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:25.167801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf14bdf-f2b6-40d2-adb2-60a0ca7036c6 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:25.241500 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf14bdf-f2b6-40d2-adb2-60a0ca7036c6 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:25.241500 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a4e04-ca32-4c24-8591-2423df5904bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:25.241500 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a4e04-ca32-4c24-8591-2423df5904bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:25.241500 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a4e04-ca32-4c24-8591-2423df5904bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:25.241936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a4e04-ca32-4c24-8591-2423df5904bd admin admin] PATH_INFO: `/v3/projects/18a4de6e0d934e0e98828dc55db41ebd/users/bd0fa8bfa8c849d58392b3f2ee5db966/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:25.241936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a4e04-ca32-4c24-8591-2423df5904bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a4de6e0d934e0e98828dc55db41ebd, user_id=bd0fa8bfa8c849d58392b3f2ee5db966, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:25.241936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a4e04-ca32-4c24-8591-2423df5904bd admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:25.437497 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1345/2650] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:25 2022] PUT /identity/v3/projects/18a4de6e0d934e0e98828dc55db41ebd/users/bd0fa8bfa8c849d58392b3f2ee5db966/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:25.448360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359e7ee-6c95-4c5b-86ae-56a1804a88d1 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:25.448646 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359e7ee-6c95-4c5b-86ae-56a1804a88d1 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:25.448943 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359e7ee-6c95-4c5b-86ae-56a1804a88d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:25.476854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-f359e7ee-6c95-4c5b-86ae-56a1804a88d1 None None] MFA Rules not processed for user `bd0fa8bfa8c849d58392b3f2ee5db966`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:25.478115 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f359e7ee-6c95-4c5b-86ae-56a1804a88d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:25.545530 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1306/2651] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:25.550529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a4e04-ca32-4c24-8591-2423df5904bd admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:25.613074 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a4e04-ca32-4c24-8591-2423df5904bd admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:25.617614 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153be5c-a31b-4654-b390-e99b5e504366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:25.618311 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153be5c-a31b-4654-b390-e99b5e504366 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:25.618596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153be5c-a31b-4654-b390-e99b5e504366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:25.618871 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153be5c-a31b-4654-b390-e99b5e504366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:25.619499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153be5c-a31b-4654-b390-e99b5e504366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:25.621495 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153be5c-a31b-4654-b390-e99b5e504366 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:25.743741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1346/2652] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:17:25 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:25.747818 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359e7ee-6c95-4c5b-86ae-56a1804a88d1 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:25.759006 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359e7ee-6c95-4c5b-86ae-56a1804a88d1 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:25.817499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d743815-47b1-49b7-887c-4ec9cdbef4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:25.818114 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d743815-47b1-49b7-887c-4ec9cdbef4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:25.818399 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d743815-47b1-49b7-887c-4ec9cdbef4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:25.818678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d743815-47b1-49b7-887c-4ec9cdbef4e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:25.819322 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d743815-47b1-49b7-887c-4ec9cdbef4e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:25.821881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d743815-47b1-49b7-887c-4ec9cdbef4e1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:25.945220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1307/2653] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:17:25 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:25.947281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153be5c-a31b-4654-b390-e99b5e504366 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:25.958101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153be5c-a31b-4654-b390-e99b5e504366 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:25.962683 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b380d3d-4643-4d5d-8926-0b34c9b5a7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:25.963342 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b380d3d-4643-4d5d-8926-0b34c9b5a7bc admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:25.963624 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b380d3d-4643-4d5d-8926-0b34c9b5a7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:25.963928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b380d3d-4643-4d5d-8926-0b34c9b5a7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:25.964566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b380d3d-4643-4d5d-8926-0b34c9b5a7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:25.966265 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b380d3d-4643-4d5d-8926-0b34c9b5a7bc admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:25.977140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1347/2654] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:25.981060 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d743815-47b1-49b7-887c-4ec9cdbef4e1 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:25.991644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d743815-47b1-49b7-887c-4ec9cdbef4e1 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:25.999537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101a828-837b-41e7-b7f7-76ea15e19582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:25.999537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101a828-837b-41e7-b7f7-76ea15e19582 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:25.999537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101a828-837b-41e7-b7f7-76ea15e19582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:25.999537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101a828-837b-41e7-b7f7-76ea15e19582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:25.999982 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101a828-837b-41e7-b7f7-76ea15e19582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:26.001213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101a828-837b-41e7-b7f7-76ea15e19582 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:26.012677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1308/2655] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:26.016906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b380d3d-4643-4d5d-8926-0b34c9b5a7bc admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:26.027207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b380d3d-4643-4d5d-8926-0b34c9b5a7bc admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:26.034000 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73247e98-bf84-4571-9281-48d91f87c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:26.034000 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73247e98-bf84-4571-9281-48d91f87c40e admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:26.034000 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73247e98-bf84-4571-9281-48d91f87c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:26.034000 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73247e98-bf84-4571-9281-48d91f87c40e admin admin] PATH_INFO: `/v3/projects/c591d256bc6640cd8d53c998677b91cc/users/6b9c05db39e145b1afc73acc743b8775/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:26.049822 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73247e98-bf84-4571-9281-48d91f87c40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c591d256bc6640cd8d53c998677b91cc, user_id=6b9c05db39e145b1afc73acc743b8775, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:26.053125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73247e98-bf84-4571-9281-48d91f87c40e admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:26.151736 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1348/2656] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:26 2022] PUT /identity/v3/projects/c591d256bc6640cd8d53c998677b91cc/users/6b9c05db39e145b1afc73acc743b8775/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:17:26.163379 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a38ef-1985-4117-8aed-129a4c689483 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:26.163669 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a38ef-1985-4117-8aed-129a4c689483 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:26.163971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a38ef-1985-4117-8aed-129a4c689483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:26.197770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e80a38ef-1985-4117-8aed-129a4c689483 None None] MFA Rules not processed for user `6b9c05db39e145b1afc73acc743b8775`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:26.199004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e80a38ef-1985-4117-8aed-129a4c689483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:26.265244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1309/2657] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:26.269729 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73247e98-bf84-4571-9281-48d91f87c40e admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:26.330702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73247e98-bf84-4571-9281-48d91f87c40e admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:26.335546 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a8a38-1e16-41d7-ad87-b59c7d806c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:26.336178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a8a38-1e16-41d7-ad87-b59c7d806c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:26.336492 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a8a38-1e16-41d7-ad87-b59c7d806c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:26.337319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a8a38-1e16-41d7-ad87-b59c7d806c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:26.337998 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a8a38-1e16-41d7-ad87-b59c7d806c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:26.339879 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a8a38-1e16-41d7-ad87-b59c7d806c06 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:26.368045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:26.425829 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1349/2658] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:17:26 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:26.430583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a38ef-1985-4117-8aed-129a4c689483 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:26.441433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a38ef-1985-4117-8aed-129a4c689483 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:26.498003 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef7ee8-1337-4a02-afbd-28958bfe2233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:26.498615 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef7ee8-1337-4a02-afbd-28958bfe2233 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:26.498891 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef7ee8-1337-4a02-afbd-28958bfe2233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:26.499160 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef7ee8-1337-4a02-afbd-28958bfe2233 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:26.499808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef7ee8-1337-4a02-afbd-28958bfe2233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:26.501747 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef7ee8-1337-4a02-afbd-28958bfe2233 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:26.731063 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1310/2659] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:17:26 2022] POST /identity/v3/users => generated 299 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:26.735093 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a8a38-1e16-41d7-ad87-b59c7d806c06 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:26.745816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a8a38-1e16-41d7-ad87-b59c7d806c06 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:26.750450 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db7470-f684-486b-8838-31df580a8ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:26.751042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db7470-f684-486b-8838-31df580a8ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:26.751321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db7470-f684-486b-8838-31df580a8ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:26.751600 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db7470-f684-486b-8838-31df580a8ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:26.752263 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db7470-f684-486b-8838-31df580a8ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:26.753876 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db7470-f684-486b-8838-31df580a8ac2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:26.764577 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1350/2660] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:26.768345 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:26.776354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef7ee8-1337-4a02-afbd-28958bfe2233 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:26.786145 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef7ee8-1337-4a02-afbd-28958bfe2233 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:26.791173 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec72cb-3a66-4836-a127-11583375bef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:26.791819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec72cb-3a66-4836-a127-11583375bef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:26.792130 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec72cb-3a66-4836-a127-11583375bef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:26.792401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec72cb-3a66-4836-a127-11583375bef0 admin admin] PATH_INFO: `/v3/projects/1e23d23769714156a3eba10f9ba071d4/users/e026863ff09d46afb9c1b153c5d4202b/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:26.806746 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec72cb-3a66-4836-a127-11583375bef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e23d23769714156a3eba10f9ba071d4, user_id=e026863ff09d46afb9c1b153c5d4202b, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:26.813388 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec72cb-3a66-4836-a127-11583375bef0 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:26.956889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1311/2661] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:26 2022] PUT /identity/v3/projects/1e23d23769714156a3eba10f9ba071d4/users/e026863ff09d46afb9c1b153c5d4202b/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:17:26.961001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db7470-f684-486b-8838-31df580a8ac2 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:26.971514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db7470-f684-486b-8838-31df580a8ac2 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:27.030128 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bb411-1166-40b1-bf0b-b2b6e8a74207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:27.030737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bb411-1166-40b1-bf0b-b2b6e8a74207 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:27.031021 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bb411-1166-40b1-bf0b-b2b6e8a74207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:27.031295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bb411-1166-40b1-bf0b-b2b6e8a74207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:27.031964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bb411-1166-40b1-bf0b-b2b6e8a74207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:27.033610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bb411-1166-40b1-bf0b-b2b6e8a74207 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:27.044215 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1351/2662] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:17:27.048531 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec72cb-3a66-4836-a127-11583375bef0 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:27.059587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec72cb-3a66-4836-a127-11583375bef0 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:27.064250 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e12f02-642a-4b92-bcc8-c611e2f805f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:27.064904 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e12f02-642a-4b92-bcc8-c611e2f805f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:27.065187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e12f02-642a-4b92-bcc8-c611e2f805f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:27.065463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e12f02-642a-4b92-bcc8-c611e2f805f7 admin admin] PATH_INFO: `/v3/projects/1e23d23769714156a3eba10f9ba071d4/users/e026863ff09d46afb9c1b153c5d4202b/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:27.067387 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e12f02-642a-4b92-bcc8-c611e2f805f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e23d23769714156a3eba10f9ba071d4, user_id=e026863ff09d46afb9c1b153c5d4202b, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:27.070098 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e12f02-642a-4b92-bcc8-c611e2f805f7 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:27.080368 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1312/2663] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:27 2022] PUT /identity/v3/projects/1e23d23769714156a3eba10f9ba071d4/users/e026863ff09d46afb9c1b153c5d4202b/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:27.090990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7176ac0-6704-4110-94fb-a07fa31cd89d None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:27.091226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7176ac0-6704-4110-94fb-a07fa31cd89d None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:27.091509 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7176ac0-6704-4110-94fb-a07fa31cd89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:27.120005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-e7176ac0-6704-4110-94fb-a07fa31cd89d None None] MFA Rules not processed for user `e026863ff09d46afb9c1b153c5d4202b`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:27.121230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e7176ac0-6704-4110-94fb-a07fa31cd89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:27.191134 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1352/2664] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:27.202001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e12f02-642a-4b92-bcc8-c611e2f805f7 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:27.207009 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b3e12f02-642a-4b92-bcc8-c611e2f805f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:27.263333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e12f02-642a-4b92-bcc8-c611e2f805f7 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:27.267095 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6a337-ebd8-447f-b2cd-46e21ddc1dd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:27.272025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6a337-ebd8-447f-b2cd-46e21ddc1dd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:27.272025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6a337-ebd8-447f-b2cd-46e21ddc1dd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:27.272025 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6a337-ebd8-447f-b2cd-46e21ddc1dd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:27.278326 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6a337-ebd8-447f-b2cd-46e21ddc1dd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:27.279780 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6a337-ebd8-447f-b2cd-46e21ddc1dd7 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:27.290074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1313/2665] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:27.438812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:27.441727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7176ac0-6704-4110-94fb-a07fa31cd89d None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:27.443120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e7176ac0-6704-4110-94fb-a07fa31cd89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:27.508395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7176ac0-6704-4110-94fb-a07fa31cd89d None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:27.513166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba017f-c3eb-46f5-b73f-8bf38a1bbd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:27.513806 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba017f-c3eb-46f5-b73f-8bf38a1bbd90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:27.514125 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba017f-c3eb-46f5-b73f-8bf38a1bbd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:27.514401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba017f-c3eb-46f5-b73f-8bf38a1bbd90 admin admin] PATH_INFO: `/v3/users/e33026468b9e4ff9b5e9af74886396d9` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:27.515624 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba017f-c3eb-46f5-b73f-8bf38a1bbd90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e33026468b9e4ff9b5e9af74886396d9)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:27.517654 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba017f-c3eb-46f5-b73f-8bf38a1bbd90 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:27.526292 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:27.833407 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bcba017f-c3eb-46f5-b73f-8bf38a1bbd90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e33026468b9e4ff9b5e9af74886396d9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:27.845963 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bcba017f-c3eb-46f5-b73f-8bf38a1bbd90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e33026468b9e4ff9b5e9af74886396d9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:28.047999 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bcba017f-c3eb-46f5-b73f-8bf38a1bbd90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e33026468b9e4ff9b5e9af74886396d9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:28.056036 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bcba017f-c3eb-46f5-b73f-8bf38a1bbd90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e33026468b9e4ff9b5e9af74886396d9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:28.056733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-bcba017f-c3eb-46f5-b73f-8bf38a1bbd90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e33026468b9e4ff9b5e9af74886396d9'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:28.065484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1353/2666] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:17:27 2022] DELETE /identity/v3/users/e33026468b9e4ff9b5e9af74886396d9 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:28.069822 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077995c-0560-400b-89ba-bbab5ae71483 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:28.070323 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077995c-0560-400b-89ba-bbab5ae71483 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:28.070446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077995c-0560-400b-89ba-bbab5ae71483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:28.090734 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-c077995c-0560-400b-89ba-bbab5ae71483 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:28.091973 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c077995c-0560-400b-89ba-bbab5ae71483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:28.151782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1314/2667] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:28.161700 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba017f-c3eb-46f5-b73f-8bf38a1bbd90 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:28.163098 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-bcba017f-c3eb-46f5-b73f-8bf38a1bbd90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:28.222773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba017f-c3eb-46f5-b73f-8bf38a1bbd90 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:28.226615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26cdb5-30b5-42e8-9e49-c72ba86739ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:28.227349 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26cdb5-30b5-42e8-9e49-c72ba86739ea service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:28.227636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26cdb5-30b5-42e8-9e49-c72ba86739ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:28.227952 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26cdb5-30b5-42e8-9e49-c72ba86739ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:28.237038 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26cdb5-30b5-42e8-9e49-c72ba86739ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:28.238465 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26cdb5-30b5-42e8-9e49-c72ba86739ea service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:28.249010 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1354/2668] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:28.279185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:28.707592 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077995c-0560-400b-89ba-bbab5ae71483 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:28.709078 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c077995c-0560-400b-89ba-bbab5ae71483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:28.741305 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26cdb5-30b5-42e8-9e49-c72ba86739ea service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:28.743647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0b26cdb5-30b5-42e8-9e49-c72ba86739ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:28.765367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26cdb5-30b5-42e8-9e49-c72ba86739ea service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:28.771565 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077995c-0560-400b-89ba-bbab5ae71483 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:28.772712 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a5aa0-ea00-4152-aa54-f887ad235c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:28.773669 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a5aa0-ea00-4152-aa54-f887ad235c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:28.774575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a5aa0-ea00-4152-aa54-f887ad235c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:28.775068 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a5aa0-ea00-4152-aa54-f887ad235c2b admin admin] PATH_INFO: `/v3/projects/b6620948d9e54389a9fd5db27405c929` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:28.778017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70011ec-9bf6-49d8-820a-ac760d402b8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:28.778017 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70011ec-9bf6-49d8-820a-ac760d402b8d service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:28.778303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a5aa0-ea00-4152-aa54-f887ad235c2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6620948d9e54389a9fd5db27405c929)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:28.778398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70011ec-9bf6-49d8-820a-ac760d402b8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:28.778398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70011ec-9bf6-49d8-820a-ac760d402b8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:28.779529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a70011ec-9bf6-49d8-820a-ac760d402b8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:28.779885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a5aa0-ea00-4152-aa54-f887ad235c2b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:28.840133 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70011ec-9bf6-49d8-820a-ac760d402b8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:28.841641 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70011ec-9bf6-49d8-820a-ac760d402b8d service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:28.845131 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:28.850919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1315/2669] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:28.923378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-946a5aa0-ea00-4152-aa54-f887ad235c2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6620948d9e54389a9fd5db27405c929', 'request_id': 'req-946a5aa0-ea00-4152-aa54-f887ad235c2b'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:29.036332 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-946a5aa0-ea00-4152-aa54-f887ad235c2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6620948d9e54389a9fd5db27405c929', 'request_id': 'req-946a5aa0-ea00-4152-aa54-f887ad235c2b'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:29.043432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-946a5aa0-ea00-4152-aa54-f887ad235c2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6620948d9e54389a9fd5db27405c929', 'request_id': 'req-946a5aa0-ea00-4152-aa54-f887ad235c2b'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:29.053643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-946a5aa0-ea00-4152-aa54-f887ad235c2b admin admin] The token cache is being invalidate because project b6620948d9e54389a9fd5db27405c929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:29.054978 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-946a5aa0-ea00-4152-aa54-f887ad235c2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:29.054978 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-946a5aa0-ea00-4152-aa54-f887ad235c2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:29.056973 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1355/2670] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:17:28 2022] DELETE /identity/v3/projects/b6620948d9e54389a9fd5db27405c929 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:17:29.061944 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcbbf9-58eb-40ef-b68f-c39386633e1c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:29.062227 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcbbf9-58eb-40ef-b68f-c39386633e1c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:29.062495 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcbbf9-58eb-40ef-b68f-c39386633e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:29.096608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e4dcbbf9-58eb-40ef-b68f-c39386633e1c None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:29.097812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e4dcbbf9-58eb-40ef-b68f-c39386633e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:29.178953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1316/2671] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:29.186921 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb96f0-4c6a-40e4-818f-110e7dae8604 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:29.187251 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb96f0-4c6a-40e4-818f-110e7dae8604 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:29.192434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb96f0-4c6a-40e4-818f-110e7dae8604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:29.209565 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-eddb96f0-4c6a-40e4-818f-110e7dae8604 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:29.210795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-eddb96f0-4c6a-40e4-818f-110e7dae8604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:29.220925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1356/2672] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:29.225692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcbbf9-58eb-40ef-b68f-c39386633e1c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:29.239111 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcbbf9-58eb-40ef-b68f-c39386633e1c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:29.243983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bdbc6-b319-4bf4-83c1-d128e94abc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:29.244544 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bdbc6-b319-4bf4-83c1-d128e94abc6e admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:29.244824 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bdbc6-b319-4bf4-83c1-d128e94abc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:29.245099 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bdbc6-b319-4bf4-83c1-d128e94abc6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:29.245748 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bdbc6-b319-4bf4-83c1-d128e94abc6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:17:29.246068 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bdbc6-b319-4bf4-83c1-d128e94abc6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:29.247728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bdbc6-b319-4bf4-83c1-d128e94abc6e admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:29.260251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1317/2673] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:17:29.264636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb96f0-4c6a-40e4-818f-110e7dae8604 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:29.275235 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb96f0-4c6a-40e4-818f-110e7dae8604 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:29.281357 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1163860-c4ee-4ee1-9837-2df8697a92da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:29.282048 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1163860-c4ee-4ee1-9837-2df8697a92da admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:29.282337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1163860-c4ee-4ee1-9837-2df8697a92da admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:29.282611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1163860-c4ee-4ee1-9837-2df8697a92da admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:29.283260 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1163860-c4ee-4ee1-9837-2df8697a92da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:29.285264 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1163860-c4ee-4ee1-9837-2df8697a92da admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:29.392391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1357/2674] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:17:29 2022] POST /identity/v3/projects => generated 363 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:29.396698 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bdbc6-b319-4bf4-83c1-d128e94abc6e admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:29.407237 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bdbc6-b319-4bf4-83c1-d128e94abc6e admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:29.468570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d5019-0daa-4530-8f42-eb511b62c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:29.469220 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d5019-0daa-4530-8f42-eb511b62c947 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:29.469501 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d5019-0daa-4530-8f42-eb511b62c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:29.469774 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d5019-0daa-4530-8f42-eb511b62c947 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:29.470406 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d5019-0daa-4530-8f42-eb511b62c947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:29.472351 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d5019-0daa-4530-8f42-eb511b62c947 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:29.591349 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1318/2675] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:17:29 2022] POST /identity/v3/users => generated 282 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:29.595525 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1163860-c4ee-4ee1-9837-2df8697a92da admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:29.609370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1163860-c4ee-4ee1-9837-2df8697a92da admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:29.614094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a4e15-ef6f-48d4-8352-879ac10be579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:29.614750 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4e15-ef6f-48d4-8352-879ac10be579 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:29.615041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4e15-ef6f-48d4-8352-879ac10be579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:29.615379 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4e15-ef6f-48d4-8352-879ac10be579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:29.615975 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a4e15-ef6f-48d4-8352-879ac10be579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:29.617570 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a4e15-ef6f-48d4-8352-879ac10be579 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:29.629689 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1358/2676] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:29.634933 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d5019-0daa-4530-8f42-eb511b62c947 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:29.645059 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d5019-0daa-4530-8f42-eb511b62c947 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:29.650496 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7509c-3bac-4b85-a556-fcc7dceead3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:29.651088 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7509c-3bac-4b85-a556-fcc7dceead3e admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:29.651371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7509c-3bac-4b85-a556-fcc7dceead3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:29.651645 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7509c-3bac-4b85-a556-fcc7dceead3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:29.652331 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7509c-3bac-4b85-a556-fcc7dceead3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:29.653927 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7509c-3bac-4b85-a556-fcc7dceead3e admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:29.666502 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1319/2677] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:29.670755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a4e15-ef6f-48d4-8352-879ac10be579 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:29.681699 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a4e15-ef6f-48d4-8352-879ac10be579 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:29.686442 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca312ae-54ba-4f32-a760-3913715bef3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:29.687100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca312ae-54ba-4f32-a760-3913715bef3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:29.687383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca312ae-54ba-4f32-a760-3913715bef3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:29.687658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca312ae-54ba-4f32-a760-3913715bef3b admin admin] PATH_INFO: `/v3/projects/74003c5d650e4ed79e43bc21f5ab00bf/users/2952adb02e9a4b22bb0ea45983d11648/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:29.703670 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca312ae-54ba-4f32-a760-3913715bef3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=74003c5d650e4ed79e43bc21f5ab00bf, user_id=2952adb02e9a4b22bb0ea45983d11648, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:29.706765 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca312ae-54ba-4f32-a760-3913715bef3b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:29.816908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1359/2678] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:29 2022] PUT /identity/v3/projects/74003c5d650e4ed79e43bc21f5ab00bf/users/2952adb02e9a4b22bb0ea45983d11648/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:29.828293 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1852a-ebeb-4a82-b563-7c8869775898 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:29.828584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1852a-ebeb-4a82-b563-7c8869775898 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:29.828958 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1852a-ebeb-4a82-b563-7c8869775898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:29.862198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-65f1852a-ebeb-4a82-b563-7c8869775898 None None] MFA Rules not processed for user `2952adb02e9a4b22bb0ea45983d11648`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:29.862198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-65f1852a-ebeb-4a82-b563-7c8869775898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:29.919575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:29.929736 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1320/2679] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:17:29.941885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca312ae-54ba-4f32-a760-3913715bef3b admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:29.943617 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2ca312ae-54ba-4f32-a760-3913715bef3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:30.003657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca312ae-54ba-4f32-a760-3913715bef3b admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:30.007372 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c2832-9b0a-4084-95a9-01c76b03dfe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:30.008011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c2832-9b0a-4084-95a9-01c76b03dfe5 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:30.008293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c2832-9b0a-4084-95a9-01c76b03dfe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:30.008572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c2832-9b0a-4084-95a9-01c76b03dfe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:30.017580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c2832-9b0a-4084-95a9-01c76b03dfe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:30.019138 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c2832-9b0a-4084-95a9-01c76b03dfe5 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:30.029051 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1360/2680] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:32.919782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7da2e-6ad7-4ff2-a36b-fc5a2c0296f8 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:32.920320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7da2e-6ad7-4ff2-a36b-fc5a2c0296f8 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:32.920417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7da2e-6ad7-4ff2-a36b-fc5a2c0296f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:32.974186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b5c7da2e-6ad7-4ff2-a36b-fc5a2c0296f8 None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:32.975452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b5c7da2e-6ad7-4ff2-a36b-fc5a2c0296f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:33.042856 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1321/2681] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 14:17:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:33.056289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c2832-9b0a-4084-95a9-01c76b03dfe5 service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:33.057759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-323c2832-9b0a-4084-95a9-01c76b03dfe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:33.085501 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:33.168890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c2832-9b0a-4084-95a9-01c76b03dfe5 service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:33.174760 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb61740-62b1-4794-bb65-55802f58b978 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:33.175397 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb61740-62b1-4794-bb65-55802f58b978 service swift] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:33.176072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb61740-62b1-4794-bb65-55802f58b978 service swift] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:33.176466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb61740-62b1-4794-bb65-55802f58b978 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:33.185977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb61740-62b1-4794-bb65-55802f58b978 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:33.194790 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb61740-62b1-4794-bb65-55802f58b978 service swift] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:33.196896 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1361/2682] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:17:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:17:34.471711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7da2e-6ad7-4ff2-a36b-fc5a2c0296f8 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:34.473089 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b5c7da2e-6ad7-4ff2-a36b-fc5a2c0296f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:34.549541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7da2e-6ad7-4ff2-a36b-fc5a2c0296f8 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:34.557816 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396754b-a193-40ea-a597-ddd8c7790bb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:34.560581 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396754b-a193-40ea-a597-ddd8c7790bb7 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:34.560934 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396754b-a193-40ea-a597-ddd8c7790bb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:34.561222 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396754b-a193-40ea-a597-ddd8c7790bb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:34.568446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4396754b-a193-40ea-a597-ddd8c7790bb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:34.647700 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c3064-46ef-42e8-83fd-50213a6943f0 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:34.648229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c3064-46ef-42e8-83fd-50213a6943f0 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:34.648643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c3064-46ef-42e8-83fd-50213a6943f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:34.657942 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:34.672791 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-447c3064-46ef-42e8-83fd-50213a6943f0 None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:34.674316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-447c3064-46ef-42e8-83fd-50213a6943f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:34.675761 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396754b-a193-40ea-a597-ddd8c7790bb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:34.677407 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396754b-a193-40ea-a597-ddd8c7790bb7 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:34.688032 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1362/2683] 10.222.0.64 () {58 vars in 967 bytes} [Thu Sep 1 14:17:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:17:34.697563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c3064-46ef-42e8-83fd-50213a6943f0 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:34.703750 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1322/2684] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:34.711997 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c3064-46ef-42e8-83fd-50213a6943f0 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:34.718409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a326e-7761-463b-958f-3852c82f37be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:34.719028 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a326e-7761-463b-958f-3852c82f37be service swift] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:34.719355 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a326e-7761-463b-958f-3852c82f37be service swift] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:34.719568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a326e-7761-463b-958f-3852c82f37be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:34.729159 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a326e-7761-463b-958f-3852c82f37be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:34.730757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a326e-7761-463b-958f-3852c82f37be service swift] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:34.740605 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1363/2685] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:17:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 14:17:35.576827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709613b-4afd-4fea-aaad-ae21f7da8d84 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:35.577316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709613b-4afd-4fea-aaad-ae21f7da8d84 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:35.577526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709613b-4afd-4fea-aaad-ae21f7da8d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:35.602188 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e709613b-4afd-4fea-aaad-ae21f7da8d84 None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:35.603444 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e709613b-4afd-4fea-aaad-ae21f7da8d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:35.611191 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1323/2686] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Sep 1 14:17:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:35.628985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a326e-7761-463b-958f-3852c82f37be service swift] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:35.637711 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a326e-7761-463b-958f-3852c82f37be service swift] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:35.642849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ca779-6a9e-43e2-955c-08290e8c667c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:35.643486 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ca779-6a9e-43e2-955c-08290e8c667c service swift] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:35.643948 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ca779-6a9e-43e2-955c-08290e8c667c service swift] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:35.644491 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ca779-6a9e-43e2-955c-08290e8c667c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:35.654349 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ca779-6a9e-43e2-955c-08290e8c667c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:35.655957 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ca779-6a9e-43e2-955c-08290e8c667c service swift] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:35.672735 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1364/2687] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:17:36.668288 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a5961-5f38-4109-b37c-6de8fd2fc043 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:36.669441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a5961-5f38-4109-b37c-6de8fd2fc043 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:36.670030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a5961-5f38-4109-b37c-6de8fd2fc043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:36.695143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-ec7a5961-5f38-4109-b37c-6de8fd2fc043 None None] MFA Rules not processed for user `98320a8730d245f6b7fa014273604ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:36.696971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ec7a5961-5f38-4109-b37c-6de8fd2fc043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:36.705956 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1324/2688] 10.222.0.64 () {58 vars in 967 bytes} [Thu Sep 1 14:17:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:17:36.718742 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ca779-6a9e-43e2-955c-08290e8c667c service swift] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:36.729567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ca779-6a9e-43e2-955c-08290e8c667c service swift] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:36.734815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe581fee-fd95-462c-b832-ff7b7d9f186f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdebe1b674cc4b2bb6bf962de01a24ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:36.735486 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe581fee-fd95-462c-b832-ff7b7d9f186f service swift] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:36.735773 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe581fee-fd95-462c-b832-ff7b7d9f186f service swift] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:36.736072 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe581fee-fd95-462c-b832-ff7b7d9f186f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:36.744823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe581fee-fd95-462c-b832-ff7b7d9f186f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:36.746396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe581fee-fd95-462c-b832-ff7b7d9f186f service swift] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:36.754666 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1365/2689] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Sep 1 14:17:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 14:17:36.873514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a5961-5f38-4109-b37c-6de8fd2fc043 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:36.883324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a5961-5f38-4109-b37c-6de8fd2fc043 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:36.887087 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efdfe5-351c-42d7-9983-9331976389b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:36.887695 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efdfe5-351c-42d7-9983-9331976389b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:36.888013 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efdfe5-351c-42d7-9983-9331976389b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:36.888398 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efdfe5-351c-42d7-9983-9331976389b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:36.890043 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-46efdfe5-351c-42d7-9983-9331976389b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:36.955204 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efdfe5-351c-42d7-9983-9331976389b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:36.956950 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efdfe5-351c-42d7-9983-9331976389b5 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:36.966016 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1325/2690] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:40.347499 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe581fee-fd95-462c-b832-ff7b7d9f186f service swift] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:40.349137 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fe581fee-fd95-462c-b832-ff7b7d9f186f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:40.422594 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe581fee-fd95-462c-b832-ff7b7d9f186f service swift] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:40.427359 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924961a7-b793-485c-8249-ca2dcec8597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:40.428041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924961a7-b793-485c-8249-ca2dcec8597a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:40.431512 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924961a7-b793-485c-8249-ca2dcec8597a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:40.431512 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924961a7-b793-485c-8249-ca2dcec8597a admin admin] PATH_INFO: `/v3/users/9cec9fa4375e48498e11c53f7faa540b` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:40.431512 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924961a7-b793-485c-8249-ca2dcec8597a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cec9fa4375e48498e11c53f7faa540b)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:40.432631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924961a7-b793-485c-8249-ca2dcec8597a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:40.757089 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:40.759672 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-924961a7-b793-485c-8249-ca2dcec8597a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cec9fa4375e48498e11c53f7faa540b'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:40.771484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-924961a7-b793-485c-8249-ca2dcec8597a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cec9fa4375e48498e11c53f7faa540b'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:40.958766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-924961a7-b793-485c-8249-ca2dcec8597a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cec9fa4375e48498e11c53f7faa540b'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:40.966325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-924961a7-b793-485c-8249-ca2dcec8597a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cec9fa4375e48498e11c53f7faa540b'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:40.967040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-924961a7-b793-485c-8249-ca2dcec8597a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cec9fa4375e48498e11c53f7faa540b'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:40.973006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1366/2691] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:17:40 2022] DELETE /identity/v3/users/9cec9fa4375e48498e11c53f7faa540b => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:40.977604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54f563-07ff-446f-b602-ad48d9a778c3 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:40.978092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54f563-07ff-446f-b602-ad48d9a778c3 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:40.978192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54f563-07ff-446f-b602-ad48d9a778c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:40.998781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-4b54f563-07ff-446f-b602-ad48d9a778c3 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:41.000033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4b54f563-07ff-446f-b602-ad48d9a778c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:41.117959 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924961a7-b793-485c-8249-ca2dcec8597a admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:41.119514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-924961a7-b793-485c-8249-ca2dcec8597a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:41.195034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1326/2692] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:41.204930 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54f563-07ff-446f-b602-ad48d9a778c3 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:41.206706 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4b54f563-07ff-446f-b602-ad48d9a778c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:41.272774 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54f563-07ff-446f-b602-ad48d9a778c3 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:41.276755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0dc60-068d-4749-8324-7297e813148f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:41.277373 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0dc60-068d-4749-8324-7297e813148f service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:41.277651 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0dc60-068d-4749-8324-7297e813148f service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:41.277922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0dc60-068d-4749-8324-7297e813148f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:41.288133 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0dc60-068d-4749-8324-7297e813148f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:41.290224 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0dc60-068d-4749-8324-7297e813148f service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:41.299992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1327/2693] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:17:41.306205 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924961a7-b793-485c-8249-ca2dcec8597a admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:41.310049 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af4be7-69d5-4618-ad4d-1edd9e4c7494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:41.310658 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af4be7-69d5-4618-ad4d-1edd9e4c7494 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:41.310941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af4be7-69d5-4618-ad4d-1edd9e4c7494 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:41.311213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af4be7-69d5-4618-ad4d-1edd9e4c7494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:41.313039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e8af4be7-69d5-4618-ad4d-1edd9e4c7494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:41.325481 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af4be7-69d5-4618-ad4d-1edd9e4c7494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:41.326913 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af4be7-69d5-4618-ad4d-1edd9e4c7494 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:41.338239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1367/2694] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:17:41.632971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0dc60-068d-4749-8324-7297e813148f service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:41.634442 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-74a0dc60-068d-4749-8324-7297e813148f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:41.646052 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:41.667174 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0dc60-068d-4749-8324-7297e813148f service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:41.673066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb403d0c-bee1-4095-8d29-8ad654c4b443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:41.673904 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb403d0c-bee1-4095-8d29-8ad654c4b443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:41.674265 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb403d0c-bee1-4095-8d29-8ad654c4b443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:41.674726 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb403d0c-bee1-4095-8d29-8ad654c4b443 admin admin] PATH_INFO: `/v3/projects/9088bbf5d43c4e25a470455563fede6c` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:41.676094 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb403d0c-bee1-4095-8d29-8ad654c4b443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9088bbf5d43c4e25a470455563fede6c)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:41.678282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb403d0c-bee1-4095-8d29-8ad654c4b443 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:41.811501 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-eb403d0c-bee1-4095-8d29-8ad654c4b443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9088bbf5d43c4e25a470455563fede6c', 'request_id': 'req-eb403d0c-bee1-4095-8d29-8ad654c4b443'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:41.817255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-eb403d0c-bee1-4095-8d29-8ad654c4b443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9088bbf5d43c4e25a470455563fede6c', 'request_id': 'req-eb403d0c-bee1-4095-8d29-8ad654c4b443'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:41.912983 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-eb403d0c-bee1-4095-8d29-8ad654c4b443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9088bbf5d43c4e25a470455563fede6c', 'request_id': 'req-eb403d0c-bee1-4095-8d29-8ad654c4b443'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:41.931582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-eb403d0c-bee1-4095-8d29-8ad654c4b443 admin admin] The token cache is being invalidate because project 9088bbf5d43c4e25a470455563fede6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:41.932038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-eb403d0c-bee1-4095-8d29-8ad654c4b443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:41.932998 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-eb403d0c-bee1-4095-8d29-8ad654c4b443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:41.934522 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1328/2695] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:17:41 2022] DELETE /identity/v3/projects/9088bbf5d43c4e25a470455563fede6c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:42.432461 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af4be7-69d5-4618-ad4d-1edd9e4c7494 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:42.433989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-e8af4be7-69d5-4618-ad4d-1edd9e4c7494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:42.446935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af4be7-69d5-4618-ad4d-1edd9e4c7494 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:42.518958 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b5458-bc5f-4c39-a939-61ea3ff91517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:42.520368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b5458-bc5f-4c39-a939-61ea3ff91517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:42.520819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b5458-bc5f-4c39-a939-61ea3ff91517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:42.521106 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b5458-bc5f-4c39-a939-61ea3ff91517 admin admin] PATH_INFO: `/v3/users/bd0fa8bfa8c849d58392b3f2ee5db966` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:42.522328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b5458-bc5f-4c39-a939-61ea3ff91517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd0fa8bfa8c849d58392b3f2ee5db966)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:42.524827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b5458-bc5f-4c39-a939-61ea3ff91517 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:42.780204 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-881b5458-bc5f-4c39-a939-61ea3ff91517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd0fa8bfa8c849d58392b3f2ee5db966'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:42.793377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-881b5458-bc5f-4c39-a939-61ea3ff91517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd0fa8bfa8c849d58392b3f2ee5db966'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:42.802934 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:42.884874 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-881b5458-bc5f-4c39-a939-61ea3ff91517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd0fa8bfa8c849d58392b3f2ee5db966'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:42.893604 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-881b5458-bc5f-4c39-a939-61ea3ff91517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd0fa8bfa8c849d58392b3f2ee5db966'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:42.894323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-881b5458-bc5f-4c39-a939-61ea3ff91517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd0fa8bfa8c849d58392b3f2ee5db966'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:42.900360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1368/2696] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:17:42 2022] DELETE /identity/v3/users/bd0fa8bfa8c849d58392b3f2ee5db966 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:42.906324 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c15ff3-f8c9-4d41-a4cf-1851a960d6fe None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:42.906773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c15ff3-f8c9-4d41-a4cf-1851a960d6fe None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:42.906773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c15ff3-f8c9-4d41-a4cf-1851a960d6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:42.926796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-70c15ff3-f8c9-4d41-a4cf-1851a960d6fe None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:42.928057 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-70c15ff3-f8c9-4d41-a4cf-1851a960d6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:43.005683 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1329/2697] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:43.012988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b5458-bc5f-4c39-a939-61ea3ff91517 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:43.014491 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-881b5458-bc5f-4c39-a939-61ea3ff91517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:43.085280 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b5458-bc5f-4c39-a939-61ea3ff91517 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:43.089696 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d1336-e580-43ae-9960-86f293aaaa2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:43.090390 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d1336-e580-43ae-9960-86f293aaaa2a service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:43.090745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d1336-e580-43ae-9960-86f293aaaa2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:43.091163 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d1336-e580-43ae-9960-86f293aaaa2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:43.102958 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d1336-e580-43ae-9960-86f293aaaa2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:43.104561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d1336-e580-43ae-9960-86f293aaaa2a service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:43.115969 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1369/2698] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:43.707284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c15ff3-f8c9-4d41-a4cf-1851a960d6fe None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:43.709228 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-70c15ff3-f8c9-4d41-a4cf-1851a960d6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:43.722316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c15ff3-f8c9-4d41-a4cf-1851a960d6fe None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:43.726908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:43.727542 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:43.727819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:43.728124 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb admin admin] PATH_INFO: `/v3/projects/18a4de6e0d934e0e98828dc55db41ebd` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:43.729229 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a4de6e0d934e0e98828dc55db41ebd)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:43.731143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:43.933303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a4de6e0d934e0e98828dc55db41ebd', 'request_id': 'req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:43.949952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a4de6e0d934e0e98828dc55db41ebd', 'request_id': 'req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:44.049621 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a4de6e0d934e0e98828dc55db41ebd', 'request_id': 'req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:44.061608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb admin admin] The token cache is being invalidate because project 18a4de6e0d934e0e98828dc55db41ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:44.061902 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:44.062528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:44.064029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1330/2699] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:17:43 2022] DELETE /identity/v3/projects/18a4de6e0d934e0e98828dc55db41ebd => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:44.068004 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d1336-e580-43ae-9960-86f293aaaa2a service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:44.078809 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d1336-e580-43ae-9960-86f293aaaa2a service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:44.137472 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f41619-75d5-4cdc-9a6b-bdf10561c8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:44.138401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f41619-75d5-4cdc-9a6b-bdf10561c8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:44.138804 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f41619-75d5-4cdc-9a6b-bdf10561c8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:44.139247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f41619-75d5-4cdc-9a6b-bdf10561c8e0 admin admin] PATH_INFO: `/v3/users/6b9c05db39e145b1afc73acc743b8775` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:44.141081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f41619-75d5-4cdc-9a6b-bdf10561c8e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9c05db39e145b1afc73acc743b8775)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:44.142997 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f41619-75d5-4cdc-9a6b-bdf10561c8e0 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:44.390503 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d3f41619-75d5-4cdc-9a6b-bdf10561c8e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9c05db39e145b1afc73acc743b8775'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:44.403688 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d3f41619-75d5-4cdc-9a6b-bdf10561c8e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9c05db39e145b1afc73acc743b8775'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:44.530682 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d3f41619-75d5-4cdc-9a6b-bdf10561c8e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9c05db39e145b1afc73acc743b8775'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:44.552722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d3f41619-75d5-4cdc-9a6b-bdf10561c8e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9c05db39e145b1afc73acc743b8775'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:44.555339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d3f41619-75d5-4cdc-9a6b-bdf10561c8e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9c05db39e145b1afc73acc743b8775'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:44.565135 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1370/2700] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:17:44 2022] DELETE /identity/v3/users/6b9c05db39e145b1afc73acc743b8775 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:45.187783 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:45.189425 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:45.204492 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3b49a-cfa4-4064-8db0-4f0b60b1e2eb admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:45.210574 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:45.283348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:45.284011 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:45.284294 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:45.284568 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b admin admin] PATH_INFO: `/v3/projects/c591d256bc6640cd8d53c998677b91cc` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:45.285674 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c591d256bc6640cd8d53c998677b91cc)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:45.287568 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:45.348666 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f41619-75d5-4cdc-9a6b-bdf10561c8e0 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:45.350785 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d3f41619-75d5-4cdc-9a6b-bdf10561c8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:45.360819 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:45.365037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f41619-75d5-4cdc-9a6b-bdf10561c8e0 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:45.373014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468b9ba-dff0-4b2d-a6e8-9a2477190903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:45.373014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468b9ba-dff0-4b2d-a6e8-9a2477190903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:45.373455 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468b9ba-dff0-4b2d-a6e8-9a2477190903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:45.373863 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468b9ba-dff0-4b2d-a6e8-9a2477190903 admin admin] PATH_INFO: `/v3/users/d7956f61efc44be8abbce5033cc95849` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:45.375544 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468b9ba-dff0-4b2d-a6e8-9a2477190903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7956f61efc44be8abbce5033cc95849)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:45.377948 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468b9ba-dff0-4b2d-a6e8-9a2477190903 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:45.410687 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c591d256bc6640cd8d53c998677b91cc', 'request_id': 'req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:45.417596 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c591d256bc6640cd8d53c998677b91cc', 'request_id': 'req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:45.495550 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c591d256bc6640cd8d53c998677b91cc', 'request_id': 'req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:45.508127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b admin admin] The token cache is being invalidate because project c591d256bc6640cd8d53c998677b91cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:45.508426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:45.509090 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:45.510573 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1331/2701] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:17:45 2022] DELETE /identity/v3/projects/c591d256bc6640cd8d53c998677b91cc => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:45.514447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:45.515744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:45.576103 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d468b9ba-dff0-4b2d-a6e8-9a2477190903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7956f61efc44be8abbce5033cc95849'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:45.580875 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a49f0-b0ba-44cf-ba7f-71600d5e091b admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:45.586311 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ab31c-1b4e-4677-b4f9-2348266b0af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:45.586951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ab31c-1b4e-4677-b4f9-2348266b0af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:45.587234 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ab31c-1b4e-4677-b4f9-2348266b0af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:45.587510 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ab31c-1b4e-4677-b4f9-2348266b0af3 admin admin] PATH_INFO: `/v3/users/e026863ff09d46afb9c1b153c5d4202b` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:45.588681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ab31c-1b4e-4677-b4f9-2348266b0af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e026863ff09d46afb9c1b153c5d4202b)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:45.589557 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d468b9ba-dff0-4b2d-a6e8-9a2477190903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7956f61efc44be8abbce5033cc95849'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:45.590630 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ab31c-1b4e-4677-b4f9-2348266b0af3 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:45.672667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d468b9ba-dff0-4b2d-a6e8-9a2477190903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7956f61efc44be8abbce5033cc95849'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:45.680826 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d468b9ba-dff0-4b2d-a6e8-9a2477190903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7956f61efc44be8abbce5033cc95849'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:45.692226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d468b9ba-dff0-4b2d-a6e8-9a2477190903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7956f61efc44be8abbce5033cc95849'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:45.692226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1371/2702] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:17:45 2022] DELETE /identity/v3/users/d7956f61efc44be8abbce5033cc95849 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:17:45.911325 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:45.916277 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-197ab31c-1b4e-4677-b4f9-2348266b0af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e026863ff09d46afb9c1b153c5d4202b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:45.916943 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-197ab31c-1b4e-4677-b4f9-2348266b0af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e026863ff09d46afb9c1b153c5d4202b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:45.928978 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-197ab31c-1b4e-4677-b4f9-2348266b0af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e026863ff09d46afb9c1b153c5d4202b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:45.983050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468b9ba-dff0-4b2d-a6e8-9a2477190903 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:45.985412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d468b9ba-dff0-4b2d-a6e8-9a2477190903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:46.004086 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-197ab31c-1b4e-4677-b4f9-2348266b0af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e026863ff09d46afb9c1b153c5d4202b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:46.004895 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-197ab31c-1b4e-4677-b4f9-2348266b0af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e026863ff09d46afb9c1b153c5d4202b'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:46.018701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1332/2703] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:17:45 2022] DELETE /identity/v3/users/e026863ff09d46afb9c1b153c5d4202b => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:17:46.055647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468b9ba-dff0-4b2d-a6e8-9a2477190903 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:46.114294 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddef67-947d-40ce-8707-fc1081edc4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:46.115234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddef67-947d-40ce-8707-fc1081edc4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:46.115511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddef67-947d-40ce-8707-fc1081edc4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:46.115780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddef67-947d-40ce-8707-fc1081edc4c6 admin admin] PATH_INFO: `/v3/projects/4379f93c234c401fa5a0e1329e113833` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:46.116946 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddef67-947d-40ce-8707-fc1081edc4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4379f93c234c401fa5a0e1329e113833)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:46.118837 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddef67-947d-40ce-8707-fc1081edc4c6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:46.254954 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:46.272457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a2ddef67-947d-40ce-8707-fc1081edc4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4379f93c234c401fa5a0e1329e113833', 'request_id': 'req-a2ddef67-947d-40ce-8707-fc1081edc4c6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:46.373140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a2ddef67-947d-40ce-8707-fc1081edc4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4379f93c234c401fa5a0e1329e113833', 'request_id': 'req-a2ddef67-947d-40ce-8707-fc1081edc4c6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:46.379966 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a2ddef67-947d-40ce-8707-fc1081edc4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4379f93c234c401fa5a0e1329e113833', 'request_id': 'req-a2ddef67-947d-40ce-8707-fc1081edc4c6'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:46.393818 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a2ddef67-947d-40ce-8707-fc1081edc4c6 admin admin] The token cache is being invalidate because project 4379f93c234c401fa5a0e1329e113833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:46.394140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a2ddef67-947d-40ce-8707-fc1081edc4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:46.395139 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-a2ddef67-947d-40ce-8707-fc1081edc4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:46.396714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1372/2704] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:17:45 2022] DELETE /identity/v3/projects/4379f93c234c401fa5a0e1329e113833 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:17:46.404213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4716-5673-43b9-899e-07e823766741 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:46.404722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4716-5673-43b9-899e-07e823766741 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:46.404824 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4716-5673-43b9-899e-07e823766741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:46.428948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-aa7f4716-5673-43b9-899e-07e823766741 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:46.428948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-aa7f4716-5673-43b9-899e-07e823766741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:46.495196 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1333/2705] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:46.502143 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddef67-947d-40ce-8707-fc1081edc4c6 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:46.503642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b71b-5e14-4af6-baf5-9d4b965c730c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:46.503980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b71b-5e14-4af6-baf5-9d4b965c730c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:46.504261 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32b71b-5e14-4af6-baf5-9d4b965c730c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:46.504771 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a2ddef67-947d-40ce-8707-fc1081edc4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:46.525250 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-4a32b71b-5e14-4af6-baf5-9d4b965c730c None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:46.526874 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4a32b71b-5e14-4af6-baf5-9d4b965c730c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:46.527884 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddef67-947d-40ce-8707-fc1081edc4c6 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:46.533411 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bc88d-e4eb-4577-b113-cffe124714ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:46.534648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bc88d-e4eb-4577-b113-cffe124714ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:46.535273 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bc88d-e4eb-4577-b113-cffe124714ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:46.535642 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bc88d-e4eb-4577-b113-cffe124714ed admin admin] PATH_INFO: `/v3/projects/1e23d23769714156a3eba10f9ba071d4` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:46.535912 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1334/2706] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:46.537521 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bc88d-e4eb-4577-b113-cffe124714ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e23d23769714156a3eba10f9ba071d4)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:46.543472 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32b71b-5e14-4af6-baf5-9d4b965c730c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:46.543636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bc88d-e4eb-4577-b113-cffe124714ed admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:46.550556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32b71b-5e14-4af6-baf5-9d4b965c730c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:46.556570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153eb484-30f2-447d-befd-b759239ed04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:46.557213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153eb484-30f2-447d-befd-b759239ed04a admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:46.557493 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153eb484-30f2-447d-befd-b759239ed04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:46.557796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153eb484-30f2-447d-befd-b759239ed04a admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:46.558494 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153eb484-30f2-447d-befd-b759239ed04a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:17:46.558804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153eb484-30f2-447d-befd-b759239ed04a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:46.560495 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153eb484-30f2-447d-befd-b759239ed04a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:46.573975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1335/2707] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:17:46.578678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153eb484-30f2-447d-befd-b759239ed04a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:46.590028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153eb484-30f2-447d-befd-b759239ed04a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:46.595541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcdbd2-03a2-4525-8e06-e4c1493c0b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:46.596241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcdbd2-03a2-4525-8e06-e4c1493c0b96 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:46.596533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcdbd2-03a2-4525-8e06-e4c1493c0b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:46.596810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcdbd2-03a2-4525-8e06-e4c1493c0b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:46.597489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcdbd2-03a2-4525-8e06-e4c1493c0b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:46.599474 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcdbd2-03a2-4525-8e06-e4c1493c0b96 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:46.713283 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1336/2708] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:17:46 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:46.714456 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcdbd2-03a2-4525-8e06-e4c1493c0b96 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:46.714925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-976bc88d-e4eb-4577-b113-cffe124714ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e23d23769714156a3eba10f9ba071d4', 'request_id': 'req-976bc88d-e4eb-4577-b113-cffe124714ed'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:46.782199 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcdbd2-03a2-4525-8e06-e4c1493c0b96 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:46.786856 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145a2f7-ae88-4288-8286-d5e5e159e70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:46.787465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145a2f7-ae88-4288-8286-d5e5e159e70d admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:46.787737 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145a2f7-ae88-4288-8286-d5e5e159e70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:46.788044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145a2f7-ae88-4288-8286-d5e5e159e70d admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:46.788670 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145a2f7-ae88-4288-8286-d5e5e159e70d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:46.790627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145a2f7-ae88-4288-8286-d5e5e159e70d admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:46.838207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-976bc88d-e4eb-4577-b113-cffe124714ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e23d23769714156a3eba10f9ba071d4', 'request_id': 'req-976bc88d-e4eb-4577-b113-cffe124714ed'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:46.845636 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-976bc88d-e4eb-4577-b113-cffe124714ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e23d23769714156a3eba10f9ba071d4', 'request_id': 'req-976bc88d-e4eb-4577-b113-cffe124714ed'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:46.856282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-976bc88d-e4eb-4577-b113-cffe124714ed admin admin] The token cache is being invalidate because project 1e23d23769714156a3eba10f9ba071d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:46.856581 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-976bc88d-e4eb-4577-b113-cffe124714ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:46.857246 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-976bc88d-e4eb-4577-b113-cffe124714ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:46.858753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1373/2709] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:17:46 2022] DELETE /identity/v3/projects/1e23d23769714156a3eba10f9ba071d4 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:46.864462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3aeeb-387b-4ce1-b793-85671be66711 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:46.864753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3aeeb-387b-4ce1-b793-85671be66711 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:46.865032 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3aeeb-387b-4ce1-b793-85671be66711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:46.884086 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-c0a3aeeb-387b-4ce1-b793-85671be66711 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:46.885283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c0a3aeeb-387b-4ce1-b793-85671be66711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:46.893206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1374/2710] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:17:46.903540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6873643-7f60-45e4-a71c-22f571dfe5b1 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:46.903832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6873643-7f60-45e4-a71c-22f571dfe5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:46.904139 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6873643-7f60-45e4-a71c-22f571dfe5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:46.924127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-a6873643-7f60-45e4-a71c-22f571dfe5b1 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:46.925330 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a6873643-7f60-45e4-a71c-22f571dfe5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:46.933751 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1375/2711] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:17:46.937893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6873643-7f60-45e4-a71c-22f571dfe5b1 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:46.941790 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1337/2712] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:17:46 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:46.946366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145a2f7-ae88-4288-8286-d5e5e159e70d admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:46.947727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6873643-7f60-45e4-a71c-22f571dfe5b1 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:46.948008 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f145a2f7-ae88-4288-8286-d5e5e159e70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:46.952641 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6428aa2-5804-4a9b-8353-6f5d58e34a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:46.953252 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6428aa2-5804-4a9b-8353-6f5d58e34a19 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:46.953661 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6428aa2-5804-4a9b-8353-6f5d58e34a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:46.953899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6428aa2-5804-4a9b-8353-6f5d58e34a19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:46.954522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6428aa2-5804-4a9b-8353-6f5d58e34a19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:17:46.954829 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6428aa2-5804-4a9b-8353-6f5d58e34a19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:46.956846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6428aa2-5804-4a9b-8353-6f5d58e34a19 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:46.960782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145a2f7-ae88-4288-8286-d5e5e159e70d admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:46.965453 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559da8c-be5b-425b-a49f-94531471047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:46.966120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559da8c-be5b-425b-a49f-94531471047f admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:46.966353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559da8c-be5b-425b-a49f-94531471047f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:46.966630 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559da8c-be5b-425b-a49f-94531471047f admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:46.967272 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559da8c-be5b-425b-a49f-94531471047f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:46.969858 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1376/2713] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:17:46.969992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559da8c-be5b-425b-a49f-94531471047f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:46.971248 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:46.974006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6428aa2-5804-4a9b-8353-6f5d58e34a19 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:46.983577 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1338/2714] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:17:46.983938 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6428aa2-5804-4a9b-8353-6f5d58e34a19 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:46.984926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559da8c-be5b-425b-a49f-94531471047f admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:46.988606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedccb02-0e06-48ae-85ab-1fb64357314f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:46.989204 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedccb02-0e06-48ae-85ab-1fb64357314f admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:46.989488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedccb02-0e06-48ae-85ab-1fb64357314f admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:46.989766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedccb02-0e06-48ae-85ab-1fb64357314f admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:46.990389 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedccb02-0e06-48ae-85ab-1fb64357314f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:46.992872 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedccb02-0e06-48ae-85ab-1fb64357314f admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:46.996305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559da8c-be5b-425b-a49f-94531471047f admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:47.001142 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e2f1d-75b9-44f9-856d-a5d2f70590d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:47.001735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e2f1d-75b9-44f9-856d-a5d2f70590d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:47.002015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e2f1d-75b9-44f9-856d-a5d2f70590d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:47.002287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e2f1d-75b9-44f9-856d-a5d2f70590d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:47.002912 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e2f1d-75b9-44f9-856d-a5d2f70590d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:47.004618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e2f1d-75b9-44f9-856d-a5d2f70590d0 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:47.015962 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1339/2715] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:47.029672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e2f1d-75b9-44f9-856d-a5d2f70590d0 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:47.043536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e2f1d-75b9-44f9-856d-a5d2f70590d0 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:47.048687 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeaca72-9f9d-4155-9b81-fb5dbc3954cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:47.049360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaca72-9f9d-4155-9b81-fb5dbc3954cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:47.049654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaca72-9f9d-4155-9b81-fb5dbc3954cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:47.049955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeaca72-9f9d-4155-9b81-fb5dbc3954cc admin admin] PATH_INFO: `/v3/projects/3807b87d8e2b406abdaa822c35b9ecea/users/eb7a10b72e304a01b2e888340ec14d02/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:47.065745 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeaca72-9f9d-4155-9b81-fb5dbc3954cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3807b87d8e2b406abdaa822c35b9ecea, user_id=eb7a10b72e304a01b2e888340ec14d02, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:47.068501 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeaca72-9f9d-4155-9b81-fb5dbc3954cc admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:47.113969 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1377/2716] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:17:46 2022] POST /identity/v3/projects => generated 399 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:17:47.118748 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedccb02-0e06-48ae-85ab-1fb64357314f admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:47.141680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1340/2717] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:47 2022] PUT /identity/v3/projects/3807b87d8e2b406abdaa822c35b9ecea/users/eb7a10b72e304a01b2e888340ec14d02/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:17:47.160140 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77f74c-90cc-4e9b-b25d-635d88000d03 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:47.160428 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77f74c-90cc-4e9b-b25d-635d88000d03 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:47.160704 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77f74c-90cc-4e9b-b25d-635d88000d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:47.170015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:47.183256 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedccb02-0e06-48ae-85ab-1fb64357314f admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:47.188488 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-5c77f74c-90cc-4e9b-b25d-635d88000d03 None None] MFA Rules not processed for user `eb7a10b72e304a01b2e888340ec14d02`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:47.189626 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-5c77f74c-90cc-4e9b-b25d-635d88000d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:47.240247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef6527-2811-4186-9e71-3ca6dd6b980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:47.240897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef6527-2811-4186-9e71-3ca6dd6b980f admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:47.241181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef6527-2811-4186-9e71-3ca6dd6b980f admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:47.241456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef6527-2811-4186-9e71-3ca6dd6b980f admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:47.242624 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef6527-2811-4186-9e71-3ca6dd6b980f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:47.244566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef6527-2811-4186-9e71-3ca6dd6b980f admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:47.256760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1341/2718] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:17:47.261355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77f74c-90cc-4e9b-b25d-635d88000d03 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:47.271677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77f74c-90cc-4e9b-b25d-635d88000d03 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:47.276885 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2637a7-0b74-419a-b64b-334bd93b887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:47.277468 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2637a7-0b74-419a-b64b-334bd93b887c admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:47.277754 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2637a7-0b74-419a-b64b-334bd93b887c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:47.278031 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2637a7-0b74-419a-b64b-334bd93b887c admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:47.278645 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2637a7-0b74-419a-b64b-334bd93b887c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:47.280610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2637a7-0b74-419a-b64b-334bd93b887c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:47.359367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1378/2719] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:17:47 2022] POST /identity/v3/users => generated 300 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:17:47.363399 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef6527-2811-4186-9e71-3ca6dd6b980f admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:47.373541 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef6527-2811-4186-9e71-3ca6dd6b980f admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:47.378141 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f28ea-de6f-430e-9743-6e25d1458cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:47.378721 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f28ea-de6f-430e-9743-6e25d1458cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:47.379001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f28ea-de6f-430e-9743-6e25d1458cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:47.379277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f28ea-de6f-430e-9743-6e25d1458cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:47.379947 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f28ea-de6f-430e-9743-6e25d1458cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:47.381534 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f28ea-de6f-430e-9743-6e25d1458cdc admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:47.393776 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1342/2720] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:17:47 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:17:47.393972 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1379/2721] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:17:47.397264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2637a7-0b74-419a-b64b-334bd93b887c admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:47.397415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f28ea-de6f-430e-9743-6e25d1458cdc admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:47.407589 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f28ea-de6f-430e-9743-6e25d1458cdc admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:47.460640 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2637a7-0b74-419a-b64b-334bd93b887c admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:47.463509 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0384e-8cd2-4867-aaf3-b130b2dd6901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:47.464176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0384e-8cd2-4867-aaf3-b130b2dd6901 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:47.464456 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0384e-8cd2-4867-aaf3-b130b2dd6901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:47.464733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0384e-8cd2-4867-aaf3-b130b2dd6901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:47.465369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0384e-8cd2-4867-aaf3-b130b2dd6901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:47.465647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1fc09-bea1-4597-8cac-2a4de8ff6d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:47.466263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1fc09-bea1-4597-8cac-2a4de8ff6d82 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:47.466545 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1fc09-bea1-4597-8cac-2a4de8ff6d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:47.466820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1fc09-bea1-4597-8cac-2a4de8ff6d82 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:47.467022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0384e-8cd2-4867-aaf3-b130b2dd6901 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:47.467459 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1fc09-bea1-4597-8cac-2a4de8ff6d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:47.469482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1fc09-bea1-4597-8cac-2a4de8ff6d82 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:47.478405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1380/2722] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:47.482568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0384e-8cd2-4867-aaf3-b130b2dd6901 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:47.492708 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0384e-8cd2-4867-aaf3-b130b2dd6901 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:47.497310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf4887-3839-4a5c-a86c-43f2b562709d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:47.497945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf4887-3839-4a5c-a86c-43f2b562709d admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:47.498227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf4887-3839-4a5c-a86c-43f2b562709d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:47.498504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf4887-3839-4a5c-a86c-43f2b562709d admin admin] PATH_INFO: `/v3/projects/3a5f307be6a642b885463d0e3b38e4dc/users/47cda91b87264324b0970b6b9c00c3bc/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:47.513031 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf4887-3839-4a5c-a86c-43f2b562709d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5f307be6a642b885463d0e3b38e4dc, user_id=47cda91b87264324b0970b6b9c00c3bc, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:47.515672 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf4887-3839-4a5c-a86c-43f2b562709d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:47.625951 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1343/2723] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:17:47 2022] POST /identity/v3/users => generated 296 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:47.629804 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1fc09-bea1-4597-8cac-2a4de8ff6d82 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:47.640231 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1fc09-bea1-4597-8cac-2a4de8ff6d82 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:47.643144 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1381/2724] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:47 2022] PUT /identity/v3/projects/3a5f307be6a642b885463d0e3b38e4dc/users/47cda91b87264324b0970b6b9c00c3bc/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:17:47.654292 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:47.655702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf4727-5146-4122-9a48-c95ed6fa6ecd None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:47.656023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf4727-5146-4122-9a48-c95ed6fa6ecd None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:47.656300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf4727-5146-4122-9a48-c95ed6fa6ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:47.684836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-74cf4727-5146-4122-9a48-c95ed6fa6ecd None None] MFA Rules not processed for user `47cda91b87264324b0970b6b9c00c3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:47.686100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-74cf4727-5146-4122-9a48-c95ed6fa6ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:47.701029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2cb59-b301-4200-9c5e-ee5c4824f373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:47.701674 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2cb59-b301-4200-9c5e-ee5c4824f373 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:47.701953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2cb59-b301-4200-9c5e-ee5c4824f373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:47.702223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2cb59-b301-4200-9c5e-ee5c4824f373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:47.702865 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2cb59-b301-4200-9c5e-ee5c4824f373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:47.704482 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2cb59-b301-4200-9c5e-ee5c4824f373 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:47.715897 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1344/2725] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:47.720306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2cb59-b301-4200-9c5e-ee5c4824f373 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:47.721964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:47.730802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2cb59-b301-4200-9c5e-ee5c4824f373 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:47.735637 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca33d9-55a6-4ff0-8884-cb2f76c3ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:47.736344 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca33d9-55a6-4ff0-8884-cb2f76c3ad22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:47.736665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca33d9-55a6-4ff0-8884-cb2f76c3ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:47.736899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca33d9-55a6-4ff0-8884-cb2f76c3ad22 admin admin] PATH_INFO: `/v3/projects/a667568ba5af446c8de878d4d7a3cd9f/users/1ad5a427e1844b62a4ea3cf75527eca3/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:47.752337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca33d9-55a6-4ff0-8884-cb2f76c3ad22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a667568ba5af446c8de878d4d7a3cd9f, user_id=1ad5a427e1844b62a4ea3cf75527eca3, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:47.754422 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1382/2726] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:17:47.757217 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca33d9-55a6-4ff0-8884-cb2f76c3ad22 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:47.758635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf4727-5146-4122-9a48-c95ed6fa6ecd None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:47.769137 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf4727-5146-4122-9a48-c95ed6fa6ecd None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:47.774556 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e2a33-eb24-4105-950c-4f94e0a0ffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:47.775133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e2a33-eb24-4105-950c-4f94e0a0ffa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:47.775409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e2a33-eb24-4105-950c-4f94e0a0ffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:47.775714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e2a33-eb24-4105-950c-4f94e0a0ffa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:47.776384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e2a33-eb24-4105-950c-4f94e0a0ffa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:47.778366 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e2a33-eb24-4105-950c-4f94e0a0ffa7 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:48.287711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1345/2727] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:47 2022] PUT /identity/v3/projects/a667568ba5af446c8de878d4d7a3cd9f/users/1ad5a427e1844b62a4ea3cf75527eca3/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:48.291627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca33d9-55a6-4ff0-8884-cb2f76c3ad22 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:48.355906 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1383/2728] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:17:47 2022] POST /identity/v3/projects => generated 399 bytes in 596 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:17:48.358351 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e2a33-eb24-4105-950c-4f94e0a0ffa7 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:48.361038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca33d9-55a6-4ff0-8884-cb2f76c3ad22 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:48.423823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7048e-9a9b-4a59-b499-a3b2e6b00c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:48.424662 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7048e-9a9b-4a59-b499-a3b2e6b00c9b admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:48.425072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7048e-9a9b-4a59-b499-a3b2e6b00c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:48.425470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7048e-9a9b-4a59-b499-a3b2e6b00c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:48.426460 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7048e-9a9b-4a59-b499-a3b2e6b00c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:48.426587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e2a33-eb24-4105-950c-4f94e0a0ffa7 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:48.429015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7048e-9a9b-4a59-b499-a3b2e6b00c9b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:48.432114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8a70d-1aec-4d2c-b555-87f5d9bfa7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:48.432775 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8a70d-1aec-4d2c-b555-87f5d9bfa7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:48.433055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8a70d-1aec-4d2c-b555-87f5d9bfa7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:48.433330 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8a70d-1aec-4d2c-b555-87f5d9bfa7c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:48.433961 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8a70d-1aec-4d2c-b555-87f5d9bfa7c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:48.436018 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8a70d-1aec-4d2c-b555-87f5d9bfa7c8 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:48.445618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1346/2729] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:17:48.449711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7048e-9a9b-4a59-b499-a3b2e6b00c9b admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:48.461251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7048e-9a9b-4a59-b499-a3b2e6b00c9b admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:48.465957 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b7d02-c336-4420-aea8-d1123c0f023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:48.466614 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b7d02-c336-4420-aea8-d1123c0f023e admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:48.468073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b7d02-c336-4420-aea8-d1123c0f023e admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:48.468073 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b7d02-c336-4420-aea8-d1123c0f023e admin admin] PATH_INFO: `/v3/projects/a667568ba5af446c8de878d4d7a3cd9f/users/1ad5a427e1844b62a4ea3cf75527eca3/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:48.469114 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b7d02-c336-4420-aea8-d1123c0f023e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a667568ba5af446c8de878d4d7a3cd9f, user_id=1ad5a427e1844b62a4ea3cf75527eca3, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:48.471750 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b7d02-c336-4420-aea8-d1123c0f023e admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:48.482097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1347/2730] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:48 2022] PUT /identity/v3/projects/a667568ba5af446c8de878d4d7a3cd9f/users/1ad5a427e1844b62a4ea3cf75527eca3/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:48.492772 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f1446-dcda-427a-be87-b46e639d142c None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:48.499722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f1446-dcda-427a-be87-b46e639d142c None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:48.499722 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f1446-dcda-427a-be87-b46e639d142c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:48.521075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-616f1446-dcda-427a-be87-b46e639d142c None None] MFA Rules not processed for user `1ad5a427e1844b62a4ea3cf75527eca3`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:48.522289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-616f1446-dcda-427a-be87-b46e639d142c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:48.530238 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1384/2731] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:17:48 2022] POST /identity/v3/users => generated 306 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:48.534378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8a70d-1aec-4d2c-b555-87f5d9bfa7c8 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:48.537441 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:48.544284 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8a70d-1aec-4d2c-b555-87f5d9bfa7c8 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:48.598928 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1348/2732] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:17:48.606250 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b39dd-1b2e-4d55-8e67-22b8e9d0974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:48.613623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b39dd-1b2e-4d55-8e67-22b8e9d0974c admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:48.613623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b39dd-1b2e-4d55-8e67-22b8e9d0974c admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:48.613623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b39dd-1b2e-4d55-8e67-22b8e9d0974c admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:48.613623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b39dd-1b2e-4d55-8e67-22b8e9d0974c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:48.613623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b39dd-1b2e-4d55-8e67-22b8e9d0974c admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:48.614356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f1446-dcda-427a-be87-b46e639d142c None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:48.614712 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-616f1446-dcda-427a-be87-b46e639d142c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:48.626306 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1385/2733] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:17:48.627178 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b39dd-1b2e-4d55-8e67-22b8e9d0974c admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:48.638543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b39dd-1b2e-4d55-8e67-22b8e9d0974c admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:48.643993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baac562-7bd8-4df4-aba9-864e909271b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:48.644863 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baac562-7bd8-4df4-aba9-864e909271b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:48.645140 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baac562-7bd8-4df4-aba9-864e909271b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:48.645414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baac562-7bd8-4df4-aba9-864e909271b4 admin admin] PATH_INFO: `/v3/projects/e8ea6fc505d94e1eb95343a7c4f5faf6/users/476e10cd39a343a5bf622a6acdac8cc7/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:48.664872 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baac562-7bd8-4df4-aba9-864e909271b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ea6fc505d94e1eb95343a7c4f5faf6, user_id=476e10cd39a343a5bf622a6acdac8cc7, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:48.669071 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baac562-7bd8-4df4-aba9-864e909271b4 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:48.692001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f1446-dcda-427a-be87-b46e639d142c None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:48.692001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795f511-3f9b-4c20-a6d4-bcf38c2b2798 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:48.692001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795f511-3f9b-4c20-a6d4-bcf38c2b2798 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:48.692001 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795f511-3f9b-4c20-a6d4-bcf38c2b2798 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:48.692531 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795f511-3f9b-4c20-a6d4-bcf38c2b2798 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:48.702701 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795f511-3f9b-4c20-a6d4-bcf38c2b2798 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:48.704200 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795f511-3f9b-4c20-a6d4-bcf38c2b2798 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:48.716160 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1349/2734] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:48.792274 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1386/2735] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:48 2022] PUT /identity/v3/projects/e8ea6fc505d94e1eb95343a7c4f5faf6/users/476e10cd39a343a5bf622a6acdac8cc7/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:17:48.796501 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795f511-3f9b-4c20-a6d4-bcf38c2b2798 service cinder] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:48.807371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795f511-3f9b-4c20-a6d4-bcf38c2b2798 service cinder] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:48.868197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61497e1d-2b81-40fa-9cff-04f2f5f3d088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:48.868816 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61497e1d-2b81-40fa-9cff-04f2f5f3d088 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:48.869099 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61497e1d-2b81-40fa-9cff-04f2f5f3d088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:48.869372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61497e1d-2b81-40fa-9cff-04f2f5f3d088 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:48.870012 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61497e1d-2b81-40fa-9cff-04f2f5f3d088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:48.871662 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61497e1d-2b81-40fa-9cff-04f2f5f3d088 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:48.881848 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1350/2736] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:48.895710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baac562-7bd8-4df4-aba9-864e909271b4 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:48.898752 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baac562-7bd8-4df4-aba9-864e909271b4 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:48.903404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7f4f2-1bb9-44d4-9af7-35a2510958e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:48.904086 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7f4f2-1bb9-44d4-9af7-35a2510958e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:48.904367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7f4f2-1bb9-44d4-9af7-35a2510958e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:48.904637 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7f4f2-1bb9-44d4-9af7-35a2510958e6 admin admin] PATH_INFO: `/v3/projects/e8ea6fc505d94e1eb95343a7c4f5faf6/users/476e10cd39a343a5bf622a6acdac8cc7/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:48.906540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7f4f2-1bb9-44d4-9af7-35a2510958e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ea6fc505d94e1eb95343a7c4f5faf6, user_id=476e10cd39a343a5bf622a6acdac8cc7, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:48.909198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7f4f2-1bb9-44d4-9af7-35a2510958e6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:48.920729 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1387/2737] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:48 2022] PUT /identity/v3/projects/e8ea6fc505d94e1eb95343a7c4f5faf6/users/476e10cd39a343a5bf622a6acdac8cc7/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:48.939315 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea518bd-be1c-4b37-8542-5d650e616f23 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:48.939602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea518bd-be1c-4b37-8542-5d650e616f23 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:48.939888 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea518bd-be1c-4b37-8542-5d650e616f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:48.969832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-2ea518bd-be1c-4b37-8542-5d650e616f23 None None] MFA Rules not processed for user `476e10cd39a343a5bf622a6acdac8cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:48.970971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2ea518bd-be1c-4b37-8542-5d650e616f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:49.004777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:49.046583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1351/2738] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:48 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:49.053832 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7f4f2-1bb9-44d4-9af7-35a2510958e6 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:49.054211 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea518bd-be1c-4b37-8542-5d650e616f23 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:49.056148 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2ea518bd-be1c-4b37-8542-5d650e616f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:49.059476 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:49.111949 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7f4f2-1bb9-44d4-9af7-35a2510958e6 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:49.112681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea518bd-be1c-4b37-8542-5d650e616f23 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:49.115546 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8d80b-79fb-46a1-aa1c-70d088ae5d94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:49.116188 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8d80b-79fb-46a1-aa1c-70d088ae5d94 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:49.116297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9b5e4-8d4a-440e-baa8-854c908a50b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:49.116587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8d80b-79fb-46a1-aa1c-70d088ae5d94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:49.116789 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8d80b-79fb-46a1-aa1c-70d088ae5d94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:49.116959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9b5e4-8d4a-440e-baa8-854c908a50b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:49.117245 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9b5e4-8d4a-440e-baa8-854c908a50b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:49.117521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9b5e4-8d4a-440e-baa8-854c908a50b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:49.125936 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8d80b-79fb-46a1-aa1c-70d088ae5d94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:49.127420 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8d80b-79fb-46a1-aa1c-70d088ae5d94 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:49.137887 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1388/2739] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:49 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:49.179019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9b5e4-8d4a-440e-baa8-854c908a50b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:49.183380 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9b5e4-8d4a-440e-baa8-854c908a50b7 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:49.190007 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1352/2740] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:17:49.479758 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8d80b-79fb-46a1-aa1c-70d088ae5d94 service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:49.488454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8d80b-79fb-46a1-aa1c-70d088ae5d94 service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:49.492043 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa50043-3301-4cb4-a41f-25aea7977a6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:49.492635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa50043-3301-4cb4-a41f-25aea7977a6f service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:49.492915 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa50043-3301-4cb4-a41f-25aea7977a6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:49.493186 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa50043-3301-4cb4-a41f-25aea7977a6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:49.549006 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa50043-3301-4cb4-a41f-25aea7977a6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:49.550432 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa50043-3301-4cb4-a41f-25aea7977a6f service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:49.562513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1389/2741] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:49 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:55.362048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9b5e4-8d4a-440e-baa8-854c908a50b7 service cinder] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:55.428691 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9b5e4-8d4a-440e-baa8-854c908a50b7 service cinder] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:55.433297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608bf22-5073-4969-a0a0-aae95e3497de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:55.433920 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608bf22-5073-4969-a0a0-aae95e3497de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:55.434198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608bf22-5073-4969-a0a0-aae95e3497de admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:55.434469 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608bf22-5073-4969-a0a0-aae95e3497de admin admin] PATH_INFO: `/v3/users/47cda91b87264324b0970b6b9c00c3bc` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:55.435582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608bf22-5073-4969-a0a0-aae95e3497de admin admin] RBAC: Authorizing `identity:delete_user(user_id=47cda91b87264324b0970b6b9c00c3bc)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:55.437515 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608bf22-5073-4969-a0a0-aae95e3497de admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:55.528559 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:55.623936 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1608bf22-5073-4969-a0a0-aae95e3497de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47cda91b87264324b0970b6b9c00c3bc'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:55.624605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1608bf22-5073-4969-a0a0-aae95e3497de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47cda91b87264324b0970b6b9c00c3bc'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:55.636993 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1608bf22-5073-4969-a0a0-aae95e3497de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47cda91b87264324b0970b6b9c00c3bc'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:55.832586 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1608bf22-5073-4969-a0a0-aae95e3497de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47cda91b87264324b0970b6b9c00c3bc'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:55.833244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1608bf22-5073-4969-a0a0-aae95e3497de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47cda91b87264324b0970b6b9c00c3bc'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:55.846886 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1353/2742] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:17:55 2022] DELETE /identity/v3/users/47cda91b87264324b0970b6b9c00c3bc => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:55.852063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845dac1-8bf2-4e51-b538-07ed56275380 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:55.852548 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845dac1-8bf2-4e51-b538-07ed56275380 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:55.852648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845dac1-8bf2-4e51-b538-07ed56275380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:55.872894 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-a845dac1-8bf2-4e51-b538-07ed56275380 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:55.874117 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a845dac1-8bf2-4e51-b538-07ed56275380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:55.934606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1390/2743] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:55.944630 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608bf22-5073-4969-a0a0-aae95e3497de admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:55.946107 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1608bf22-5073-4969-a0a0-aae95e3497de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:56.007364 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608bf22-5073-4969-a0a0-aae95e3497de admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:56.011113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb4408-0866-42f5-8e54-bd4174ca55a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:56.011890 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb4408-0866-42f5-8e54-bd4174ca55a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:56.012278 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb4408-0866-42f5-8e54-bd4174ca55a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:56.012559 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb4408-0866-42f5-8e54-bd4174ca55a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:56.022292 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb4408-0866-42f5-8e54-bd4174ca55a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:56.024505 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb4408-0866-42f5-8e54-bd4174ca55a8 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:56.034156 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1354/2744] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:56.506364 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845dac1-8bf2-4e51-b538-07ed56275380 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:56.508546 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a845dac1-8bf2-4e51-b538-07ed56275380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:56.523964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845dac1-8bf2-4e51-b538-07ed56275380 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:56.529232 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:56.529901 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:56.530182 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:56.532948 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f admin admin] PATH_INFO: `/v3/projects/3a5f307be6a642b885463d0e3b38e4dc` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:56.532948 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5f307be6a642b885463d0e3b38e4dc)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:56.534457 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:56.691040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:56.699332 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5f307be6a642b885463d0e3b38e4dc', 'request_id': 'req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:56.792209 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5f307be6a642b885463d0e3b38e4dc', 'request_id': 'req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:56.799174 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5f307be6a642b885463d0e3b38e4dc', 'request_id': 'req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:56.811124 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f admin admin] The token cache is being invalidate because project 3a5f307be6a642b885463d0e3b38e4dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:56.811554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:56.812640 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:56.814722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1391/2745] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:17:56 2022] DELETE /identity/v3/projects/3a5f307be6a642b885463d0e3b38e4dc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:56.821108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb4408-0866-42f5-8e54-bd4174ca55a8 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:56.835934 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb4408-0866-42f5-8e54-bd4174ca55a8 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:56.903119 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e02321-e03f-45f8-b1ad-de9e00b7ee89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:56.903793 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e02321-e03f-45f8-b1ad-de9e00b7ee89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:56.904107 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e02321-e03f-45f8-b1ad-de9e00b7ee89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:56.904383 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e02321-e03f-45f8-b1ad-de9e00b7ee89 admin admin] PATH_INFO: `/v3/users/476e10cd39a343a5bf622a6acdac8cc7` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:56.905514 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e02321-e03f-45f8-b1ad-de9e00b7ee89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=476e10cd39a343a5bf622a6acdac8cc7)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:56.907430 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e02321-e03f-45f8-b1ad-de9e00b7ee89 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:57.138778 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-68e02321-e03f-45f8-b1ad-de9e00b7ee89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476e10cd39a343a5bf622a6acdac8cc7'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:57.139443 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-68e02321-e03f-45f8-b1ad-de9e00b7ee89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476e10cd39a343a5bf622a6acdac8cc7'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:57.140627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:57.151938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-68e02321-e03f-45f8-b1ad-de9e00b7ee89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476e10cd39a343a5bf622a6acdac8cc7'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:57.247873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-68e02321-e03f-45f8-b1ad-de9e00b7ee89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476e10cd39a343a5bf622a6acdac8cc7'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:57.248806 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-68e02321-e03f-45f8-b1ad-de9e00b7ee89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476e10cd39a343a5bf622a6acdac8cc7'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:57.263926 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1355/2746] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:17:56 2022] DELETE /identity/v3/users/476e10cd39a343a5bf622a6acdac8cc7 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:57.842650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:57.845026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:57.869522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e3ba1-69ac-4abf-89cf-6d20adc8059f admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:57.934165 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f593a2-259e-4537-bf5f-dba50188b581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:57.934796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f593a2-259e-4537-bf5f-dba50188b581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:57.935081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f593a2-259e-4537-bf5f-dba50188b581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:57.935358 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f593a2-259e-4537-bf5f-dba50188b581 admin admin] PATH_INFO: `/v3/projects/e8ea6fc505d94e1eb95343a7c4f5faf6` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:57.936508 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f593a2-259e-4537-bf5f-dba50188b581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ea6fc505d94e1eb95343a7c4f5faf6)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:57.938410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f593a2-259e-4537-bf5f-dba50188b581 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:58.095441 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-75f593a2-259e-4537-bf5f-dba50188b581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ea6fc505d94e1eb95343a7c4f5faf6', 'request_id': 'req-75f593a2-259e-4537-bf5f-dba50188b581'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:58.203650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-75f593a2-259e-4537-bf5f-dba50188b581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ea6fc505d94e1eb95343a7c4f5faf6', 'request_id': 'req-75f593a2-259e-4537-bf5f-dba50188b581'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:58.210831 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-75f593a2-259e-4537-bf5f-dba50188b581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ea6fc505d94e1eb95343a7c4f5faf6', 'request_id': 'req-75f593a2-259e-4537-bf5f-dba50188b581'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:58.221888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-75f593a2-259e-4537-bf5f-dba50188b581 admin admin] The token cache is being invalidate because project e8ea6fc505d94e1eb95343a7c4f5faf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:17:58.222185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-75f593a2-259e-4537-bf5f-dba50188b581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:58.222853 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-75f593a2-259e-4537-bf5f-dba50188b581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:58.224541 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1392/2747] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:17:57 2022] DELETE /identity/v3/projects/e8ea6fc505d94e1eb95343a7c4f5faf6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:58.236664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e44e7-3b5c-4e3f-b96e-0eaa4625704a None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:58.237192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e44e7-3b5c-4e3f-b96e-0eaa4625704a None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:58.237281 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e44e7-3b5c-4e3f-b96e-0eaa4625704a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:58.258296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e57e44e7-3b5c-4e3f-b96e-0eaa4625704a None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:58.259536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e57e44e7-3b5c-4e3f-b96e-0eaa4625704a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:58.318194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1356/2748] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:17:58.326739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c01c4-a44b-4fd4-a992-fbb723356a67 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:58.327030 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c01c4-a44b-4fd4-a992-fbb723356a67 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:58.327306 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c01c4-a44b-4fd4-a992-fbb723356a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:58.348494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-b56c01c4-a44b-4fd4-a992-fbb723356a67 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:58.349714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-b56c01c4-a44b-4fd4-a992-fbb723356a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:58.357863 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1393/2749] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:58.362229 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e44e7-3b5c-4e3f-b96e-0eaa4625704a None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:58.372791 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e44e7-3b5c-4e3f-b96e-0eaa4625704a None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:58.377475 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32482e45-9ec8-484b-a4a7-de3efc52bb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:58.378016 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32482e45-9ec8-484b-a4a7-de3efc52bb2a admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:58.378295 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32482e45-9ec8-484b-a4a7-de3efc52bb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:58.378564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32482e45-9ec8-484b-a4a7-de3efc52bb2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:58.379205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32482e45-9ec8-484b-a4a7-de3efc52bb2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:17:58.379526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32482e45-9ec8-484b-a4a7-de3efc52bb2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:58.381153 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32482e45-9ec8-484b-a4a7-de3efc52bb2a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:58.393610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1357/2750] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:17:58.398143 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c01c4-a44b-4fd4-a992-fbb723356a67 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:58.407701 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c01c4-a44b-4fd4-a992-fbb723356a67 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:58.413893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49378a-28fb-4913-b0ac-385231ac5776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:58.413893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49378a-28fb-4913-b0ac-385231ac5776 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:58.413893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49378a-28fb-4913-b0ac-385231ac5776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:58.413893 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49378a-28fb-4913-b0ac-385231ac5776 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:58.414602 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49378a-28fb-4913-b0ac-385231ac5776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:58.416527 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49378a-28fb-4913-b0ac-385231ac5776 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:58.539909 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1394/2751] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:17:58 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:17:58.541745 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32482e45-9ec8-484b-a4a7-de3efc52bb2a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:58.552337 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32482e45-9ec8-484b-a4a7-de3efc52bb2a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:58.612940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36dc757-faf2-444e-b76c-f0f41b28318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:58.613555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dc757-faf2-444e-b76c-f0f41b28318f admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:58.613841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dc757-faf2-444e-b76c-f0f41b28318f admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:58.614166 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dc757-faf2-444e-b76c-f0f41b28318f admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:58.614805 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36dc757-faf2-444e-b76c-f0f41b28318f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:58.617320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36dc757-faf2-444e-b76c-f0f41b28318f admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:58.734103 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1358/2752] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:17:58 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:17:58.738239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49378a-28fb-4913-b0ac-385231ac5776 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:58.749464 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49378a-28fb-4913-b0ac-385231ac5776 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:58.754042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e55ccb-5f87-4453-ab17-a11ad1a50f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:58.754630 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e55ccb-5f87-4453-ab17-a11ad1a50f5a admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:58.754905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e55ccb-5f87-4453-ab17-a11ad1a50f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:58.755206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e55ccb-5f87-4453-ab17-a11ad1a50f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:58.755838 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e55ccb-5f87-4453-ab17-a11ad1a50f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:58.757971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e55ccb-5f87-4453-ab17-a11ad1a50f5a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:58.768596 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1395/2753] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:58.772770 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36dc757-faf2-444e-b76c-f0f41b28318f admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:58.783893 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36dc757-faf2-444e-b76c-f0f41b28318f admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:58.789889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a94a0-1bba-4a95-9e8f-41b1936a1309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:58.790512 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a94a0-1bba-4a95-9e8f-41b1936a1309 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:58.790851 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a94a0-1bba-4a95-9e8f-41b1936a1309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:58.791133 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a94a0-1bba-4a95-9e8f-41b1936a1309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:58.791786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a94a0-1bba-4a95-9e8f-41b1936a1309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:58.793447 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a94a0-1bba-4a95-9e8f-41b1936a1309 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:58.805076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1359/2754] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:17:58.809325 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e55ccb-5f87-4453-ab17-a11ad1a50f5a admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:58.820096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e55ccb-5f87-4453-ab17-a11ad1a50f5a admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:58.824678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aff13b-a7fe-4aae-bb01-ca04f982be50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:58.825459 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aff13b-a7fe-4aae-bb01-ca04f982be50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:58.825602 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aff13b-a7fe-4aae-bb01-ca04f982be50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:58.825930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aff13b-a7fe-4aae-bb01-ca04f982be50 admin admin] PATH_INFO: `/v3/projects/edfb488a8c8e49a5a5ee299aaafb9e11/users/f8384748a2c64d1aacaaa198b0651425/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:58.842114 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aff13b-a7fe-4aae-bb01-ca04f982be50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edfb488a8c8e49a5a5ee299aaafb9e11, user_id=f8384748a2c64d1aacaaa198b0651425, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:58.844834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aff13b-a7fe-4aae-bb01-ca04f982be50 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:58.847095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:58.981853 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1396/2755] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:17:58 2022] PUT /identity/v3/projects/edfb488a8c8e49a5a5ee299aaafb9e11/users/f8384748a2c64d1aacaaa198b0651425/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:58.992543 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8764d2f-0e02-465f-9257-73e617bf811a None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:58.992755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8764d2f-0e02-465f-9257-73e617bf811a None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:58.993035 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8764d2f-0e02-465f-9257-73e617bf811a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:59.021777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b8764d2f-0e02-465f-9257-73e617bf811a None None] MFA Rules not processed for user `f8384748a2c64d1aacaaa198b0651425`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:59.023497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b8764d2f-0e02-465f-9257-73e617bf811a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:59.042847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:59.091608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1360/2756] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:59.103578 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aff13b-a7fe-4aae-bb01-ca04f982be50 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:59.105333 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-43aff13b-a7fe-4aae-bb01-ca04f982be50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:59.169535 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aff13b-a7fe-4aae-bb01-ca04f982be50 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:59.176123 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d4b9-3c42-4a9e-9fe0-2778e2ad94b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:59.176738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d4b9-3c42-4a9e-9fe0-2778e2ad94b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:59.177076 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d4b9-3c42-4a9e-9fe0-2778e2ad94b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:59.177465 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d4b9-3c42-4a9e-9fe0-2778e2ad94b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:59.187970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84d4b9-3c42-4a9e-9fe0-2778e2ad94b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:59.188270 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84d4b9-3c42-4a9e-9fe0-2778e2ad94b7 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:59.198424 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1397/2757] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:17:59.225813 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8764d2f-0e02-465f-9257-73e617bf811a None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:59.289608 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8764d2f-0e02-465f-9257-73e617bf811a None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:59.295065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a373f-ef2c-4812-bd68-c9f70eeeff23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:59.295713 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a373f-ef2c-4812-bd68-c9f70eeeff23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:59.296629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a373f-ef2c-4812-bd68-c9f70eeeff23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:59.296908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a373f-ef2c-4812-bd68-c9f70eeeff23 admin admin] PATH_INFO: `/v3/users/f8384748a2c64d1aacaaa198b0651425` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:59.298096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a373f-ef2c-4812-bd68-c9f70eeeff23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8384748a2c64d1aacaaa198b0651425)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:59.300056 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a373f-ef2c-4812-bd68-c9f70eeeff23 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:59.598781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-bf7a373f-ef2c-4812-bd68-c9f70eeeff23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8384748a2c64d1aacaaa198b0651425'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:59.599359 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-bf7a373f-ef2c-4812-bd68-c9f70eeeff23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8384748a2c64d1aacaaa198b0651425'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:59.612284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-bf7a373f-ef2c-4812-bd68-c9f70eeeff23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8384748a2c64d1aacaaa198b0651425'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:59.762532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-bf7a373f-ef2c-4812-bd68-c9f70eeeff23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8384748a2c64d1aacaaa198b0651425'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:59.763164 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-bf7a373f-ef2c-4812-bd68-c9f70eeeff23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8384748a2c64d1aacaaa198b0651425'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:17:59.777358 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1361/2758] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:17:59 2022] DELETE /identity/v3/users/f8384748a2c64d1aacaaa198b0651425 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:17:59.782029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fc04e-db7a-412b-81a2-572a2eeb2c07 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:59.782324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fc04e-db7a-412b-81a2-572a2eeb2c07 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:59.782599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fc04e-db7a-412b-81a2-572a2eeb2c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:59.802102 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-fd4fc04e-db7a-412b-81a2-572a2eeb2c07 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:17:59.803317 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fd4fc04e-db7a-412b-81a2-572a2eeb2c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:59.862646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1398/2759] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:17:59.872401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a373f-ef2c-4812-bd68-c9f70eeeff23 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:17:59.873801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bf7a373f-ef2c-4812-bd68-c9f70eeeff23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:17:59.926627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:17:59.941725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a373f-ef2c-4812-bd68-c9f70eeeff23 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:17:59.945979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83858c6a-a734-4415-9814-980603f311a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:17:59.946597 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83858c6a-a734-4415-9814-980603f311a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:17:59.946880 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83858c6a-a734-4415-9814-980603f311a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:17:59.947152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83858c6a-a734-4415-9814-980603f311a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:17:59.957204 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83858c6a-a734-4415-9814-980603f311a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:17:59.958639 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83858c6a-a734-4415-9814-980603f311a8 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:17:59.968392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1362/2760] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:18:00.761218 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fc04e-db7a-412b-81a2-572a2eeb2c07 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:00.762657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-fd4fc04e-db7a-412b-81a2-572a2eeb2c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:00.775173 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fc04e-db7a-412b-81a2-572a2eeb2c07 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:00.780064 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7daef-0263-4d9e-bb77-cad656ac3495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:00.780631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7daef-0263-4d9e-bb77-cad656ac3495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:00.780951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7daef-0263-4d9e-bb77-cad656ac3495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:00.781176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7daef-0263-4d9e-bb77-cad656ac3495 admin admin] PATH_INFO: `/v3/projects/edfb488a8c8e49a5a5ee299aaafb9e11` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:00.782575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7daef-0263-4d9e-bb77-cad656ac3495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edfb488a8c8e49a5a5ee299aaafb9e11)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:00.784634 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7daef-0263-4d9e-bb77-cad656ac3495 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:01.011230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e9a7daef-0263-4d9e-bb77-cad656ac3495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edfb488a8c8e49a5a5ee299aaafb9e11', 'request_id': 'req-e9a7daef-0263-4d9e-bb77-cad656ac3495'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:01.146088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e9a7daef-0263-4d9e-bb77-cad656ac3495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edfb488a8c8e49a5a5ee299aaafb9e11', 'request_id': 'req-e9a7daef-0263-4d9e-bb77-cad656ac3495'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:01.154180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e9a7daef-0263-4d9e-bb77-cad656ac3495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edfb488a8c8e49a5a5ee299aaafb9e11', 'request_id': 'req-e9a7daef-0263-4d9e-bb77-cad656ac3495'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:01.165698 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e9a7daef-0263-4d9e-bb77-cad656ac3495 admin admin] The token cache is being invalidate because project edfb488a8c8e49a5a5ee299aaafb9e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:18:01.165996 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e9a7daef-0263-4d9e-bb77-cad656ac3495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:01.166663 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-e9a7daef-0263-4d9e-bb77-cad656ac3495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:01.168184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1399/2761] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:18:00 2022] DELETE /identity/v3/projects/edfb488a8c8e49a5a5ee299aaafb9e11 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:01.173256 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a1c15-4448-4005-a9c5-ac3df4d30c39 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:01.173659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a1c15-4448-4005-a9c5-ac3df4d30c39 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:01.173827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a1c15-4448-4005-a9c5-ac3df4d30c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:01.194274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-606a1c15-4448-4005-a9c5-ac3df4d30c39 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:01.195547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-606a1c15-4448-4005-a9c5-ac3df4d30c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:01.256238 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1363/2762] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:01.265836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a10e-587f-4cdf-ba71-cfc8c79356e9 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:01.266128 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a10e-587f-4cdf-ba71-cfc8c79356e9 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:01.266412 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a10e-587f-4cdf-ba71-cfc8c79356e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:01.286964 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-d7f8a10e-587f-4cdf-ba71-cfc8c79356e9 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:01.288267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d7f8a10e-587f-4cdf-ba71-cfc8c79356e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:01.296775 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1400/2763] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:01.305888 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a1c15-4448-4005-a9c5-ac3df4d30c39 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:01.316461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a1c15-4448-4005-a9c5-ac3df4d30c39 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:01.321723 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dfb5b-7d7b-4cf5-ae26-364843d250f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:01.322340 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dfb5b-7d7b-4cf5-ae26-364843d250f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:01.322629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dfb5b-7d7b-4cf5-ae26-364843d250f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:01.322902 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dfb5b-7d7b-4cf5-ae26-364843d250f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:01.323548 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dfb5b-7d7b-4cf5-ae26-364843d250f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:18:01.323854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dfb5b-7d7b-4cf5-ae26-364843d250f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:01.325481 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dfb5b-7d7b-4cf5-ae26-364843d250f7 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:01.338051 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1364/2764] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:18:01.357560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8a10e-587f-4cdf-ba71-cfc8c79356e9 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:01.367300 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8a10e-587f-4cdf-ba71-cfc8c79356e9 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:01.372063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba21e-2688-4151-b207-558832481319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:01.372657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba21e-2688-4151-b207-558832481319 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:01.372937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba21e-2688-4151-b207-558832481319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:01.373289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba21e-2688-4151-b207-558832481319 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:01.373929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aba21e-2688-4151-b207-558832481319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:01.375854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aba21e-2688-4151-b207-558832481319 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:01.388150 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:01.506653 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1401/2765] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:18:01 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:01.511457 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dfb5b-7d7b-4cf5-ae26-364843d250f7 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:01.521783 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dfb5b-7d7b-4cf5-ae26-364843d250f7 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:01.579599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b4a91-20ea-4228-b088-a9bb5a8441d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:01.580423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4a91-20ea-4228-b088-a9bb5a8441d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:01.580709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4a91-20ea-4228-b088-a9bb5a8441d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:01.580988 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4a91-20ea-4228-b088-a9bb5a8441d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:01.581631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b4a91-20ea-4228-b088-a9bb5a8441d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:01.583543 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b4a91-20ea-4228-b088-a9bb5a8441d2 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:01.724355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1365/2766] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:18:01 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:01.729197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba21e-2688-4151-b207-558832481319 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:01.740028 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba21e-2688-4151-b207-558832481319 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:01.745276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce00c4-c1ad-417a-bb43-671549497566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:01.746107 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce00c4-c1ad-417a-bb43-671549497566 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:01.746693 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce00c4-c1ad-417a-bb43-671549497566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:01.747107 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce00c4-c1ad-417a-bb43-671549497566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:01.747755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce00c4-c1ad-417a-bb43-671549497566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:01.749408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce00c4-c1ad-417a-bb43-671549497566 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:01.760069 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1402/2767] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:01.764161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b4a91-20ea-4228-b088-a9bb5a8441d2 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:01.774757 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b4a91-20ea-4228-b088-a9bb5a8441d2 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:01.779742 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ba987-ae02-4d88-af1d-75561fe68333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:01.780395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ba987-ae02-4d88-af1d-75561fe68333 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:01.784372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ba987-ae02-4d88-af1d-75561fe68333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:01.784372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ba987-ae02-4d88-af1d-75561fe68333 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:01.784372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ba987-ae02-4d88-af1d-75561fe68333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:01.784372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ba987-ae02-4d88-af1d-75561fe68333 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:01.795545 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1366/2768] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:01.799462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce00c4-c1ad-417a-bb43-671549497566 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:01.810184 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce00c4-c1ad-417a-bb43-671549497566 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:01.814764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f9d8f-02db-40d6-8b30-67cdc203adf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:01.815413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f9d8f-02db-40d6-8b30-67cdc203adf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:01.815696 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f9d8f-02db-40d6-8b30-67cdc203adf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:01.816002 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f9d8f-02db-40d6-8b30-67cdc203adf4 admin admin] PATH_INFO: `/v3/projects/ab4b20f04fd846f7a935b76d88d1f52d/users/aa583c926533453a8e48added4a22a54/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:01.831724 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f9d8f-02db-40d6-8b30-67cdc203adf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4b20f04fd846f7a935b76d88d1f52d, user_id=aa583c926533453a8e48added4a22a54, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:01.834328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f9d8f-02db-40d6-8b30-67cdc203adf4 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:01.941410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1403/2769] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:01 2022] PUT /identity/v3/projects/ab4b20f04fd846f7a935b76d88d1f52d/users/aa583c926533453a8e48added4a22a54/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:01.955421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cc364-bf21-4a11-9df1-007e8828f3d8 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:01.955705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cc364-bf21-4a11-9df1-007e8828f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:01.956084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9cc364-bf21-4a11-9df1-007e8828f3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:01.988929 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-3d9cc364-bf21-4a11-9df1-007e8828f3d8 None None] MFA Rules not processed for user `aa583c926533453a8e48added4a22a54`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:01.990126 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-3d9cc364-bf21-4a11-9df1-007e8828f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:02.028874 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:02.054803 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1367/2770] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:02.059983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f9d8f-02db-40d6-8b30-67cdc203adf4 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:02.136146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f9d8f-02db-40d6-8b30-67cdc203adf4 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:02.140929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30925a-d131-4f90-a8d6-636a08d971d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:02.141542 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30925a-d131-4f90-a8d6-636a08d971d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:02.141826 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30925a-d131-4f90-a8d6-636a08d971d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:02.142133 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30925a-d131-4f90-a8d6-636a08d971d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:02.142780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30925a-d131-4f90-a8d6-636a08d971d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:02.144719 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30925a-d131-4f90-a8d6-636a08d971d2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:02.292063 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1404/2771] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:18:02 2022] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:02.303635 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cc364-bf21-4a11-9df1-007e8828f3d8 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:02.314448 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9cc364-bf21-4a11-9df1-007e8828f3d8 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:02.372214 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1ad08-76e4-40d0-93ec-c79ed6931077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:02.372746 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1ad08-76e4-40d0-93ec-c79ed6931077 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:02.373027 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1ad08-76e4-40d0-93ec-c79ed6931077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:02.373299 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1ad08-76e4-40d0-93ec-c79ed6931077 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:02.373939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1ad08-76e4-40d0-93ec-c79ed6931077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:02.375991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1ad08-76e4-40d0-93ec-c79ed6931077 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:02.487050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30925a-d131-4f90-a8d6-636a08d971d2 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:02.488900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-5c30925a-d131-4f90-a8d6-636a08d971d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:02.501216 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30925a-d131-4f90-a8d6-636a08d971d2 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:02.501644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1368/2772] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:18:02 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:02.505828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1ad08-76e4-40d0-93ec-c79ed6931077 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:02.508212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aee33b-a109-4c73-b049-82702f39aa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:02.508822 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aee33b-a109-4c73-b049-82702f39aa32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:02.509098 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aee33b-a109-4c73-b049-82702f39aa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:02.509373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aee33b-a109-4c73-b049-82702f39aa32 admin admin] PATH_INFO: `/v3/users/eb7a10b72e304a01b2e888340ec14d02` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:02.510491 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aee33b-a109-4c73-b049-82702f39aa32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7a10b72e304a01b2e888340ec14d02)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:02.512436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aee33b-a109-4c73-b049-82702f39aa32 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:02.516278 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1ad08-76e4-40d0-93ec-c79ed6931077 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:02.521197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badead9-82c1-4cd8-ad4d-433bc42da3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:02.521829 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badead9-82c1-4cd8-ad4d-433bc42da3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:02.522113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badead9-82c1-4cd8-ad4d-433bc42da3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:02.522423 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badead9-82c1-4cd8-ad4d-433bc42da3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:02.523796 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badead9-82c1-4cd8-ad4d-433bc42da3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:02.525601 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badead9-82c1-4cd8-ad4d-433bc42da3c3 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:02.535700 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1369/2773] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:02.539945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badead9-82c1-4cd8-ad4d-433bc42da3c3 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:02.549427 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badead9-82c1-4cd8-ad4d-433bc42da3c3 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:02.554116 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d02ccd-ff51-48c8-887e-3f6a691a6064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:02.554771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d02ccd-ff51-48c8-887e-3f6a691a6064 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:02.555034 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d02ccd-ff51-48c8-887e-3f6a691a6064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:02.555312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d02ccd-ff51-48c8-887e-3f6a691a6064 admin admin] PATH_INFO: `/v3/projects/e7fc70809e4b4f649aa8314a10d938cf/users/b10e52e83ca74b78ba6ed67f016d6f48/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:02.571093 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d02ccd-ff51-48c8-887e-3f6a691a6064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fc70809e4b4f649aa8314a10d938cf, user_id=b10e52e83ca74b78ba6ed67f016d6f48, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:02.573871 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d02ccd-ff51-48c8-887e-3f6a691a6064 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:02.686338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1370/2774] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:02 2022] PUT /identity/v3/projects/e7fc70809e4b4f649aa8314a10d938cf/users/b10e52e83ca74b78ba6ed67f016d6f48/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:18:02.690305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d02ccd-ff51-48c8-887e-3f6a691a6064 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:02.725702 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f1aee33b-a109-4c73-b049-82702f39aa32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7a10b72e304a01b2e888340ec14d02'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:02.737753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f1aee33b-a109-4c73-b049-82702f39aa32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7a10b72e304a01b2e888340ec14d02'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:02.753110 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d02ccd-ff51-48c8-887e-3f6a691a6064 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:02.758290 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43537172-1c2b-4a87-bb18-5ffc080f47ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:02.758892 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43537172-1c2b-4a87-bb18-5ffc080f47ef admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:02.759167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43537172-1c2b-4a87-bb18-5ffc080f47ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:02.759436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43537172-1c2b-4a87-bb18-5ffc080f47ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:02.760100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43537172-1c2b-4a87-bb18-5ffc080f47ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:02.761678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43537172-1c2b-4a87-bb18-5ffc080f47ef admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:02.771259 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1371/2775] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:18:02.775483 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43537172-1c2b-4a87-bb18-5ffc080f47ef admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:02.784600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43537172-1c2b-4a87-bb18-5ffc080f47ef admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:02.789089 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf400145-150d-41ab-b413-1d7e28974f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:02.789694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf400145-150d-41ab-b413-1d7e28974f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:02.789974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf400145-150d-41ab-b413-1d7e28974f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:02.790244 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf400145-150d-41ab-b413-1d7e28974f4e admin admin] PATH_INFO: `/v3/projects/e7fc70809e4b4f649aa8314a10d938cf/users/b10e52e83ca74b78ba6ed67f016d6f48/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:02.792124 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf400145-150d-41ab-b413-1d7e28974f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fc70809e4b4f649aa8314a10d938cf, user_id=b10e52e83ca74b78ba6ed67f016d6f48, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:02.794658 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf400145-150d-41ab-b413-1d7e28974f4e admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:02.804912 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1372/2776] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:02 2022] PUT /identity/v3/projects/e7fc70809e4b4f649aa8314a10d938cf/users/b10e52e83ca74b78ba6ed67f016d6f48/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:18:02.815830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd070c7-e354-4a75-ae93-87766de0e5d1 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:02.816155 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd070c7-e354-4a75-ae93-87766de0e5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:02.816432 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd070c7-e354-4a75-ae93-87766de0e5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:02.847295 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-2dd070c7-e354-4a75-ae93-87766de0e5d1 None None] MFA Rules not processed for user `b10e52e83ca74b78ba6ed67f016d6f48`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:02.847295 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2dd070c7-e354-4a75-ae93-87766de0e5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:02.851389 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:02.866737 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f1aee33b-a109-4c73-b049-82702f39aa32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7a10b72e304a01b2e888340ec14d02'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:02.874488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f1aee33b-a109-4c73-b049-82702f39aa32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7a10b72e304a01b2e888340ec14d02'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:02.875297 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-f1aee33b-a109-4c73-b049-82702f39aa32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7a10b72e304a01b2e888340ec14d02'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:02.881710 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1405/2777] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:18:02 2022] DELETE /identity/v3/users/eb7a10b72e304a01b2e888340ec14d02 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:18:02.886465 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c838a39-6f62-408c-aa19-1877c52dbfe3 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:02.886754 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c838a39-6f62-408c-aa19-1877c52dbfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:02.887033 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c838a39-6f62-408c-aa19-1877c52dbfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:02.906111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-2c838a39-6f62-408c-aa19-1877c52dbfe3 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:02.910177 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2c838a39-6f62-408c-aa19-1877c52dbfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:02.915487 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:02.918547 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1373/2778] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:18:02.929681 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd070c7-e354-4a75-ae93-87766de0e5d1 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:02.931046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-2dd070c7-e354-4a75-ae93-87766de0e5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:02.968559 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1406/2779] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:02.978414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c838a39-6f62-408c-aa19-1877c52dbfe3 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:02.979814 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2c838a39-6f62-408c-aa19-1877c52dbfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:02.989599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd070c7-e354-4a75-ae93-87766de0e5d1 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:03.035853 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c838a39-6f62-408c-aa19-1877c52dbfe3 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:03.038920 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48613730-653a-4ef9-8a5b-ec21f3c68602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:03.039559 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48613730-653a-4ef9-8a5b-ec21f3c68602 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:03.039843 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48613730-653a-4ef9-8a5b-ec21f3c68602 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:03.040144 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48613730-653a-4ef9-8a5b-ec21f3c68602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:03.040517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0529ff-5756-4454-bba0-8517f51be6c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:03.041138 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0529ff-5756-4454-bba0-8517f51be6c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:03.041417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0529ff-5756-4454-bba0-8517f51be6c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:03.041764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0529ff-5756-4454-bba0-8517f51be6c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:03.041935 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-48613730-653a-4ef9-8a5b-ec21f3c68602 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:03.051047 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0529ff-5756-4454-bba0-8517f51be6c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:03.052509 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0529ff-5756-4454-bba0-8517f51be6c2 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:03.062546 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1407/2780] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:18:03.103111 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48613730-653a-4ef9-8a5b-ec21f3c68602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:03.104588 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48613730-653a-4ef9-8a5b-ec21f3c68602 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:03.113995 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1374/2781] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:18:03.486537 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0529ff-5756-4454-bba0-8517f51be6c2 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:03.488014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-9e0529ff-5756-4454-bba0-8517f51be6c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:03.501222 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0529ff-5756-4454-bba0-8517f51be6c2 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:03.506039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:03.506672 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:03.506987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:03.507268 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d admin admin] PATH_INFO: `/v3/projects/3807b87d8e2b406abdaa822c35b9ecea` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:03.508452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3807b87d8e2b406abdaa822c35b9ecea)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:03.510511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:03.746894 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3807b87d8e2b406abdaa822c35b9ecea', 'request_id': 'req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:03.900664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3807b87d8e2b406abdaa822c35b9ecea', 'request_id': 'req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:03.907540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3807b87d8e2b406abdaa822c35b9ecea', 'request_id': 'req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:03.918130 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d admin admin] The token cache is being invalidate because project 3807b87d8e2b406abdaa822c35b9ecea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:18:03.918418 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:03.919061 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:03.920631 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1408/2782] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:18:03 2022] DELETE /identity/v3/projects/3807b87d8e2b406abdaa822c35b9ecea => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:03.924775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48613730-653a-4ef9-8a5b-ec21f3c68602 service cinder] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:03.936537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48613730-653a-4ef9-8a5b-ec21f3c68602 service cinder] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:03.945537 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:04.006609 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde028ca-19aa-4151-bacd-df820ab38db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:04.007759 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde028ca-19aa-4151-bacd-df820ab38db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:04.008075 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde028ca-19aa-4151-bacd-df820ab38db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:04.008659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde028ca-19aa-4151-bacd-df820ab38db9 admin admin] PATH_INFO: `/v3/users/1ad5a427e1844b62a4ea3cf75527eca3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:04.009650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde028ca-19aa-4151-bacd-df820ab38db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad5a427e1844b62a4ea3cf75527eca3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:04.011567 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde028ca-19aa-4151-bacd-df820ab38db9 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:04.268943 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-dde028ca-19aa-4151-bacd-df820ab38db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad5a427e1844b62a4ea3cf75527eca3'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:04.269878 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-dde028ca-19aa-4151-bacd-df820ab38db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad5a427e1844b62a4ea3cf75527eca3'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:04.281677 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-dde028ca-19aa-4151-bacd-df820ab38db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad5a427e1844b62a4ea3cf75527eca3'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:04.374752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-dde028ca-19aa-4151-bacd-df820ab38db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad5a427e1844b62a4ea3cf75527eca3'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:04.375387 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-dde028ca-19aa-4151-bacd-df820ab38db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad5a427e1844b62a4ea3cf75527eca3'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:04.388792 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1375/2783] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:18:03 2022] DELETE /identity/v3/users/1ad5a427e1844b62a4ea3cf75527eca3 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:05.148272 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:05.149959 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:05.168037 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed666fcf-7e9e-4301-905a-2ee6d9ae387d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:05.206144 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:05.225469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ddadcb-ac95-48a6-95a8-fb149317e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:05.226681 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddadcb-ac95-48a6-95a8-fb149317e021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:05.226967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddadcb-ac95-48a6-95a8-fb149317e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:05.227239 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ddadcb-ac95-48a6-95a8-fb149317e021 admin admin] PATH_INFO: `/v3/projects/a667568ba5af446c8de878d4d7a3cd9f` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:05.228406 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddadcb-ac95-48a6-95a8-fb149317e021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a667568ba5af446c8de878d4d7a3cd9f)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:05.230282 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ddadcb-ac95-48a6-95a8-fb149317e021 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:05.363410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-52ddadcb-ac95-48a6-95a8-fb149317e021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a667568ba5af446c8de878d4d7a3cd9f', 'request_id': 'req-52ddadcb-ac95-48a6-95a8-fb149317e021'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:05.454800 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-52ddadcb-ac95-48a6-95a8-fb149317e021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a667568ba5af446c8de878d4d7a3cd9f', 'request_id': 'req-52ddadcb-ac95-48a6-95a8-fb149317e021'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:05.462146 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-52ddadcb-ac95-48a6-95a8-fb149317e021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a667568ba5af446c8de878d4d7a3cd9f', 'request_id': 'req-52ddadcb-ac95-48a6-95a8-fb149317e021'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:05.472664 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-52ddadcb-ac95-48a6-95a8-fb149317e021 admin admin] The token cache is being invalidate because project a667568ba5af446c8de878d4d7a3cd9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:18:05.472951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-52ddadcb-ac95-48a6-95a8-fb149317e021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:05.473582 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-52ddadcb-ac95-48a6-95a8-fb149317e021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:05.475039 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1409/2784] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:18:05 2022] DELETE /identity/v3/projects/a667568ba5af446c8de878d4d7a3cd9f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:05.479908 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612bb6c-e795-46be-b08e-e1ea1c72dd19 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:05.480400 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612bb6c-e795-46be-b08e-e1ea1c72dd19 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:05.480500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e612bb6c-e795-46be-b08e-e1ea1c72dd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:05.499785 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-e612bb6c-e795-46be-b08e-e1ea1c72dd19 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:05.500995 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-e612bb6c-e795-46be-b08e-e1ea1c72dd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:05.559320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1376/2785] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:05.567187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435d657-41d1-4848-9eae-c1f59eaaf849 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:05.567473 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435d657-41d1-4848-9eae-c1f59eaaf849 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:05.567750 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435d657-41d1-4848-9eae-c1f59eaaf849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:05.588135 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-c435d657-41d1-4848-9eae-c1f59eaaf849 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:05.589345 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-c435d657-41d1-4848-9eae-c1f59eaaf849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:05.597263 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1410/2786] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:05.601894 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612bb6c-e795-46be-b08e-e1ea1c72dd19 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:05.611709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e612bb6c-e795-46be-b08e-e1ea1c72dd19 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:05.616438 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e8639-4dfd-4768-bda9-bb9343b4e9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:05.617076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e8639-4dfd-4768-bda9-bb9343b4e9eb admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:05.617335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e8639-4dfd-4768-bda9-bb9343b4e9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:05.617605 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e8639-4dfd-4768-bda9-bb9343b4e9eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:05.618278 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e8639-4dfd-4768-bda9-bb9343b4e9eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:18:05.618580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e8639-4dfd-4768-bda9-bb9343b4e9eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:05.620584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e8639-4dfd-4768-bda9-bb9343b4e9eb admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:05.632728 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1377/2787] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:18:05.637110 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435d657-41d1-4848-9eae-c1f59eaaf849 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:05.646415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435d657-41d1-4848-9eae-c1f59eaaf849 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:05.651599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17341c-3ccd-4922-aaf6-7bd52b4ca9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:05.652233 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17341c-3ccd-4922-aaf6-7bd52b4ca9cf admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:05.652517 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17341c-3ccd-4922-aaf6-7bd52b4ca9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:05.652788 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17341c-3ccd-4922-aaf6-7bd52b4ca9cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:05.653417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17341c-3ccd-4922-aaf6-7bd52b4ca9cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:05.655315 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17341c-3ccd-4922-aaf6-7bd52b4ca9cf admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:05.793326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1411/2788] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:18:05 2022] POST /identity/v3/projects => generated 393 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:05.797531 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e8639-4dfd-4768-bda9-bb9343b4e9eb admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:05.808264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e8639-4dfd-4768-bda9-bb9343b4e9eb admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:05.821599 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:05.865321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737b2af-0fcc-48dc-af7a-f5ab4078dea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:05.865931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737b2af-0fcc-48dc-af7a-f5ab4078dea4 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:05.866740 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737b2af-0fcc-48dc-af7a-f5ab4078dea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:05.867044 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737b2af-0fcc-48dc-af7a-f5ab4078dea4 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:05.867666 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737b2af-0fcc-48dc-af7a-f5ab4078dea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:05.869679 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737b2af-0fcc-48dc-af7a-f5ab4078dea4 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:05.969351 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1378/2789] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:18:05 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:05.973417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17341c-3ccd-4922-aaf6-7bd52b4ca9cf admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:05.983627 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17341c-3ccd-4922-aaf6-7bd52b4ca9cf admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:05.988225 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a975cf7-c234-438f-b7dd-db0efb49ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:05.988816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a975cf7-c234-438f-b7dd-db0efb49ecf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:05.989095 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a975cf7-c234-438f-b7dd-db0efb49ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:05.989362 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a975cf7-c234-438f-b7dd-db0efb49ecf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:05.989991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a975cf7-c234-438f-b7dd-db0efb49ecf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:05.992166 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a975cf7-c234-438f-b7dd-db0efb49ecf4 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:06.005162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1412/2790] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:06.011030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737b2af-0fcc-48dc-af7a-f5ab4078dea4 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:06.021305 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737b2af-0fcc-48dc-af7a-f5ab4078dea4 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:06.026212 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cba0d0-c90d-4ee0-88e4-a610818bf094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:06.026827 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cba0d0-c90d-4ee0-88e4-a610818bf094 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:06.027106 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cba0d0-c90d-4ee0-88e4-a610818bf094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:06.027379 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cba0d0-c90d-4ee0-88e4-a610818bf094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:06.028062 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cba0d0-c90d-4ee0-88e4-a610818bf094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:06.029708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cba0d0-c90d-4ee0-88e4-a610818bf094 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:06.041562 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1379/2791] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:06.045944 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a975cf7-c234-438f-b7dd-db0efb49ecf4 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:06.056511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a975cf7-c234-438f-b7dd-db0efb49ecf4 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:06.061078 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9fced-5c02-417a-8e23-cdda9e8ea7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:06.061726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9fced-5c02-417a-8e23-cdda9e8ea7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:06.062008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9fced-5c02-417a-8e23-cdda9e8ea7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:06.062288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9fced-5c02-417a-8e23-cdda9e8ea7a0 admin admin] PATH_INFO: `/v3/projects/5b3d139e50a0484ba6654b0240959f37/users/c04aa7988d6e46c28dc805f3490cd67e/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:06.076930 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9fced-5c02-417a-8e23-cdda9e8ea7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3d139e50a0484ba6654b0240959f37, user_id=c04aa7988d6e46c28dc805f3490cd67e, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:06.079426 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9fced-5c02-417a-8e23-cdda9e8ea7a0 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:06.158900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1413/2792] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:06 2022] PUT /identity/v3/projects/5b3d139e50a0484ba6654b0240959f37/users/c04aa7988d6e46c28dc805f3490cd67e/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:06.171011 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a06627-5f25-46fa-ba2f-14ec5d2eb1a7 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:06.171304 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a06627-5f25-46fa-ba2f-14ec5d2eb1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:06.172239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a06627-5f25-46fa-ba2f-14ec5d2eb1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:06.217828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-34a06627-5f25-46fa-ba2f-14ec5d2eb1a7 None None] MFA Rules not processed for user `c04aa7988d6e46c28dc805f3490cd67e`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:06.224711 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-34a06627-5f25-46fa-ba2f-14ec5d2eb1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:06.301623 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1380/2793] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:06.306659 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9fced-5c02-417a-8e23-cdda9e8ea7a0 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:06.368974 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9fced-5c02-417a-8e23-cdda9e8ea7a0 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:06.373718 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b8c8a-895f-4ff7-ab8f-3b85f56f2ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:06.374323 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b8c8a-895f-4ff7-ab8f-3b85f56f2ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:06.374609 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b8c8a-895f-4ff7-ab8f-3b85f56f2ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:06.374884 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b8c8a-895f-4ff7-ab8f-3b85f56f2ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:06.375515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b8c8a-895f-4ff7-ab8f-3b85f56f2ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:06.377459 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b8c8a-895f-4ff7-ab8f-3b85f56f2ae6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:06.388512 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:06.523905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1414/2794] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:18:06 2022] POST /identity/v3/projects => generated 391 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:06.536974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a06627-5f25-46fa-ba2f-14ec5d2eb1a7 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:06.548236 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a06627-5f25-46fa-ba2f-14ec5d2eb1a7 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:06.606406 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2b53b-9995-4a3b-8173-32bc99dc4add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:06.606938 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2b53b-9995-4a3b-8173-32bc99dc4add admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:06.607219 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2b53b-9995-4a3b-8173-32bc99dc4add admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:06.607491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2b53b-9995-4a3b-8173-32bc99dc4add admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:06.608153 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2b53b-9995-4a3b-8173-32bc99dc4add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:06.610054 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2b53b-9995-4a3b-8173-32bc99dc4add admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:06.783552 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1381/2795] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:18:06 2022] POST /identity/v3/users => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:06.786959 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b8c8a-895f-4ff7-ab8f-3b85f56f2ae6 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:06.799176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b8c8a-895f-4ff7-ab8f-3b85f56f2ae6 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:06.804611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bcf39-085d-4af2-85de-ea2ead7b46cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:06.805215 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bcf39-085d-4af2-85de-ea2ead7b46cd admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:06.805584 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bcf39-085d-4af2-85de-ea2ead7b46cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:06.805913 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bcf39-085d-4af2-85de-ea2ead7b46cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:06.806567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bcf39-085d-4af2-85de-ea2ead7b46cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:06.808202 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bcf39-085d-4af2-85de-ea2ead7b46cd admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:06.819104 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1415/2796] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:06.824202 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2b53b-9995-4a3b-8173-32bc99dc4add admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:06.835196 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2b53b-9995-4a3b-8173-32bc99dc4add admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:06.840194 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2ff0e-89a5-45ed-8eaa-ab2624d99cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:06.840872 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2ff0e-89a5-45ed-8eaa-ab2624d99cad admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:06.841111 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2ff0e-89a5-45ed-8eaa-ab2624d99cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:06.841340 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2ff0e-89a5-45ed-8eaa-ab2624d99cad admin admin] PATH_INFO: `/v3/projects/ca82d652546a47db8e0609ff7dacbf0b/users/1e478b58a716439985520b6d2d8964e0/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:06.854892 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:06.858527 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2ff0e-89a5-45ed-8eaa-ab2624d99cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca82d652546a47db8e0609ff7dacbf0b, user_id=1e478b58a716439985520b6d2d8964e0, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:06.862774 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2ff0e-89a5-45ed-8eaa-ab2624d99cad admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:07.067435 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1382/2797] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:06 2022] PUT /identity/v3/projects/ca82d652546a47db8e0609ff7dacbf0b/users/1e478b58a716439985520b6d2d8964e0/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:07.071630 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bcf39-085d-4af2-85de-ea2ead7b46cd admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:07.081886 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bcf39-085d-4af2-85de-ea2ead7b46cd admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:07.138461 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c422d1-9384-4480-9394-24513f008957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:07.138991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c422d1-9384-4480-9394-24513f008957 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:07.139293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c422d1-9384-4480-9394-24513f008957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:07.139563 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c422d1-9384-4480-9394-24513f008957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:07.140268 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c422d1-9384-4480-9394-24513f008957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:07.141857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c422d1-9384-4480-9394-24513f008957 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:07.155504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1416/2798] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:07.156954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2ff0e-89a5-45ed-8eaa-ab2624d99cad admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:07.168578 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2ff0e-89a5-45ed-8eaa-ab2624d99cad admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:07.173301 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea42776-deef-4fd8-b2af-9453924b1135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:07.173954 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea42776-deef-4fd8-b2af-9453924b1135 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:07.174236 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea42776-deef-4fd8-b2af-9453924b1135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:07.174510 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea42776-deef-4fd8-b2af-9453924b1135 admin admin] PATH_INFO: `/v3/projects/ca82d652546a47db8e0609ff7dacbf0b/users/1e478b58a716439985520b6d2d8964e0/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:07.176436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea42776-deef-4fd8-b2af-9453924b1135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca82d652546a47db8e0609ff7dacbf0b, user_id=1e478b58a716439985520b6d2d8964e0, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:07.179141 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea42776-deef-4fd8-b2af-9453924b1135 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:07.189935 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1383/2799] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:07 2022] PUT /identity/v3/projects/ca82d652546a47db8e0609ff7dacbf0b/users/1e478b58a716439985520b6d2d8964e0/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:07.200434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9395a-3b6e-44cf-b49a-4611fd64d4e5 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:07.205360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9395a-3b6e-44cf-b49a-4611fd64d4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:07.205360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9395a-3b6e-44cf-b49a-4611fd64d4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:07.230452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-a7f9395a-3b6e-44cf-b49a-4611fd64d4e5 None None] MFA Rules not processed for user `1e478b58a716439985520b6d2d8964e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:07.231682 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a7f9395a-3b6e-44cf-b49a-4611fd64d4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:07.300252 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1417/2800] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:07.312533 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea42776-deef-4fd8-b2af-9453924b1135 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:07.314449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1ea42776-deef-4fd8-b2af-9453924b1135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:07.374416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea42776-deef-4fd8-b2af-9453924b1135 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:07.378019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee4fda-080d-4d47-8038-4ce36281d216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:07.378619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee4fda-080d-4d47-8038-4ce36281d216 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:07.378895 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee4fda-080d-4d47-8038-4ce36281d216 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:07.379161 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee4fda-080d-4d47-8038-4ce36281d216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:07.388092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee4fda-080d-4d47-8038-4ce36281d216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:07.389566 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee4fda-080d-4d47-8038-4ce36281d216 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:07.399306 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1384/2801] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:07 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:18:07.445362 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9395a-3b6e-44cf-b49a-4611fd64d4e5 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:07.446747 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a7f9395a-3b6e-44cf-b49a-4611fd64d4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:07.458937 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9395a-3b6e-44cf-b49a-4611fd64d4e5 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:07.463025 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f46bd-b579-4c29-86f8-870de3627479 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:07.463669 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f46bd-b579-4c29-86f8-870de3627479 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:07.463981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f46bd-b579-4c29-86f8-870de3627479 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:07.464262 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f46bd-b579-4c29-86f8-870de3627479 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:07.520038 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f46bd-b579-4c29-86f8-870de3627479 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:07.521468 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f46bd-b579-4c29-86f8-870de3627479 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:07.526108 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:07.530623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1418/2802] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:07 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:18:07.571472 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee4fda-080d-4d47-8038-4ce36281d216 service cinder] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:07.574223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-baee4fda-080d-4d47-8038-4ce36281d216 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:07.651428 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee4fda-080d-4d47-8038-4ce36281d216 service cinder] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:07.656084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e74fda-e6f3-4199-8ff7-e837175716e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:07.656720 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e74fda-e6f3-4199-8ff7-e837175716e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:07.657000 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e74fda-e6f3-4199-8ff7-e837175716e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:07.657274 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e74fda-e6f3-4199-8ff7-e837175716e0 admin admin] PATH_INFO: `/v3/users/aa583c926533453a8e48added4a22a54` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:07.658417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e74fda-e6f3-4199-8ff7-e837175716e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa583c926533453a8e48added4a22a54)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:07.660406 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e74fda-e6f3-4199-8ff7-e837175716e0 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:07.957970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-00e74fda-e6f3-4199-8ff7-e837175716e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa583c926533453a8e48added4a22a54'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:07.958705 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-00e74fda-e6f3-4199-8ff7-e837175716e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa583c926533453a8e48added4a22a54'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:07.972216 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-00e74fda-e6f3-4199-8ff7-e837175716e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa583c926533453a8e48added4a22a54'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:08.098422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-00e74fda-e6f3-4199-8ff7-e837175716e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa583c926533453a8e48added4a22a54'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:08.107522 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-00e74fda-e6f3-4199-8ff7-e837175716e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa583c926533453a8e48added4a22a54'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:08.108485 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:08.112735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1385/2803] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:18:07 2022] DELETE /identity/v3/users/aa583c926533453a8e48added4a22a54 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:08.117739 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1971f-9188-42ba-8204-1631b30d8841 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:08.118029 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1971f-9188-42ba-8204-1631b30d8841 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:08.118304 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1971f-9188-42ba-8204-1631b30d8841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:08.137790 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-dfa1971f-9188-42ba-8204-1631b30d8841 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:08.139027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-dfa1971f-9188-42ba-8204-1631b30d8841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:08.204139 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1419/2804] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:08.214355 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e74fda-e6f3-4199-8ff7-e837175716e0 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:08.215788 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-00e74fda-e6f3-4199-8ff7-e837175716e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:08.275315 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e74fda-e6f3-4199-8ff7-e837175716e0 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:08.279115 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69ce37-178f-4ad8-8640-988344df5790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:08.279729 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69ce37-178f-4ad8-8640-988344df5790 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:08.280032 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69ce37-178f-4ad8-8640-988344df5790 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:08.280300 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69ce37-178f-4ad8-8640-988344df5790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:08.297273 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69ce37-178f-4ad8-8640-988344df5790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:08.297273 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69ce37-178f-4ad8-8640-988344df5790 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:08.304654 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1386/2805] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:18:08.862289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1971f-9188-42ba-8204-1631b30d8841 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:08.866876 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-dfa1971f-9188-42ba-8204-1631b30d8841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:08.876738 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1971f-9188-42ba-8204-1631b30d8841 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:08.881369 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:08.882586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:08.882864 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:08.883138 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60 admin admin] PATH_INFO: `/v3/projects/ab4b20f04fd846f7a935b76d88d1f52d` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:08.884295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4b20f04fd846f7a935b76d88d1f52d)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:08.886218 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:09.020463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4b20f04fd846f7a935b76d88d1f52d', 'request_id': 'req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:09.126872 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4b20f04fd846f7a935b76d88d1f52d', 'request_id': 'req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:09.133981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4b20f04fd846f7a935b76d88d1f52d', 'request_id': 'req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:09.144852 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60 admin admin] The token cache is being invalidate because project ab4b20f04fd846f7a935b76d88d1f52d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:18:09.145148 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:09.145795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:09.147379 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1420/2806] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:18:08 2022] DELETE /identity/v3/projects/ab4b20f04fd846f7a935b76d88d1f52d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:09.151540 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69ce37-178f-4ad8-8640-988344df5790 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:09.161572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69ce37-178f-4ad8-8640-988344df5790 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:09.221809 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f8b7d-eddb-4c20-83e2-9a87a6873672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:09.222486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f8b7d-eddb-4c20-83e2-9a87a6873672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:09.222772 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f8b7d-eddb-4c20-83e2-9a87a6873672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:09.223049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f8b7d-eddb-4c20-83e2-9a87a6873672 admin admin] PATH_INFO: `/v3/users/b10e52e83ca74b78ba6ed67f016d6f48` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:09.224207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f8b7d-eddb-4c20-83e2-9a87a6873672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b10e52e83ca74b78ba6ed67f016d6f48)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:09.226704 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f8b7d-eddb-4c20-83e2-9a87a6873672 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:09.525708 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ba4f8b7d-eddb-4c20-83e2-9a87a6873672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b10e52e83ca74b78ba6ed67f016d6f48'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:09.526410 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ba4f8b7d-eddb-4c20-83e2-9a87a6873672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b10e52e83ca74b78ba6ed67f016d6f48'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:09.538665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ba4f8b7d-eddb-4c20-83e2-9a87a6873672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b10e52e83ca74b78ba6ed67f016d6f48'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:09.620823 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ba4f8b7d-eddb-4c20-83e2-9a87a6873672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b10e52e83ca74b78ba6ed67f016d6f48'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:09.621393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-ba4f8b7d-eddb-4c20-83e2-9a87a6873672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b10e52e83ca74b78ba6ed67f016d6f48'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:09.635122 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1387/2807] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:18:09 2022] DELETE /identity/v3/users/b10e52e83ca74b78ba6ed67f016d6f48 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:18:10.170834 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:10.175105 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:10.186830 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfbb97-ee76-4d83-96cc-bfa70f0abe60 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:10.250022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b7c7c-f6c8-4f55-ad74-3ce9f7b80c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:10.252020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7c7c-f6c8-4f55-ad74-3ce9f7b80c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:10.252020 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7c7c-f6c8-4f55-ad74-3ce9f7b80c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:10.252376 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7c7c-f6c8-4f55-ad74-3ce9f7b80c11 admin admin] PATH_INFO: `/v3/projects/e7fc70809e4b4f649aa8314a10d938cf` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:10.253624 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b7c7c-f6c8-4f55-ad74-3ce9f7b80c11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7fc70809e4b4f649aa8314a10d938cf)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:10.255610 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b7c7c-f6c8-4f55-ad74-3ce9f7b80c11 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:10.456612 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:10.473941 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-483b7c7c-f6c8-4f55-ad74-3ce9f7b80c11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7fc70809e4b4f649aa8314a10d938cf', 'request_id': 'req-483b7c7c-f6c8-4f55-ad74-3ce9f7b80c11'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:10.643507 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-483b7c7c-f6c8-4f55-ad74-3ce9f7b80c11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7fc70809e4b4f649aa8314a10d938cf', 'request_id': 'req-483b7c7c-f6c8-4f55-ad74-3ce9f7b80c11'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:10.651302 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-483b7c7c-f6c8-4f55-ad74-3ce9f7b80c11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7fc70809e4b4f649aa8314a10d938cf', 'request_id': 'req-483b7c7c-f6c8-4f55-ad74-3ce9f7b80c11'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:10.661727 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-483b7c7c-f6c8-4f55-ad74-3ce9f7b80c11 admin admin] The token cache is being invalidate because project e7fc70809e4b4f649aa8314a10d938cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:18:10.662023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-483b7c7c-f6c8-4f55-ad74-3ce9f7b80c11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:10.662660 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-483b7c7c-f6c8-4f55-ad74-3ce9f7b80c11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:10.664708 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1421/2808] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:18:10 2022] DELETE /identity/v3/projects/e7fc70809e4b4f649aa8314a10d938cf => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:10.670920 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dfa77-6e94-4ab6-b576-a5b0972716b6 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:10.671456 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dfa77-6e94-4ab6-b576-a5b0972716b6 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:10.671456 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dfa77-6e94-4ab6-b576-a5b0972716b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:10.695503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-362dfa77-6e94-4ab6-b576-a5b0972716b6 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:10.696684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-362dfa77-6e94-4ab6-b576-a5b0972716b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:10.714048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:10.755590 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1388/2809] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:10.821073 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fca6d-f8c1-4d22-8b59-5df939b40307 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:10.821469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fca6d-f8c1-4d22-8b59-5df939b40307 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:10.821842 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fca6d-f8c1-4d22-8b59-5df939b40307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:10.841967 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-f04fca6d-f8c1-4d22-8b59-5df939b40307 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:10.843182 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f04fca6d-f8c1-4d22-8b59-5df939b40307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:10.852001 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1422/2810] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:10.856084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dfa77-6e94-4ab6-b576-a5b0972716b6 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:10.865959 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dfa77-6e94-4ab6-b576-a5b0972716b6 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:10.871919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b38fc8-4ce5-4944-b16d-ef613c7c9db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:10.872529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b38fc8-4ce5-4944-b16d-ef613c7c9db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:10.872810 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b38fc8-4ce5-4944-b16d-ef613c7c9db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:10.873085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b38fc8-4ce5-4944-b16d-ef613c7c9db2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:10.873733 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b38fc8-4ce5-4944-b16d-ef613c7c9db2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:18:10.874039 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b38fc8-4ce5-4944-b16d-ef613c7c9db2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:10.875628 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b38fc8-4ce5-4944-b16d-ef613c7c9db2 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:10.887593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1389/2811] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:18:10.892227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fca6d-f8c1-4d22-8b59-5df939b40307 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:10.906532 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fca6d-f8c1-4d22-8b59-5df939b40307 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:10.913709 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd627540-b7f1-47bb-95d4-0828ddf76a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:10.913709 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd627540-b7f1-47bb-95d4-0828ddf76a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:10.913709 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd627540-b7f1-47bb-95d4-0828ddf76a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:10.913709 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd627540-b7f1-47bb-95d4-0828ddf76a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:10.914182 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd627540-b7f1-47bb-95d4-0828ddf76a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:10.915882 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd627540-b7f1-47bb-95d4-0828ddf76a8b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:11.073516 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1423/2812] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:18:10 2022] POST /identity/v3/projects => generated 397 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:11.077559 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b38fc8-4ce5-4944-b16d-ef613c7c9db2 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:11.087859 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b38fc8-4ce5-4944-b16d-ef613c7c9db2 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:11.146343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda79f3-6ffc-4986-ba56-a2c3acdec263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:11.146998 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda79f3-6ffc-4986-ba56-a2c3acdec263 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:11.147308 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda79f3-6ffc-4986-ba56-a2c3acdec263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:11.147610 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda79f3-6ffc-4986-ba56-a2c3acdec263 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:11.148279 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda79f3-6ffc-4986-ba56-a2c3acdec263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:11.150223 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda79f3-6ffc-4986-ba56-a2c3acdec263 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:11.263930 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1390/2813] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:18:11 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:11.265062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd627540-b7f1-47bb-95d4-0828ddf76a8b admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:11.275391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd627540-b7f1-47bb-95d4-0828ddf76a8b admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:11.280220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c71a0e-bb76-4d35-9ab9-da9dc8bfaba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:11.280940 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c71a0e-bb76-4d35-9ab9-da9dc8bfaba6 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:11.281226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c71a0e-bb76-4d35-9ab9-da9dc8bfaba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:11.281495 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c71a0e-bb76-4d35-9ab9-da9dc8bfaba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:11.282136 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c71a0e-bb76-4d35-9ab9-da9dc8bfaba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:11.283723 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c71a0e-bb76-4d35-9ab9-da9dc8bfaba6 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:11.296960 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1424/2814] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:11.301760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda79f3-6ffc-4986-ba56-a2c3acdec263 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:11.313428 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda79f3-6ffc-4986-ba56-a2c3acdec263 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:11.318241 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cd7d1-0e44-4036-afcd-9455ea0423cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:11.318979 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cd7d1-0e44-4036-afcd-9455ea0423cb admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:11.319506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cd7d1-0e44-4036-afcd-9455ea0423cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:11.319854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cd7d1-0e44-4036-afcd-9455ea0423cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:11.320606 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cd7d1-0e44-4036-afcd-9455ea0423cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:11.322263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cd7d1-0e44-4036-afcd-9455ea0423cb admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:11.333483 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1391/2815] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:11.345391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c71a0e-bb76-4d35-9ab9-da9dc8bfaba6 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:11.355950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c71a0e-bb76-4d35-9ab9-da9dc8bfaba6 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:11.360594 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4251149-acb7-4cce-8ee9-314e619afc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:11.361263 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4251149-acb7-4cce-8ee9-314e619afc2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:11.361535 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4251149-acb7-4cce-8ee9-314e619afc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:11.361811 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4251149-acb7-4cce-8ee9-314e619afc2d admin admin] PATH_INFO: `/v3/projects/7df663d18818495e99cff28e9f50229e/users/11a5147e010f431aa463c24e5f56fbaf/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:11.388413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4251149-acb7-4cce-8ee9-314e619afc2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df663d18818495e99cff28e9f50229e, user_id=11a5147e010f431aa463c24e5f56fbaf, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:11.388413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4251149-acb7-4cce-8ee9-314e619afc2d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:11.489645 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1425/2816] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:11 2022] PUT /identity/v3/projects/7df663d18818495e99cff28e9f50229e/users/11a5147e010f431aa463c24e5f56fbaf/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:11.500205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc3f75-1f8d-42eb-8003-ee7961546af2 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:11.500500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc3f75-1f8d-42eb-8003-ee7961546af2 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:11.500775 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc3f75-1f8d-42eb-8003-ee7961546af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:11.530786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-a4bc3f75-1f8d-42eb-8003-ee7961546af2 None None] MFA Rules not processed for user `11a5147e010f431aa463c24e5f56fbaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:11.532038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a4bc3f75-1f8d-42eb-8003-ee7961546af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:11.598490 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1392/2817] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:11 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:11.637202 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4251149-acb7-4cce-8ee9-314e619afc2d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:11.638924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d4251149-acb7-4cce-8ee9-314e619afc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:11.697705 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4251149-acb7-4cce-8ee9-314e619afc2d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:11.701787 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45d9e0-7f0f-49e4-b705-46b8004cd158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:11.702488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45d9e0-7f0f-49e4-b705-46b8004cd158 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:11.702770 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45d9e0-7f0f-49e4-b705-46b8004cd158 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:11.703045 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45d9e0-7f0f-49e4-b705-46b8004cd158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:11.712219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45d9e0-7f0f-49e4-b705-46b8004cd158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:11.713681 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45d9e0-7f0f-49e4-b705-46b8004cd158 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:11.722643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1426/2818] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:11 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:18:14.303855 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc3f75-1f8d-42eb-8003-ee7961546af2 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:14.305370 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a4bc3f75-1f8d-42eb-8003-ee7961546af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:14.326520 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:14.372415 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc3f75-1f8d-42eb-8003-ee7961546af2 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:14.377168 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2dd67-0885-4bc6-89f7-423bc5aea8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:14.377899 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2dd67-0885-4bc6-89f7-423bc5aea8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:14.378091 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2dd67-0885-4bc6-89f7-423bc5aea8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:14.389302 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2dd67-0885-4bc6-89f7-423bc5aea8e2 admin admin] PATH_INFO: `/v3/users/c04aa7988d6e46c28dc805f3490cd67e` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:14.389302 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2dd67-0885-4bc6-89f7-423bc5aea8e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c04aa7988d6e46c28dc805f3490cd67e)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:14.389302 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2dd67-0885-4bc6-89f7-423bc5aea8e2 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:14.611313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1ed2dd67-0885-4bc6-89f7-423bc5aea8e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c04aa7988d6e46c28dc805f3490cd67e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:14.611987 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1ed2dd67-0885-4bc6-89f7-423bc5aea8e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c04aa7988d6e46c28dc805f3490cd67e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:14.623990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1ed2dd67-0885-4bc6-89f7-423bc5aea8e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c04aa7988d6e46c28dc805f3490cd67e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:14.709587 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1ed2dd67-0885-4bc6-89f7-423bc5aea8e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c04aa7988d6e46c28dc805f3490cd67e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:14.710209 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1ed2dd67-0885-4bc6-89f7-423bc5aea8e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c04aa7988d6e46c28dc805f3490cd67e'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:14.723122 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1393/2819] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:18:14 2022] DELETE /identity/v3/users/c04aa7988d6e46c28dc805f3490cd67e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:14.727593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ec008-63e9-478d-a4b1-fb7c495d4636 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:14.728097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ec008-63e9-478d-a4b1-fb7c495d4636 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:14.728196 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ec008-63e9-478d-a4b1-fb7c495d4636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:14.747464 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-671ec008-63e9-478d-a4b1-fb7c495d4636 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:14.758755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-671ec008-63e9-478d-a4b1-fb7c495d4636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:14.797801 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:14.810860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1427/2820] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:14.821927 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2dd67-0885-4bc6-89f7-423bc5aea8e2 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:14.823068 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1ed2dd67-0885-4bc6-89f7-423bc5aea8e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:14.884076 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2dd67-0885-4bc6-89f7-423bc5aea8e2 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:14.887725 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56997c40-4198-4aac-a6e6-8c70ce28508f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:14.888362 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56997c40-4198-4aac-a6e6-8c70ce28508f service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:14.888644 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56997c40-4198-4aac-a6e6-8c70ce28508f service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:14.888919 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56997c40-4198-4aac-a6e6-8c70ce28508f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:14.898018 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56997c40-4198-4aac-a6e6-8c70ce28508f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:14.899449 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56997c40-4198-4aac-a6e6-8c70ce28508f service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:14.908906 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1394/2821] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:18:15.365048 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ec008-63e9-478d-a4b1-fb7c495d4636 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:15.369055 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-671ec008-63e9-478d-a4b1-fb7c495d4636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:15.379572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ec008-63e9-478d-a4b1-fb7c495d4636 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:15.384260 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:15.384898 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:15.385180 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:15.385462 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a admin admin] PATH_INFO: `/v3/projects/5b3d139e50a0484ba6654b0240959f37` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:15.387190 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3d139e50a0484ba6654b0240959f37)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:15.389179 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:15.556684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3d139e50a0484ba6654b0240959f37', 'request_id': 'req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:15.677657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3d139e50a0484ba6654b0240959f37', 'request_id': 'req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:15.685330 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3d139e50a0484ba6654b0240959f37', 'request_id': 'req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:15.697475 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a admin admin] The token cache is being invalidate because project 5b3d139e50a0484ba6654b0240959f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:18:15.697989 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:15.698797 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:15.700361 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1428/2822] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:18:15 2022] DELETE /identity/v3/projects/5b3d139e50a0484ba6654b0240959f37 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:15.704598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56997c40-4198-4aac-a6e6-8c70ce28508f service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:15.714432 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56997c40-4198-4aac-a6e6-8c70ce28508f service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:15.753014 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:15.771848 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc9bfb-24de-4b1c-845a-b333f8840148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:15.772513 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc9bfb-24de-4b1c-845a-b333f8840148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:15.772801 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc9bfb-24de-4b1c-845a-b333f8840148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:15.773071 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc9bfb-24de-4b1c-845a-b333f8840148 admin admin] PATH_INFO: `/v3/users/1e478b58a716439985520b6d2d8964e0` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:15.774266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc9bfb-24de-4b1c-845a-b333f8840148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e478b58a716439985520b6d2d8964e0)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:15.776242 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc9bfb-24de-4b1c-845a-b333f8840148 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:16.120341 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d6bc9bfb-24de-4b1c-845a-b333f8840148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e478b58a716439985520b6d2d8964e0'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:16.121005 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d6bc9bfb-24de-4b1c-845a-b333f8840148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e478b58a716439985520b6d2d8964e0'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:16.133736 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d6bc9bfb-24de-4b1c-845a-b333f8840148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e478b58a716439985520b6d2d8964e0'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:16.294985 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d6bc9bfb-24de-4b1c-845a-b333f8840148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e478b58a716439985520b6d2d8964e0'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:16.295613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-d6bc9bfb-24de-4b1c-845a-b333f8840148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e478b58a716439985520b6d2d8964e0'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:16.310461 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1395/2823] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:18:15 2022] DELETE /identity/v3/users/1e478b58a716439985520b6d2d8964e0 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:17.051561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:17.052316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:17.066483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f5518-f22d-4ee0-ab99-4922a95bb02a admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:17.125845 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cab8a-bee9-4aa5-95d8-b47fdfa6448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:17.126485 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cab8a-bee9-4aa5-95d8-b47fdfa6448d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:17.126769 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cab8a-bee9-4aa5-95d8-b47fdfa6448d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:17.127046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cab8a-bee9-4aa5-95d8-b47fdfa6448d admin admin] PATH_INFO: `/v3/projects/ca82d652546a47db8e0609ff7dacbf0b` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:17.128194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cab8a-bee9-4aa5-95d8-b47fdfa6448d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca82d652546a47db8e0609ff7dacbf0b)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:17.130096 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cab8a-bee9-4aa5-95d8-b47fdfa6448d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:17.281641 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-db4cab8a-bee9-4aa5-95d8-b47fdfa6448d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca82d652546a47db8e0609ff7dacbf0b', 'request_id': 'req-db4cab8a-bee9-4aa5-95d8-b47fdfa6448d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:17.397745 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-db4cab8a-bee9-4aa5-95d8-b47fdfa6448d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca82d652546a47db8e0609ff7dacbf0b', 'request_id': 'req-db4cab8a-bee9-4aa5-95d8-b47fdfa6448d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:17.405484 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-db4cab8a-bee9-4aa5-95d8-b47fdfa6448d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca82d652546a47db8e0609ff7dacbf0b', 'request_id': 'req-db4cab8a-bee9-4aa5-95d8-b47fdfa6448d'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:17.416821 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-db4cab8a-bee9-4aa5-95d8-b47fdfa6448d admin admin] The token cache is being invalidate because project ca82d652546a47db8e0609ff7dacbf0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:18:17.417684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-db4cab8a-bee9-4aa5-95d8-b47fdfa6448d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:17.417857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-db4cab8a-bee9-4aa5-95d8-b47fdfa6448d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:17.419364 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1429/2824] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:18:17 2022] DELETE /identity/v3/projects/ca82d652546a47db8e0609ff7dacbf0b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:17.424245 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7915a6-640d-4a68-a3c5-bcb7ba5cce98 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:17.424731 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7915a6-640d-4a68-a3c5-bcb7ba5cce98 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:17.424845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7915a6-640d-4a68-a3c5-bcb7ba5cce98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:17.445155 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-0d7915a6-640d-4a68-a3c5-bcb7ba5cce98 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:17.446446 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-0d7915a6-640d-4a68-a3c5-bcb7ba5cce98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:17.510900 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1396/2825] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:17.520243 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e8433-4db2-4c3b-af3e-698b83d64e39 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:17.520558 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e8433-4db2-4c3b-af3e-698b83d64e39 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:17.520925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e8433-4db2-4c3b-af3e-698b83d64e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:17.535566 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:17.546429 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-3a4e8433-4db2-4c3b-af3e-698b83d64e39 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:17.547637 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3a4e8433-4db2-4c3b-af3e-698b83d64e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:17.556463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1430/2826] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:17.561781 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7915a6-640d-4a68-a3c5-bcb7ba5cce98 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:17.576739 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7915a6-640d-4a68-a3c5-bcb7ba5cce98 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:17.582458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bfe43-aef8-4b88-9069-c9af5ed23b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:17.589840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bfe43-aef8-4b88-9069-c9af5ed23b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:17.589840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bfe43-aef8-4b88-9069-c9af5ed23b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:17.589840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bfe43-aef8-4b88-9069-c9af5ed23b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:17.589840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bfe43-aef8-4b88-9069-c9af5ed23b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:18:17.589840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bfe43-aef8-4b88-9069-c9af5ed23b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:17.589840 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bfe43-aef8-4b88-9069-c9af5ed23b8d admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:17.598411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1397/2827] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 14:18:17.603116 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e8433-4db2-4c3b-af3e-698b83d64e39 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:17.612585 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e8433-4db2-4c3b-af3e-698b83d64e39 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:17.618027 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11015777-22df-4f73-82a4-b9596782636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:17.618665 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11015777-22df-4f73-82a4-b9596782636f admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:17.618948 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11015777-22df-4f73-82a4-b9596782636f admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:17.619221 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11015777-22df-4f73-82a4-b9596782636f admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:17.619881 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11015777-22df-4f73-82a4-b9596782636f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:17.621900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11015777-22df-4f73-82a4-b9596782636f admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:17.802841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1431/2828] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:18:17 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:17.807062 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bfe43-aef8-4b88-9069-c9af5ed23b8d admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:17.816886 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bfe43-aef8-4b88-9069-c9af5ed23b8d admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:17.863350 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:17.875782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872b0cd-9673-4f78-8ede-acb94dd9f9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:17.876422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872b0cd-9673-4f78-8ede-acb94dd9f9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:17.876703 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872b0cd-9673-4f78-8ede-acb94dd9f9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:17.876974 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872b0cd-9673-4f78-8ede-acb94dd9f9e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:17.877619 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872b0cd-9673-4f78-8ede-acb94dd9f9e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:17.879536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872b0cd-9673-4f78-8ede-acb94dd9f9e3 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:18.018421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1398/2829] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:18:17 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:18.023401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11015777-22df-4f73-82a4-b9596782636f admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:18.033509 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11015777-22df-4f73-82a4-b9596782636f admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:18.038053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734df012-da75-48b1-a7da-4c7bc5ae6665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:18.038648 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734df012-da75-48b1-a7da-4c7bc5ae6665 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:18.038928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734df012-da75-48b1-a7da-4c7bc5ae6665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:18.039208 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734df012-da75-48b1-a7da-4c7bc5ae6665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:18.039933 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734df012-da75-48b1-a7da-4c7bc5ae6665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:18.041634 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734df012-da75-48b1-a7da-4c7bc5ae6665 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:18.051903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1432/2830] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:18:18.056105 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872b0cd-9673-4f78-8ede-acb94dd9f9e3 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:18.065861 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872b0cd-9673-4f78-8ede-acb94dd9f9e3 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:18.071112 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8513a-a376-4348-8932-4c68f651a4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:18.071709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8513a-a376-4348-8932-4c68f651a4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:18.072092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8513a-a376-4348-8932-4c68f651a4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:18.072387 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8513a-a376-4348-8932-4c68f651a4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:18.073028 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8513a-a376-4348-8932-4c68f651a4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:18.074600 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8513a-a376-4348-8932-4c68f651a4e3 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:18.086371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1399/2831] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:18.090939 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734df012-da75-48b1-a7da-4c7bc5ae6665 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:18.101015 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734df012-da75-48b1-a7da-4c7bc5ae6665 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:18.105756 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce496047-1c5f-490f-9677-a99bed440de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:18.106407 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce496047-1c5f-490f-9677-a99bed440de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:18.106688 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce496047-1c5f-490f-9677-a99bed440de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:18.106961 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce496047-1c5f-490f-9677-a99bed440de2 admin admin] PATH_INFO: `/v3/projects/8019beba1e2a4331b385ad3afa189653/users/7509a7e81e584a7eac7d1e20ef81eac5/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:18.121520 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce496047-1c5f-490f-9677-a99bed440de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8019beba1e2a4331b385ad3afa189653, user_id=7509a7e81e584a7eac7d1e20ef81eac5, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:18.124220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce496047-1c5f-490f-9677-a99bed440de2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:18.341383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1433/2832] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:18 2022] PUT /identity/v3/projects/8019beba1e2a4331b385ad3afa189653/users/7509a7e81e584a7eac7d1e20ef81eac5/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:18.351755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed2304-4fb4-4349-852a-6cf151e7a664 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:18.352144 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed2304-4fb4-4349-852a-6cf151e7a664 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:18.352422 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed2304-4fb4-4349-852a-6cf151e7a664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:18.382656 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-deed2304-4fb4-4349-852a-6cf151e7a664 None None] MFA Rules not processed for user `7509a7e81e584a7eac7d1e20ef81eac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:18.383896 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-deed2304-4fb4-4349-852a-6cf151e7a664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:18.450089 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1400/2833] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:18:18.454558 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce496047-1c5f-490f-9677-a99bed440de2 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:18.516567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce496047-1c5f-490f-9677-a99bed440de2 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:18.521026 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0004198-6ef7-46ce-a35e-331fcc1b52a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:18.521623 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0004198-6ef7-46ce-a35e-331fcc1b52a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:18.521903 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0004198-6ef7-46ce-a35e-331fcc1b52a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:18.522194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0004198-6ef7-46ce-a35e-331fcc1b52a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:18.522836 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0004198-6ef7-46ce-a35e-331fcc1b52a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:18.524761 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0004198-6ef7-46ce-a35e-331fcc1b52a4 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:18.575349 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed2304-4fb4-4349-852a-6cf151e7a664 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:18.576904 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-deed2304-4fb4-4349-852a-6cf151e7a664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:18.590841 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed2304-4fb4-4349-852a-6cf151e7a664 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:18.595462 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aea332-7b9a-4eeb-9f85-63bfc972c3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:18.596062 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea332-7b9a-4eeb-9f85-63bfc972c3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:18.596338 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea332-7b9a-4eeb-9f85-63bfc972c3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:18.596617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea332-7b9a-4eeb-9f85-63bfc972c3fa admin admin] PATH_INFO: `/v3/users/2952adb02e9a4b22bb0ea45983d11648` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:18.597745 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aea332-7b9a-4eeb-9f85-63bfc972c3fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2952adb02e9a4b22bb0ea45983d11648)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:18.599647 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aea332-7b9a-4eeb-9f85-63bfc972c3fa admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:18.621493 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1434/2834] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:18:18 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:18.625586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0004198-6ef7-46ce-a35e-331fcc1b52a4 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:18.688391 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0004198-6ef7-46ce-a35e-331fcc1b52a4 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:18.693200 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0ea78-89e8-4bc0-93b2-5a1e7f5c9ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:18.693814 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0ea78-89e8-4bc0-93b2-5a1e7f5c9ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:18.694635 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0ea78-89e8-4bc0-93b2-5a1e7f5c9ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:18.694921 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0ea78-89e8-4bc0-93b2-5a1e7f5c9ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:18.695551 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0ea78-89e8-4bc0-93b2-5a1e7f5c9ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:18.697591 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0ea78-89e8-4bc0-93b2-5a1e7f5c9ca2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:18.820740 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1435/2835] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:18:18 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:18:18.824471 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0ea78-89e8-4bc0-93b2-5a1e7f5c9ca2 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:18.834414 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0ea78-89e8-4bc0-93b2-5a1e7f5c9ca2 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:18.839052 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd54d2-4426-4ea6-96f8-25f97902245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:18.839646 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd54d2-4426-4ea6-96f8-25f97902245d admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:18.839951 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd54d2-4426-4ea6-96f8-25f97902245d admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:18.840231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd54d2-4426-4ea6-96f8-25f97902245d admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:18.840875 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd54d2-4426-4ea6-96f8-25f97902245d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:18.842477 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd54d2-4426-4ea6-96f8-25f97902245d admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:18.854321 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1436/2836] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:18:18.867137 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c1aea332-7b9a-4eeb-9f85-63bfc972c3fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2952adb02e9a4b22bb0ea45983d11648'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:18.867313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd54d2-4426-4ea6-96f8-25f97902245d admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:18.867811 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c1aea332-7b9a-4eeb-9f85-63bfc972c3fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2952adb02e9a4b22bb0ea45983d11648'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:18.880057 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd54d2-4426-4ea6-96f8-25f97902245d admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:18.881685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c1aea332-7b9a-4eeb-9f85-63bfc972c3fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2952adb02e9a4b22bb0ea45983d11648'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:18.884917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3201ad-b9a2-43be-b76b-86c791c622db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:18.885639 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3201ad-b9a2-43be-b76b-86c791c622db admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:18.885925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3201ad-b9a2-43be-b76b-86c791c622db admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:18.886220 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3201ad-b9a2-43be-b76b-86c791c622db admin admin] PATH_INFO: `/v3/projects/cf4d9e59d3e94e608ed81a098838e002/users/525169d3155b41d6a9cf627275a8b08f/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:18.888575 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:18.901514 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3201ad-b9a2-43be-b76b-86c791c622db admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4d9e59d3e94e608ed81a098838e002, user_id=525169d3155b41d6a9cf627275a8b08f, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:18.904270 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3201ad-b9a2-43be-b76b-86c791c622db admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:19.001045 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c1aea332-7b9a-4eeb-9f85-63bfc972c3fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2952adb02e9a4b22bb0ea45983d11648'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:19.001698 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c1aea332-7b9a-4eeb-9f85-63bfc972c3fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2952adb02e9a4b22bb0ea45983d11648'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:19.007547 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1437/2837] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:18 2022] PUT /identity/v3/projects/cf4d9e59d3e94e608ed81a098838e002/users/525169d3155b41d6a9cf627275a8b08f/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:19.011535 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3201ad-b9a2-43be-b76b-86c791c622db admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:19.013167 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3a3201ad-b9a2-43be-b76b-86c791c622db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:19.015084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1401/2838] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:18:18 2022] DELETE /identity/v3/users/2952adb02e9a4b22bb0ea45983d11648 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:18:19.019273 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c4f60-31fa-4052-a1a7-d3e5d4590b87 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:19.019563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c4f60-31fa-4052-a1a7-d3e5d4590b87 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:19.019837 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c4f60-31fa-4052-a1a7-d3e5d4590b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:19.038990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-272c4f60-31fa-4052-a1a7-d3e5d4590b87 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:19.040282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-272c4f60-31fa-4052-a1a7-d3e5d4590b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:19.061143 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:19.078935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3201ad-b9a2-43be-b76b-86c791c622db admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:19.099894 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1402/2839] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:18:19.110258 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c4f60-31fa-4052-a1a7-d3e5d4590b87 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:19.112429 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-272c4f60-31fa-4052-a1a7-d3e5d4590b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:19.138255 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8180f4c-8b72-45b3-8daa-1c9532a57126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:19.138865 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8180f4c-8b72-45b3-8daa-1c9532a57126 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:19.139143 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8180f4c-8b72-45b3-8daa-1c9532a57126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:19.139413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8180f4c-8b72-45b3-8daa-1c9532a57126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:19.140085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8180f4c-8b72-45b3-8daa-1c9532a57126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:19.141695 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8180f4c-8b72-45b3-8daa-1c9532a57126 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:19.155451 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1438/2840] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:18:19.159807 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8180f4c-8b72-45b3-8daa-1c9532a57126 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:19.170401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8180f4c-8b72-45b3-8daa-1c9532a57126 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:19.171655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c4f60-31fa-4052-a1a7-d3e5d4590b87 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:19.175240 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d87e7a-fd57-4512-88dc-cbe87523be74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:19.175525 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54f56d-59aa-4921-89b4-6420d510e869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:19.175929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d87e7a-fd57-4512-88dc-cbe87523be74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:19.176218 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d87e7a-fd57-4512-88dc-cbe87523be74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:19.176360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54f56d-59aa-4921-89b4-6420d510e869 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:19.176496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d87e7a-fd57-4512-88dc-cbe87523be74 admin admin] PATH_INFO: `/v3/projects/cf4d9e59d3e94e608ed81a098838e002/users/525169d3155b41d6a9cf627275a8b08f/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:19.176773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54f56d-59aa-4921-89b4-6420d510e869 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:19.177118 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54f56d-59aa-4921-89b4-6420d510e869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:19.179053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d87e7a-fd57-4512-88dc-cbe87523be74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4d9e59d3e94e608ed81a098838e002, user_id=525169d3155b41d6a9cf627275a8b08f, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:19.181736 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d87e7a-fd57-4512-88dc-cbe87523be74 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:19.186990 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54f56d-59aa-4921-89b4-6420d510e869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:19.188515 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54f56d-59aa-4921-89b4-6420d510e869 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:19.193402 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1439/2841] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:19 2022] PUT /identity/v3/projects/cf4d9e59d3e94e608ed81a098838e002/users/525169d3155b41d6a9cf627275a8b08f/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:18:19.203597 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1403/2842] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:18:19.203892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbaa6f5-c155-4c29-8c17-209c25978ed8 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:19.204204 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbaa6f5-c155-4c29-8c17-209c25978ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:19.204479 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbaa6f5-c155-4c29-8c17-209c25978ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:19.234986 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-dbbaa6f5-c155-4c29-8c17-209c25978ed8 None None] MFA Rules not processed for user `525169d3155b41d6a9cf627275a8b08f`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:19.236257 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-dbbaa6f5-c155-4c29-8c17-209c25978ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:19.305529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:19.310655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1440/2843] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:18:19.324396 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54f56d-59aa-4921-89b4-6420d510e869 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:19.325910 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1c54f56d-59aa-4921-89b4-6420d510e869 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:19.386029 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54f56d-59aa-4921-89b4-6420d510e869 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:19.436877 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bf8f6-756a-4c75-9791-f483ec22fa67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:19.437584 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bf8f6-756a-4c75-9791-f483ec22fa67 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:19.437931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bf8f6-756a-4c75-9791-f483ec22fa67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:19.438397 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bf8f6-756a-4c75-9791-f483ec22fa67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:19.450548 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bf8f6-756a-4c75-9791-f483ec22fa67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:19.452022 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bf8f6-756a-4c75-9791-f483ec22fa67 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:19.472177 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1404/2844] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:18:19.657101 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbaa6f5-c155-4c29-8c17-209c25978ed8 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:19.658508 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-dbbaa6f5-c155-4c29-8c17-209c25978ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:19.672188 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbaa6f5-c155-4c29-8c17-209c25978ed8 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:19.677981 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bf8f6-756a-4c75-9791-f483ec22fa67 service cinder] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:19.679608 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ced05-5e0d-47fd-b20e-f71b4887b85d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:19.680384 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ced05-5e0d-47fd-b20e-f71b4887b85d service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:19.680512 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-8d3bf8f6-756a-4c75-9791-f483ec22fa67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:19.680659 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ced05-5e0d-47fd-b20e-f71b4887b85d service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:19.680935 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ced05-5e0d-47fd-b20e-f71b4887b85d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:19.682650 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-8e0ced05-5e0d-47fd-b20e-f71b4887b85d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:19.726393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=100 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:19.753928 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ced05-5e0d-47fd-b20e-f71b4887b85d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:19.755370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ced05-5e0d-47fd-b20e-f71b4887b85d service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:19.759755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bf8f6-756a-4c75-9791-f483ec22fa67 service cinder] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:19.764741 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1441/2845] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:18:19.764903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:19.765437 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:19.765784 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:19.766175 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241 admin admin] PATH_INFO: `/v3/projects/74003c5d650e4ed79e43bc21f5ab00bf` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:19.767374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74003c5d650e4ed79e43bc21f5ab00bf)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:19.769500 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:19.895307 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74003c5d650e4ed79e43bc21f5ab00bf', 'request_id': 'req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:19.901412 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74003c5d650e4ed79e43bc21f5ab00bf', 'request_id': 'req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:19.963226 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74003c5d650e4ed79e43bc21f5ab00bf', 'request_id': 'req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:19.976824 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241 admin admin] The token cache is being invalidate because project 74003c5d650e4ed79e43bc21f5ab00bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:18:19.977093 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:19.977745 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:19.979367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1405/2846] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:18:19 2022] DELETE /identity/v3/projects/74003c5d650e4ed79e43bc21f5ab00bf => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:18:20.306924 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ced05-5e0d-47fd-b20e-f71b4887b85d service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:20.317926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ced05-5e0d-47fd-b20e-f71b4887b85d service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:20.381747 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81f202-1fd3-44c4-bb3a-d92d26ee7036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:20.382387 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81f202-1fd3-44c4-bb3a-d92d26ee7036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:20.382673 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81f202-1fd3-44c4-bb3a-d92d26ee7036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:20.383123 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81f202-1fd3-44c4-bb3a-d92d26ee7036 admin admin] PATH_INFO: `/v3/users/7509a7e81e584a7eac7d1e20ef81eac5` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:20.386731 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81f202-1fd3-44c4-bb3a-d92d26ee7036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7509a7e81e584a7eac7d1e20ef81eac5)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:20.389783 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81f202-1fd3-44c4-bb3a-d92d26ee7036 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:20.548773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:20.550268 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:20.564077 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f9c5d-1fd7-4ef7-a993-39e156bd8241 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:20.568750 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb074e79-c443-4fb8-9434-84b942cd1ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:20.569387 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb074e79-c443-4fb8-9434-84b942cd1ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:20.569669 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb074e79-c443-4fb8-9434-84b942cd1ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:20.569948 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb074e79-c443-4fb8-9434-84b942cd1ecc admin admin] PATH_INFO: `/v3/users/11a5147e010f431aa463c24e5f56fbaf` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:20.571072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb074e79-c443-4fb8-9434-84b942cd1ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a5147e010f431aa463c24e5f56fbaf)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:20.571552 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ab81f202-1fd3-44c4-bb3a-d92d26ee7036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7509a7e81e584a7eac7d1e20ef81eac5'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:20.573020 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb074e79-c443-4fb8-9434-84b942cd1ecc admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:20.584608 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ab81f202-1fd3-44c4-bb3a-d92d26ee7036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7509a7e81e584a7eac7d1e20ef81eac5'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:20.711803 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ab81f202-1fd3-44c4-bb3a-d92d26ee7036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7509a7e81e584a7eac7d1e20ef81eac5'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:20.719632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ab81f202-1fd3-44c4-bb3a-d92d26ee7036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7509a7e81e584a7eac7d1e20ef81eac5'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:20.720341 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-ab81f202-1fd3-44c4-bb3a-d92d26ee7036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7509a7e81e584a7eac7d1e20ef81eac5'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:20.726993 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1442/2847] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:18:20 2022] DELETE /identity/v3/users/7509a7e81e584a7eac7d1e20ef81eac5 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:20.731539 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96e34a-106e-4272-8ebb-743dcee41adb None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:20.731828 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96e34a-106e-4272-8ebb-743dcee41adb None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:20.732139 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96e34a-106e-4272-8ebb-743dcee41adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:20.750597 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-0b96e34a-106e-4272-8ebb-743dcee41adb None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:20.751806 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0b96e34a-106e-4272-8ebb-743dcee41adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:20.760843 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:20.816657 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1443/2848] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:18:20.822265 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-eb074e79-c443-4fb8-9434-84b942cd1ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a5147e010f431aa463c24e5f56fbaf'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:20.823221 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-eb074e79-c443-4fb8-9434-84b942cd1ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a5147e010f431aa463c24e5f56fbaf'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:20.824449 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96e34a-106e-4272-8ebb-743dcee41adb None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:20.826118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0b96e34a-106e-4272-8ebb-743dcee41adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:20.837237 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-eb074e79-c443-4fb8-9434-84b942cd1ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a5147e010f431aa463c24e5f56fbaf'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:20.885839 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96e34a-106e-4272-8ebb-743dcee41adb None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:20.891846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99166dac-fc64-43fb-a469-a35f6dd3d0ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:20.892572 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99166dac-fc64-43fb-a469-a35f6dd3d0ed service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:20.892860 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99166dac-fc64-43fb-a469-a35f6dd3d0ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:20.893339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99166dac-fc64-43fb-a469-a35f6dd3d0ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:20.900366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-eb074e79-c443-4fb8-9434-84b942cd1ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a5147e010f431aa463c24e5f56fbaf'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:20.902702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-eb074e79-c443-4fb8-9434-84b942cd1ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a5147e010f431aa463c24e5f56fbaf'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:20.904197 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99166dac-fc64-43fb-a469-a35f6dd3d0ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:20.905918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99166dac-fc64-43fb-a469-a35f6dd3d0ed service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:20.916277 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1406/2849] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:18:20 2022] DELETE /identity/v3/users/11a5147e010f431aa463c24e5f56fbaf => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:18:20.916452 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1444/2850] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:18:20.920676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32c432-cc53-438f-9d4d-f0a6e5766fec None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:20.920960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32c432-cc53-438f-9d4d-f0a6e5766fec None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:20.921263 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32c432-cc53-438f-9d4d-f0a6e5766fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:20.940882 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-4c32c432-cc53-438f-9d4d-f0a6e5766fec None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:20.942103 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4c32c432-cc53-438f-9d4d-f0a6e5766fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:20.968580 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:21.003975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1407/2851] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:18:21.014448 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99166dac-fc64-43fb-a469-a35f6dd3d0ed service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:21.015925 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-99166dac-fc64-43fb-a469-a35f6dd3d0ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:21.027340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99166dac-fc64-43fb-a469-a35f6dd3d0ed service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:21.076994 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0441fc-a5e9-4a05-9315-7e0509576ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:21.077527 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0441fc-a5e9-4a05-9315-7e0509576ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:21.077813 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0441fc-a5e9-4a05-9315-7e0509576ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:21.078085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0441fc-a5e9-4a05-9315-7e0509576ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:21.088100 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0441fc-a5e9-4a05-9315-7e0509576ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:21.089573 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0441fc-a5e9-4a05-9315-7e0509576ec7 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:21.099501 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1445/2852] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:18:21.347298 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32c432-cc53-438f-9d4d-f0a6e5766fec None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:21.349189 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-4c32c432-cc53-438f-9d4d-f0a6e5766fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:21.377023 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32c432-cc53-438f-9d4d-f0a6e5766fec None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:21.382819 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:21.383939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:21.383939 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:21.384252 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588 admin admin] PATH_INFO: `/v3/projects/8019beba1e2a4331b385ad3afa189653` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:21.385359 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8019beba1e2a4331b385ad3afa189653)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:21.387284 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:21.505426 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0441fc-a5e9-4a05-9315-7e0509576ec7 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:21.507744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-9d0441fc-a5e9-4a05-9315-7e0509576ec7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:21.522042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0441fc-a5e9-4a05-9315-7e0509576ec7 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:21.522218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8019beba1e2a4331b385ad3afa189653', 'request_id': 'req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:21.528499 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8019beba1e2a4331b385ad3afa189653', 'request_id': 'req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:21.582052 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47daf20-153b-42d9-88ed-d6e906f82332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:21.582679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47daf20-153b-42d9-88ed-d6e906f82332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:21.582958 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47daf20-153b-42d9-88ed-d6e906f82332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:21.583231 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47daf20-153b-42d9-88ed-d6e906f82332 admin admin] PATH_INFO: `/v3/projects/7df663d18818495e99cff28e9f50229e` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:21.584376 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47daf20-153b-42d9-88ed-d6e906f82332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7df663d18818495e99cff28e9f50229e)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:21.586347 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47daf20-153b-42d9-88ed-d6e906f82332 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:21.588793 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=100 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:21.608845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8019beba1e2a4331b385ad3afa189653', 'request_id': 'req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:21.626769 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588 admin admin] The token cache is being invalidate because project 8019beba1e2a4331b385ad3afa189653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:18:21.627067 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:21.627752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:21.629289 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1408/2853] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:18:21 2022] DELETE /identity/v3/projects/8019beba1e2a4331b385ad3afa189653 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:21.633807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:21.635212 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:21.647762 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0f777-6e3d-4bf7-b58e-a4cfc99ec588 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:21.652426 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0650773-960d-4104-83d7-244767683282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:21.653065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0650773-960d-4104-83d7-244767683282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:21.653343 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0650773-960d-4104-83d7-244767683282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:21.653617 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0650773-960d-4104-83d7-244767683282 admin admin] PATH_INFO: `/v3/users/525169d3155b41d6a9cf627275a8b08f` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:21.654739 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0650773-960d-4104-83d7-244767683282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=525169d3155b41d6a9cf627275a8b08f)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:21.656715 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0650773-960d-4104-83d7-244767683282 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:21.705990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d47daf20-153b-42d9-88ed-d6e906f82332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7df663d18818495e99cff28e9f50229e', 'request_id': 'req-d47daf20-153b-42d9-88ed-d6e906f82332'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:21.820383 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d47daf20-153b-42d9-88ed-d6e906f82332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7df663d18818495e99cff28e9f50229e', 'request_id': 'req-d47daf20-153b-42d9-88ed-d6e906f82332'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:21.827176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d47daf20-153b-42d9-88ed-d6e906f82332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7df663d18818495e99cff28e9f50229e', 'request_id': 'req-d47daf20-153b-42d9-88ed-d6e906f82332'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:21.838313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d47daf20-153b-42d9-88ed-d6e906f82332 admin admin] The token cache is being invalidate because project 7df663d18818495e99cff28e9f50229e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:18:21.838611 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d47daf20-153b-42d9-88ed-d6e906f82332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:21.839254 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d47daf20-153b-42d9-88ed-d6e906f82332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:21.840777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1446/2854] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:18:21 2022] DELETE /identity/v3/projects/7df663d18818495e99cff28e9f50229e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:21.907593 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f0650773-960d-4104-83d7-244767683282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525169d3155b41d6a9cf627275a8b08f'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:21.908213 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f0650773-960d-4104-83d7-244767683282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525169d3155b41d6a9cf627275a8b08f'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:21.922575 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f0650773-960d-4104-83d7-244767683282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525169d3155b41d6a9cf627275a8b08f'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:21.997992 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f0650773-960d-4104-83d7-244767683282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525169d3155b41d6a9cf627275a8b08f'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:21.998714 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f0650773-960d-4104-83d7-244767683282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525169d3155b41d6a9cf627275a8b08f'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:22.013200 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1409/2855] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:18:21 2022] DELETE /identity/v3/users/525169d3155b41d6a9cf627275a8b08f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:18:22.471277 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47daf20-153b-42d9-88ed-d6e906f82332 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:22.472744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d47daf20-153b-42d9-88ed-d6e906f82332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:22.539520 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47daf20-153b-42d9-88ed-d6e906f82332 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:22.593948 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242e180-1175-494e-b043-e85a811b7027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:22.594593 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242e180-1175-494e-b043-e85a811b7027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:22.594877 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242e180-1175-494e-b043-e85a811b7027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:22.595153 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242e180-1175-494e-b043-e85a811b7027 admin admin] PATH_INFO: `/v3/projects/cf4d9e59d3e94e608ed81a098838e002` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:22.596301 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242e180-1175-494e-b043-e85a811b7027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf4d9e59d3e94e608ed81a098838e002)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:22.598202 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242e180-1175-494e-b043-e85a811b7027 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:22.912050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:22.920418 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1242e180-1175-494e-b043-e85a811b7027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf4d9e59d3e94e608ed81a098838e002', 'request_id': 'req-1242e180-1175-494e-b043-e85a811b7027'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:23.065483 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1242e180-1175-494e-b043-e85a811b7027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf4d9e59d3e94e608ed81a098838e002', 'request_id': 'req-1242e180-1175-494e-b043-e85a811b7027'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:23.072375 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1242e180-1175-494e-b043-e85a811b7027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf4d9e59d3e94e608ed81a098838e002', 'request_id': 'req-1242e180-1175-494e-b043-e85a811b7027'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:23.083999 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1242e180-1175-494e-b043-e85a811b7027 admin admin] The token cache is being invalidate because project cf4d9e59d3e94e608ed81a098838e002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:18:23.084295 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1242e180-1175-494e-b043-e85a811b7027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:23.085408 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-1242e180-1175-494e-b043-e85a811b7027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:23.086929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1447/2856] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:18:22 2022] DELETE /identity/v3/projects/cf4d9e59d3e94e608ed81a098838e002 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:23.092014 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b257e5c-71a2-4dc3-a042-4a9a3292b8d7 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:23.092519 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b257e5c-71a2-4dc3-a042-4a9a3292b8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:23.092622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b257e5c-71a2-4dc3-a042-4a9a3292b8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:23.112697 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-8b257e5c-71a2-4dc3-a042-4a9a3292b8d7 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:23.113903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-8b257e5c-71a2-4dc3-a042-4a9a3292b8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:23.133794 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:23.174419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1410/2857] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:23.183243 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182517b-6e90-43a1-89d5-561b82ea2ac3 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:23.183534 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182517b-6e90-43a1-89d5-561b82ea2ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:23.183814 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182517b-6e90-43a1-89d5-561b82ea2ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:23.203806 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-0182517b-6e90-43a1-89d5-561b82ea2ac3 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:23.205328 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0182517b-6e90-43a1-89d5-561b82ea2ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:23.216224 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1448/2858] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:23.220680 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b257e5c-71a2-4dc3-a042-4a9a3292b8d7 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:23.231190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b257e5c-71a2-4dc3-a042-4a9a3292b8d7 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:23.235847 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da1ea7-323d-4c96-af68-ae276e030e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:23.236478 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da1ea7-323d-4c96-af68-ae276e030e1e admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:23.242374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da1ea7-323d-4c96-af68-ae276e030e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:23.242374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da1ea7-323d-4c96-af68-ae276e030e1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:23.242374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da1ea7-323d-4c96-af68-ae276e030e1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:18:23.242374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da1ea7-323d-4c96-af68-ae276e030e1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:23.242374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da1ea7-323d-4c96-af68-ae276e030e1e admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:23.251078 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1411/2859] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:18:23.255504 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182517b-6e90-43a1-89d5-561b82ea2ac3 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:23.265656 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182517b-6e90-43a1-89d5-561b82ea2ac3 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:23.270644 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d5c7-caf5-4aac-85ed-8df1137e86ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:23.271249 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d5c7-caf5-4aac-85ed-8df1137e86ed admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:23.271561 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d5c7-caf5-4aac-85ed-8df1137e86ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:23.271844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d5c7-caf5-4aac-85ed-8df1137e86ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:23.273064 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05d5c7-caf5-4aac-85ed-8df1137e86ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:23.274981 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05d5c7-caf5-4aac-85ed-8df1137e86ed admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:23.404734 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1449/2860] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:18:23 2022] POST /identity/v3/projects => generated 359 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:23.409108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da1ea7-323d-4c96-af68-ae276e030e1e admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:23.419831 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da1ea7-323d-4c96-af68-ae276e030e1e admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:23.477159 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b5e0e-61e9-4dd0-937b-bfa5df511b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:23.477709 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b5e0e-61e9-4dd0-937b-bfa5df511b52 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:23.477971 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b5e0e-61e9-4dd0-937b-bfa5df511b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:23.478246 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b5e0e-61e9-4dd0-937b-bfa5df511b52 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:23.478870 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b5e0e-61e9-4dd0-937b-bfa5df511b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:23.480826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b5e0e-61e9-4dd0-937b-bfa5df511b52 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:23.587316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1412/2861] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:18:23 2022] POST /identity/v3/users => generated 280 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:23.591522 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d5c7-caf5-4aac-85ed-8df1137e86ed admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:23.601888 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d5c7-caf5-4aac-85ed-8df1137e86ed admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:23.606909 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a39f1-4854-4d9b-9e19-42882dd33cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:23.607553 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a39f1-4854-4d9b-9e19-42882dd33cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:23.607842 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a39f1-4854-4d9b-9e19-42882dd33cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:23.608154 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a39f1-4854-4d9b-9e19-42882dd33cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:23.608803 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a39f1-4854-4d9b-9e19-42882dd33cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:23.610443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a39f1-4854-4d9b-9e19-42882dd33cc5 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:23.620703 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1450/2862] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:23.625074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b5e0e-61e9-4dd0-937b-bfa5df511b52 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:23.635828 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b5e0e-61e9-4dd0-937b-bfa5df511b52 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:23.641048 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74179e68-3316-481b-9681-f6dcb7e04770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:23.641655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74179e68-3316-481b-9681-f6dcb7e04770 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:23.641960 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74179e68-3316-481b-9681-f6dcb7e04770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:23.642266 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74179e68-3316-481b-9681-f6dcb7e04770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:23.642965 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74179e68-3316-481b-9681-f6dcb7e04770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:23.644620 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74179e68-3316-481b-9681-f6dcb7e04770 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:23.656097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1413/2863] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:23.660379 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a39f1-4854-4d9b-9e19-42882dd33cc5 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:23.670303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a39f1-4854-4d9b-9e19-42882dd33cc5 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:23.674846 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00555d69-9aa4-49db-b3c4-f06623b26fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:23.675488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00555d69-9aa4-49db-b3c4-f06623b26fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:23.675771 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00555d69-9aa4-49db-b3c4-f06623b26fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:23.676066 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00555d69-9aa4-49db-b3c4-f06623b26fe2 admin admin] PATH_INFO: `/v3/projects/1f92824eb7bf49e1accf5b33b22b789f/users/deb0e23351bc47979607c2b13dfe0758/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:23.691545 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00555d69-9aa4-49db-b3c4-f06623b26fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f92824eb7bf49e1accf5b33b22b789f, user_id=deb0e23351bc47979607c2b13dfe0758, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:23.694278 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00555d69-9aa4-49db-b3c4-f06623b26fe2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:23.812987 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1451/2864] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:23 2022] PUT /identity/v3/projects/1f92824eb7bf49e1accf5b33b22b789f/users/deb0e23351bc47979607c2b13dfe0758/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:23.823430 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dec6b0-cab9-46a7-b0dd-09cb40d75821 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:23.823717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dec6b0-cab9-46a7-b0dd-09cb40d75821 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:23.824038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dec6b0-cab9-46a7-b0dd-09cb40d75821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:23.852874 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b9dec6b0-cab9-46a7-b0dd-09cb40d75821 None None] MFA Rules not processed for user `deb0e23351bc47979607c2b13dfe0758`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:23.854113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b9dec6b0-cab9-46a7-b0dd-09cb40d75821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:23.918170 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1414/2865] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:23.951443 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00555d69-9aa4-49db-b3c4-f06623b26fe2 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:23.953163 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-00555d69-9aa4-49db-b3c4-f06623b26fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:24.010669 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00555d69-9aa4-49db-b3c4-f06623b26fe2 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:24.014276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5ab80-607e-4806-a55c-4d928afca024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:24.014880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5ab80-607e-4806-a55c-4d928afca024 service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:24.015157 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5ab80-607e-4806-a55c-4d928afca024 service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:24.015427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5ab80-607e-4806-a55c-4d928afca024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:24.024617 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5ab80-607e-4806-a55c-4d928afca024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:24.026047 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5ab80-607e-4806-a55c-4d928afca024 service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:24.035017 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1452/2866] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:18:24.050769 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dec6b0-cab9-46a7-b0dd-09cb40d75821 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:24.077624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:24.114043 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dec6b0-cab9-46a7-b0dd-09cb40d75821 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:24.119236 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ee5ce-293b-4bce-96e3-86eb69ccd96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:24.120255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ee5ce-293b-4bce-96e3-86eb69ccd96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:24.120255 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ee5ce-293b-4bce-96e3-86eb69ccd96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:24.120475 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ee5ce-293b-4bce-96e3-86eb69ccd96c admin admin] PATH_INFO: `/v3/users/deb0e23351bc47979607c2b13dfe0758` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:24.121548 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ee5ce-293b-4bce-96e3-86eb69ccd96c admin admin] RBAC: Authorizing `identity:delete_user(user_id=deb0e23351bc47979607c2b13dfe0758)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:24.123451 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ee5ce-293b-4bce-96e3-86eb69ccd96c admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:24.292881 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1a5ee5ce-293b-4bce-96e3-86eb69ccd96c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deb0e23351bc47979607c2b13dfe0758'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:24.293563 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1a5ee5ce-293b-4bce-96e3-86eb69ccd96c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deb0e23351bc47979607c2b13dfe0758'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:24.305834 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1a5ee5ce-293b-4bce-96e3-86eb69ccd96c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deb0e23351bc47979607c2b13dfe0758'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:24.380114 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1a5ee5ce-293b-4bce-96e3-86eb69ccd96c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deb0e23351bc47979607c2b13dfe0758'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:24.380734 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-1a5ee5ce-293b-4bce-96e3-86eb69ccd96c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deb0e23351bc47979607c2b13dfe0758'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:24.398907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1415/2867] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:18:24 2022] DELETE /identity/v3/users/deb0e23351bc47979607c2b13dfe0758 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:24.404081 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b794cb8-7b00-4ca3-b905-f67993d92bc9 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:24.404385 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b794cb8-7b00-4ca3-b905-f67993d92bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:24.404666 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b794cb8-7b00-4ca3-b905-f67993d92bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:24.424580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-3b794cb8-7b00-4ca3-b905-f67993d92bc9 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:24.425796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3b794cb8-7b00-4ca3-b905-f67993d92bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:24.489014 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1453/2868] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:24.499186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ee5ce-293b-4bce-96e3-86eb69ccd96c admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:24.500629 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1a5ee5ce-293b-4bce-96e3-86eb69ccd96c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:24.558095 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ee5ce-293b-4bce-96e3-86eb69ccd96c admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:24.561717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edfc47-5b54-4688-9125-1c5f41d28ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:24.570786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edfc47-5b54-4688-9125-1c5f41d28ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:24.570786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edfc47-5b54-4688-9125-1c5f41d28ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:24.570786 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edfc47-5b54-4688-9125-1c5f41d28ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:24.573205 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edfc47-5b54-4688-9125-1c5f41d28ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:24.574628 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edfc47-5b54-4688-9125-1c5f41d28ed7 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:24.585120 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1416/2869] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:18:25.146085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b794cb8-7b00-4ca3-b905-f67993d92bc9 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:25.148400 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3b794cb8-7b00-4ca3-b905-f67993d92bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:25.166954 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b794cb8-7b00-4ca3-b905-f67993d92bc9 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:25.172259 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16106b-2b0e-481c-b72b-4c8f8f5159ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:25.172905 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16106b-2b0e-481c-b72b-4c8f8f5159ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:25.173217 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16106b-2b0e-481c-b72b-4c8f8f5159ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:25.173495 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16106b-2b0e-481c-b72b-4c8f8f5159ef admin admin] PATH_INFO: `/v3/projects/1f92824eb7bf49e1accf5b33b22b789f` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:25.174917 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16106b-2b0e-481c-b72b-4c8f8f5159ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f92824eb7bf49e1accf5b33b22b789f)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:25.177097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16106b-2b0e-481c-b72b-4c8f8f5159ef admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:25.180107 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:25.304513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9a16106b-2b0e-481c-b72b-4c8f8f5159ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f92824eb7bf49e1accf5b33b22b789f', 'request_id': 'req-9a16106b-2b0e-481c-b72b-4c8f8f5159ef'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:25.389415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9a16106b-2b0e-481c-b72b-4c8f8f5159ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f92824eb7bf49e1accf5b33b22b789f', 'request_id': 'req-9a16106b-2b0e-481c-b72b-4c8f8f5159ef'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:25.396356 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9a16106b-2b0e-481c-b72b-4c8f8f5159ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f92824eb7bf49e1accf5b33b22b789f', 'request_id': 'req-9a16106b-2b0e-481c-b72b-4c8f8f5159ef'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:25.407209 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9a16106b-2b0e-481c-b72b-4c8f8f5159ef admin admin] The token cache is being invalidate because project 1f92824eb7bf49e1accf5b33b22b789f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81700) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:18:25.407494 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9a16106b-2b0e-481c-b72b-4c8f8f5159ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:25.408176 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9a16106b-2b0e-481c-b72b-4c8f8f5159ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:25.409651 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1454/2870] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:18:25 2022] DELETE /identity/v3/projects/1f92824eb7bf49e1accf5b33b22b789f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:25.414694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3416d2-c654-47b2-9216-2a6fd97a68b9 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:25.415322 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3416d2-c654-47b2-9216-2a6fd97a68b9 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:25.415322 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3416d2-c654-47b2-9216-2a6fd97a68b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:25.435282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-5c3416d2-c654-47b2-9216-2a6fd97a68b9 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:25.436519 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-5c3416d2-c654-47b2-9216-2a6fd97a68b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:25.478111 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:25.496724 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1417/2871] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:25.504613 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06154de9-4e40-4c43-8fce-298992489724 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:25.504899 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06154de9-4e40-4c43-8fce-298992489724 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:25.505171 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06154de9-4e40-4c43-8fce-298992489724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:25.525376 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-06154de9-4e40-4c43-8fce-298992489724 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:25.526568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-06154de9-4e40-4c43-8fce-298992489724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:25.534436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1455/2872] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:25.539251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3416d2-c654-47b2-9216-2a6fd97a68b9 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:25.548946 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3416d2-c654-47b2-9216-2a6fd97a68b9 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:25.556113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a81e1-88db-41a8-8401-3fa647afdee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:25.556113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a81e1-88db-41a8-8401-3fa647afdee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:25.556113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a81e1-88db-41a8-8401-3fa647afdee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:25.556113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a81e1-88db-41a8-8401-3fa647afdee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:25.556556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a81e1-88db-41a8-8401-3fa647afdee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81699) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:18:25.556745 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a81e1-88db-41a8-8401-3fa647afdee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:25.558347 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a81e1-88db-41a8-8401-3fa647afdee2 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:25.569968 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1418/2873] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:18:25.574378 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06154de9-4e40-4c43-8fce-298992489724 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:25.583853 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06154de9-4e40-4c43-8fce-298992489724 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:25.588454 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a619d2a-da79-42f0-b071-f7a69d34acfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:25.589143 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a619d2a-da79-42f0-b071-f7a69d34acfe admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:25.589421 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a619d2a-da79-42f0-b071-f7a69d34acfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:25.589686 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a619d2a-da79-42f0-b071-f7a69d34acfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:25.590310 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a619d2a-da79-42f0-b071-f7a69d34acfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:25.592259 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a619d2a-da79-42f0-b071-f7a69d34acfe admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:25.690083 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1456/2874] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:18:25 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:25.694773 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a81e1-88db-41a8-8401-3fa647afdee2 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:25.705057 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a81e1-88db-41a8-8401-3fa647afdee2 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:25.760155 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10cf2e-ba3e-4aa0-b928-06b14965ef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:25.760765 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10cf2e-ba3e-4aa0-b928-06b14965ef06 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:25.761046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10cf2e-ba3e-4aa0-b928-06b14965ef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:25.761320 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10cf2e-ba3e-4aa0-b928-06b14965ef06 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:25.761955 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10cf2e-ba3e-4aa0-b928-06b14965ef06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:25.763895 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10cf2e-ba3e-4aa0-b928-06b14965ef06 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:25.887152 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1419/2875] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:18:25 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:25.891139 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a619d2a-da79-42f0-b071-f7a69d34acfe admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:25.902011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a619d2a-da79-42f0-b071-f7a69d34acfe admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:25.906586 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9fed8-3ac4-4e67-be95-98097036b7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:25.907177 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9fed8-3ac4-4e67-be95-98097036b7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:25.907459 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9fed8-3ac4-4e67-be95-98097036b7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:25.907736 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9fed8-3ac4-4e67-be95-98097036b7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:25.908425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9fed8-3ac4-4e67-be95-98097036b7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:25.910040 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9fed8-3ac4-4e67-be95-98097036b7c9 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:25.920497 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1457/2876] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:25.924474 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10cf2e-ba3e-4aa0-b928-06b14965ef06 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:25.935313 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10cf2e-ba3e-4aa0-b928-06b14965ef06 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:25.940251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75074765-911f-4932-9893-2b530e1d93e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:25.940845 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75074765-911f-4932-9893-2b530e1d93e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:25.941127 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75074765-911f-4932-9893-2b530e1d93e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:25.941401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75074765-911f-4932-9893-2b530e1d93e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:25.942038 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75074765-911f-4932-9893-2b530e1d93e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:25.943628 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75074765-911f-4932-9893-2b530e1d93e1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:25.955361 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1420/2877] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:25.959516 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9fed8-3ac4-4e67-be95-98097036b7c9 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:25.969488 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9fed8-3ac4-4e67-be95-98097036b7c9 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:25.974093 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c3e81-9cdd-4999-80c7-5481ba3a08dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:25.974733 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3e81-9cdd-4999-80c7-5481ba3a08dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:25.978577 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3e81-9cdd-4999-80c7-5481ba3a08dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:25.978873 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c3e81-9cdd-4999-80c7-5481ba3a08dc admin admin] PATH_INFO: `/v3/projects/e6c17bac159c45598720fd30360c4cb0/users/3e10a779e0554d4d82cfab9f11cebe74/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:26.000370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c3e81-9cdd-4999-80c7-5481ba3a08dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c17bac159c45598720fd30360c4cb0, user_id=3e10a779e0554d4d82cfab9f11cebe74, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:26.003094 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c3e81-9cdd-4999-80c7-5481ba3a08dc admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:26.098232 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1458/2878] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:25 2022] PUT /identity/v3/projects/e6c17bac159c45598720fd30360c4cb0/users/3e10a779e0554d4d82cfab9f11cebe74/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:26.109239 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd629b-7595-4051-ae57-b9858860da00 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:26.109528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd629b-7595-4051-ae57-b9858860da00 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:26.109802 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd629b-7595-4051-ae57-b9858860da00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:26.138523 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-b1dd629b-7595-4051-ae57-b9858860da00 None None] MFA Rules not processed for user `3e10a779e0554d4d82cfab9f11cebe74`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:26.139759 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-b1dd629b-7595-4051-ae57-b9858860da00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:26.204776 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1421/2879] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:18:26.209299 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c3e81-9cdd-4999-80c7-5481ba3a08dc admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:26.275719 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c3e81-9cdd-4999-80c7-5481ba3a08dc admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:26.283299 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98f3ad-1953-4848-b987-bfb64fa4c9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:26.284009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98f3ad-1953-4848-b987-bfb64fa4c9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:26.284291 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98f3ad-1953-4848-b987-bfb64fa4c9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:26.284560 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98f3ad-1953-4848-b987-bfb64fa4c9f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:26.285827 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98f3ad-1953-4848-b987-bfb64fa4c9f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:26.288950 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98f3ad-1953-4848-b987-bfb64fa4c9f7 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:26.387290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1459/2880] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:18:26 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:26.391401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd629b-7595-4051-ae57-b9858860da00 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:26.402187 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd629b-7595-4051-ae57-b9858860da00 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:26.441372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:26.459521 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae892d-b065-4ecf-aac4-7b8622baf151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:26.460164 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae892d-b065-4ecf-aac4-7b8622baf151 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:26.460452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae892d-b065-4ecf-aac4-7b8622baf151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:26.460730 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae892d-b065-4ecf-aac4-7b8622baf151 admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:26.461470 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae892d-b065-4ecf-aac4-7b8622baf151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:26.465353 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae892d-b065-4ecf-aac4-7b8622baf151 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:26.586526 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1422/2881] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:18:26 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:26.590602 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98f3ad-1953-4848-b987-bfb64fa4c9f7 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:26.601267 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98f3ad-1953-4848-b987-bfb64fa4c9f7 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:26.605768 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17f5ca-1b9a-42f5-b97c-8116feaf0359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:26.606361 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17f5ca-1b9a-42f5-b97c-8116feaf0359 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:26.606639 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17f5ca-1b9a-42f5-b97c-8116feaf0359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:26.606913 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17f5ca-1b9a-42f5-b97c-8116feaf0359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:26.607548 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17f5ca-1b9a-42f5-b97c-8116feaf0359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:26.609170 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17f5ca-1b9a-42f5-b97c-8116feaf0359 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:26.621041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1460/2882] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:26.625012 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae892d-b065-4ecf-aac4-7b8622baf151 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:26.635110 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae892d-b065-4ecf-aac4-7b8622baf151 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:26.640043 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf2e0e-876e-4b12-afda-c1f203dc0ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:26.640638 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2e0e-876e-4b12-afda-c1f203dc0ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:26.640917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2e0e-876e-4b12-afda-c1f203dc0ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:26.641212 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2e0e-876e-4b12-afda-c1f203dc0ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:26.647297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf2e0e-876e-4b12-afda-c1f203dc0ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:26.647297 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf2e0e-876e-4b12-afda-c1f203dc0ab2 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:26.654697 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1423/2883] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:26.658830 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17f5ca-1b9a-42f5-b97c-8116feaf0359 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:26.664744 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:26.670190 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17f5ca-1b9a-42f5-b97c-8116feaf0359 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:26.674697 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232c3fb-d083-43e8-93a7-902d553015d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:26.675344 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232c3fb-d083-43e8-93a7-902d553015d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:26.675624 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232c3fb-d083-43e8-93a7-902d553015d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:26.675918 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232c3fb-d083-43e8-93a7-902d553015d3 admin admin] PATH_INFO: `/v3/projects/0e463ccc511c4a80a4dff2d2b2332aeb/users/543c9e39d50c4a91a21aa52034c601dc/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:26.690193 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232c3fb-d083-43e8-93a7-902d553015d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e463ccc511c4a80a4dff2d2b2332aeb, user_id=543c9e39d50c4a91a21aa52034c601dc, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:26.692873 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232c3fb-d083-43e8-93a7-902d553015d3 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:26.801643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1461/2884] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:26 2022] PUT /identity/v3/projects/0e463ccc511c4a80a4dff2d2b2332aeb/users/543c9e39d50c4a91a21aa52034c601dc/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:26.811808 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12054b0-0279-4653-9734-134240cf9820 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:26.812140 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12054b0-0279-4653-9734-134240cf9820 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:26.812419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12054b0-0279-4653-9734-134240cf9820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:26.840956 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-c12054b0-0279-4653-9734-134240cf9820 None None] MFA Rules not processed for user `543c9e39d50c4a91a21aa52034c601dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:26.842218 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c12054b0-0279-4653-9734-134240cf9820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:26.906047 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1424/2885] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:26.910463 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232c3fb-d083-43e8-93a7-902d553015d3 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:26.973082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232c3fb-d083-43e8-93a7-902d553015d3 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:26.978464 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056ec16-8398-4d48-8302-42336a7a1c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:26.979071 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056ec16-8398-4d48-8302-42336a7a1c7b admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:26.979355 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056ec16-8398-4d48-8302-42336a7a1c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:26.979632 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056ec16-8398-4d48-8302-42336a7a1c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:26.980446 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056ec16-8398-4d48-8302-42336a7a1c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:26.982628 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056ec16-8398-4d48-8302-42336a7a1c7b admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:27.086132 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1462/2886] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:18:26 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:27.090084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12054b0-0279-4653-9734-134240cf9820 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:27.100771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12054b0-0279-4653-9734-134240cf9820 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:27.158771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4fb60-d948-4068-a589-8583c8fd3baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:27.159331 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4fb60-d948-4068-a589-8583c8fd3baf admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:27.159586 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4fb60-d948-4068-a589-8583c8fd3baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:27.159854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4fb60-d948-4068-a589-8583c8fd3baf admin admin] PATH_INFO: `/v3/users` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:27.160576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4fb60-d948-4068-a589-8583c8fd3baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:27.162504 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4fb60-d948-4068-a589-8583c8fd3baf admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:27.252685 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1425/2887] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:18:27 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 14:18:27.257615 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056ec16-8398-4d48-8302-42336a7a1c7b admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:27.268395 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056ec16-8398-4d48-8302-42336a7a1c7b admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:27.273609 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c093f-dec6-4141-9832-a99ad71d5844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:27.274213 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c093f-dec6-4141-9832-a99ad71d5844 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:27.274493 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c093f-dec6-4141-9832-a99ad71d5844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:27.274764 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c093f-dec6-4141-9832-a99ad71d5844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:27.275400 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c093f-dec6-4141-9832-a99ad71d5844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:27.277303 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c093f-dec6-4141-9832-a99ad71d5844 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:27.287775 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1463/2888] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:27.291915 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4fb60-d948-4068-a589-8583c8fd3baf admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:27.302015 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4fb60-d948-4068-a589-8583c8fd3baf admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:27.306602 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbfd8c-c9ba-4046-a949-1e3ce28edcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:27.307252 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbfd8c-c9ba-4046-a949-1e3ce28edcb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:27.307535 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbfd8c-c9ba-4046-a949-1e3ce28edcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:27.307812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbfd8c-c9ba-4046-a949-1e3ce28edcb1 admin admin] PATH_INFO: `/v3/projects/17b8e3aaadcb407e8ca349f63f603bce/users/5d0e492f386b4c6295d50cd9ee24dd75/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:27.323576 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbfd8c-c9ba-4046-a949-1e3ce28edcb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b8e3aaadcb407e8ca349f63f603bce, user_id=5d0e492f386b4c6295d50cd9ee24dd75, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:27.326328 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbfd8c-c9ba-4046-a949-1e3ce28edcb1 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:27.414945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1426/2889] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:27 2022] PUT /identity/v3/projects/17b8e3aaadcb407e8ca349f63f603bce/users/5d0e492f386b4c6295d50cd9ee24dd75/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:27.419009 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c093f-dec6-4141-9832-a99ad71d5844 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:27.428881 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c093f-dec6-4141-9832-a99ad71d5844 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:27.485689 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832c91b-0ac2-4f8b-a928-b3b89e4f7ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:27.486293 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832c91b-0ac2-4f8b-a928-b3b89e4f7ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:27.486577 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832c91b-0ac2-4f8b-a928-b3b89e4f7ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:27.486854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832c91b-0ac2-4f8b-a928-b3b89e4f7ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:27.487493 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832c91b-0ac2-4f8b-a928-b3b89e4f7ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:27.489120 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832c91b-0ac2-4f8b-a928-b3b89e4f7ed2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:27.498885 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1464/2890] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:27.502987 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbfd8c-c9ba-4046-a949-1e3ce28edcb1 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:27.513777 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbfd8c-c9ba-4046-a949-1e3ce28edcb1 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:27.518555 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5e3c2-bb55-4fe5-adce-ba933b46cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:27.523583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5e3c2-bb55-4fe5-adce-ba933b46cc9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:27.523583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5e3c2-bb55-4fe5-adce-ba933b46cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:27.523583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5e3c2-bb55-4fe5-adce-ba933b46cc9a admin admin] PATH_INFO: `/v3/projects/17b8e3aaadcb407e8ca349f63f603bce/users/5d0e492f386b4c6295d50cd9ee24dd75/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:27.523583 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5e3c2-bb55-4fe5-adce-ba933b46cc9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b8e3aaadcb407e8ca349f63f603bce, user_id=5d0e492f386b4c6295d50cd9ee24dd75, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:27.524830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5e3c2-bb55-4fe5-adce-ba933b46cc9a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:27.531181 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:27.536105 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1427/2891] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:27 2022] PUT /identity/v3/projects/17b8e3aaadcb407e8ca349f63f603bce/users/5d0e492f386b4c6295d50cd9ee24dd75/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:18:27.605634 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91646747-700a-4935-90ef-44a39e3e6067 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:27.605926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91646747-700a-4935-90ef-44a39e3e6067 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:27.606205 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91646747-700a-4935-90ef-44a39e3e6067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:27.634206 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-91646747-700a-4935-90ef-44a39e3e6067 None None] MFA Rules not processed for user `5d0e492f386b4c6295d50cd9ee24dd75`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:27.635438 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-91646747-700a-4935-90ef-44a39e3e6067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:27.674805 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:27.704755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1465/2892] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:27.716515 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5e3c2-bb55-4fe5-adce-ba933b46cc9a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:27.718572 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-34a5e3c2-bb55-4fe5-adce-ba933b46cc9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:27.776970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5e3c2-bb55-4fe5-adce-ba933b46cc9a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:27.781030 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81d75f-0f86-423f-be18-d392804e474b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:27.781642 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81d75f-0f86-423f-be18-d392804e474b service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:27.781917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81d75f-0f86-423f-be18-d392804e474b service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:27.782190 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81d75f-0f86-423f-be18-d392804e474b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:27.840851 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81d75f-0f86-423f-be18-d392804e474b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:27.842271 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81d75f-0f86-423f-be18-d392804e474b service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:27.851541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1428/2893] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:18:31.206897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91646747-700a-4935-90ef-44a39e3e6067 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:31.216757 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91646747-700a-4935-90ef-44a39e3e6067 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:31.220260 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9a99e-cbbd-454e-9a3b-f0fdadb88b9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:31.220857 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9a99e-cbbd-454e-9a3b-f0fdadb88b9b service cinder] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:31.221135 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9a99e-cbbd-454e-9a3b-f0fdadb88b9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:31.221405 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9a99e-cbbd-454e-9a3b-f0fdadb88b9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:31.277949 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9a99e-cbbd-454e-9a3b-f0fdadb88b9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:31.279385 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9a99e-cbbd-454e-9a3b-f0fdadb88b9b service cinder] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:31.288283 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1466/2894] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:18:32.960385 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81d75f-0f86-423f-be18-d392804e474b service cinder] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:32.969049 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81d75f-0f86-423f-be18-d392804e474b service cinder] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:32.972734 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b7f59-780e-44f5-9197-1f7b41771d61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92870867b169496fa8913b2ab93eac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:32.973332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b7f59-780e-44f5-9197-1f7b41771d61 service cinder] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:32.973613 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b7f59-780e-44f5-9197-1f7b41771d61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:32.973889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b7f59-780e-44f5-9197-1f7b41771d61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:32.982818 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b7f59-780e-44f5-9197-1f7b41771d61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:32.984282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b7f59-780e-44f5-9197-1f7b41771d61 service cinder] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:32.994456 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1429/2895] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:18:37.625338 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9a99e-cbbd-454e-9a3b-f0fdadb88b9b service cinder] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:37.688817 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9a99e-cbbd-454e-9a3b-f0fdadb88b9b service cinder] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:37.693427 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961be32-0728-49a8-a491-d85a99cd95f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:37.694053 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961be32-0728-49a8-a491-d85a99cd95f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:37.694339 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961be32-0728-49a8-a491-d85a99cd95f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:37.694618 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961be32-0728-49a8-a491-d85a99cd95f0 admin admin] PATH_INFO: `/v3/users/3e10a779e0554d4d82cfab9f11cebe74` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:37.695743 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961be32-0728-49a8-a491-d85a99cd95f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e10a779e0554d4d82cfab9f11cebe74)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:37.697714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961be32-0728-49a8-a491-d85a99cd95f0 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:38.032874 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9961be32-0728-49a8-a491-d85a99cd95f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e10a779e0554d4d82cfab9f11cebe74'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:38.044515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9961be32-0728-49a8-a491-d85a99cd95f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e10a779e0554d4d82cfab9f11cebe74'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:38.156931 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9961be32-0728-49a8-a491-d85a99cd95f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e10a779e0554d4d82cfab9f11cebe74'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:38.159364 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:38.165460 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9961be32-0728-49a8-a491-d85a99cd95f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e10a779e0554d4d82cfab9f11cebe74'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:38.173097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-9961be32-0728-49a8-a491-d85a99cd95f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e10a779e0554d4d82cfab9f11cebe74'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:38.173097 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1467/2896] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:18:37 2022] DELETE /identity/v3/users/3e10a779e0554d4d82cfab9f11cebe74 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:38.176755 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd60e40-1238-4d40-8698-f43b8129ed27 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:38.177237 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd60e40-1238-4d40-8698-f43b8129ed27 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:38.177348 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd60e40-1238-4d40-8698-f43b8129ed27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:38.197109 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-bfd60e40-1238-4d40-8698-f43b8129ed27 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:38.198360 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bfd60e40-1238-4d40-8698-f43b8129ed27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:38.258007 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1430/2897] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:38.267892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961be32-0728-49a8-a491-d85a99cd95f0 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:38.269340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-9961be32-0728-49a8-a491-d85a99cd95f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:38.326533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961be32-0728-49a8-a491-d85a99cd95f0 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:38.330396 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829bcf-d1e0-47de-99b4-3b8dcd1e5d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:38.330996 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829bcf-d1e0-47de-99b4-3b8dcd1e5d15 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:38.331276 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829bcf-d1e0-47de-99b4-3b8dcd1e5d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:38.331549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829bcf-d1e0-47de-99b4-3b8dcd1e5d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:38.340436 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb829bcf-d1e0-47de-99b4-3b8dcd1e5d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:38.358062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb829bcf-d1e0-47de-99b4-3b8dcd1e5d15 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:38.358062 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1468/2898] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:18:38.810618 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd60e40-1238-4d40-8698-f43b8129ed27 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:38.818904 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-bfd60e40-1238-4d40-8698-f43b8129ed27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:38.824799 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd60e40-1238-4d40-8698-f43b8129ed27 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:38.829772 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae27ace-166e-40a9-bdea-ae236fb4cff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:38.830411 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae27ace-166e-40a9-bdea-ae236fb4cff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:38.830695 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae27ace-166e-40a9-bdea-ae236fb4cff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:38.830966 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae27ace-166e-40a9-bdea-ae236fb4cff6 admin admin] PATH_INFO: `/v3/projects/e6c17bac159c45598720fd30360c4cb0` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:38.832123 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae27ace-166e-40a9-bdea-ae236fb4cff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c17bac159c45598720fd30360c4cb0)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:38.834040 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae27ace-166e-40a9-bdea-ae236fb4cff6 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:38.931628 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:38.940096 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7ae27ace-166e-40a9-bdea-ae236fb4cff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c17bac159c45598720fd30360c4cb0', 'request_id': 'req-7ae27ace-166e-40a9-bdea-ae236fb4cff6'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:38.946035 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7ae27ace-166e-40a9-bdea-ae236fb4cff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c17bac159c45598720fd30360c4cb0', 'request_id': 'req-7ae27ace-166e-40a9-bdea-ae236fb4cff6'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:39.031198 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7ae27ace-166e-40a9-bdea-ae236fb4cff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c17bac159c45598720fd30360c4cb0', 'request_id': 'req-7ae27ace-166e-40a9-bdea-ae236fb4cff6'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:39.052175 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7ae27ace-166e-40a9-bdea-ae236fb4cff6 admin admin] The token cache is being invalidate because project e6c17bac159c45598720fd30360c4cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:18:39.052474 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7ae27ace-166e-40a9-bdea-ae236fb4cff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:39.053914 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-7ae27ace-166e-40a9-bdea-ae236fb4cff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:39.055678 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1431/2899] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:18:38 2022] DELETE /identity/v3/projects/e6c17bac159c45598720fd30360c4cb0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:39.060945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829bcf-d1e0-47de-99b4-3b8dcd1e5d15 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:39.070817 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829bcf-d1e0-47de-99b4-3b8dcd1e5d15 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:39.127099 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76313fa-6a7f-47a6-a392-34cde7f44ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:39.127719 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76313fa-6a7f-47a6-a392-34cde7f44ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:39.128038 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76313fa-6a7f-47a6-a392-34cde7f44ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:39.128316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76313fa-6a7f-47a6-a392-34cde7f44ce0 admin admin] PATH_INFO: `/v3/users/543c9e39d50c4a91a21aa52034c601dc` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:39.129425 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76313fa-6a7f-47a6-a392-34cde7f44ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=543c9e39d50c4a91a21aa52034c601dc)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:39.131326 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76313fa-6a7f-47a6-a392-34cde7f44ce0 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:39.324542 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d76313fa-6a7f-47a6-a392-34cde7f44ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '543c9e39d50c4a91a21aa52034c601dc'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:39.337729 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d76313fa-6a7f-47a6-a392-34cde7f44ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '543c9e39d50c4a91a21aa52034c601dc'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:39.431266 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d76313fa-6a7f-47a6-a392-34cde7f44ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '543c9e39d50c4a91a21aa52034c601dc'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:39.440678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d76313fa-6a7f-47a6-a392-34cde7f44ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '543c9e39d50c4a91a21aa52034c601dc'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:39.444082 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-d76313fa-6a7f-47a6-a392-34cde7f44ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '543c9e39d50c4a91a21aa52034c601dc'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:39.448290 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1469/2900] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:18:39 2022] DELETE /identity/v3/users/543c9e39d50c4a91a21aa52034c601dc => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:39.913414 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae27ace-166e-40a9-bdea-ae236fb4cff6 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:39.914867 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-7ae27ace-166e-40a9-bdea-ae236fb4cff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:39.928546 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae27ace-166e-40a9-bdea-ae236fb4cff6 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:39.985631 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ad47d-eea7-438d-8ad6-fc55fed85b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:39.986267 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ad47d-eea7-438d-8ad6-fc55fed85b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:39.986549 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ad47d-eea7-438d-8ad6-fc55fed85b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:39.986826 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ad47d-eea7-438d-8ad6-fc55fed85b34 admin admin] PATH_INFO: `/v3/projects/0e463ccc511c4a80a4dff2d2b2332aeb` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:39.987976 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ad47d-eea7-438d-8ad6-fc55fed85b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e463ccc511c4a80a4dff2d2b2332aeb)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:39.989895 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ad47d-eea7-438d-8ad6-fc55fed85b34 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:40.129393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f95ad47d-eea7-438d-8ad6-fc55fed85b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e463ccc511c4a80a4dff2d2b2332aeb', 'request_id': 'req-f95ad47d-eea7-438d-8ad6-fc55fed85b34'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:40.134909 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f95ad47d-eea7-438d-8ad6-fc55fed85b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e463ccc511c4a80a4dff2d2b2332aeb', 'request_id': 'req-f95ad47d-eea7-438d-8ad6-fc55fed85b34'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:40.226093 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f95ad47d-eea7-438d-8ad6-fc55fed85b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e463ccc511c4a80a4dff2d2b2332aeb', 'request_id': 'req-f95ad47d-eea7-438d-8ad6-fc55fed85b34'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:40.238078 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f95ad47d-eea7-438d-8ad6-fc55fed85b34 admin admin] The token cache is being invalidate because project 0e463ccc511c4a80a4dff2d2b2332aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:18:40.238375 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f95ad47d-eea7-438d-8ad6-fc55fed85b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:40.239117 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-f95ad47d-eea7-438d-8ad6-fc55fed85b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:40.240659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1432/2901] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:18:39 2022] DELETE /identity/v3/projects/0e463ccc511c4a80a4dff2d2b2332aeb => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:40.244719 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76313fa-6a7f-47a6-a392-34cde7f44ce0 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:40.246187 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d76313fa-6a7f-47a6-a392-34cde7f44ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:40.259409 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76313fa-6a7f-47a6-a392-34cde7f44ce0 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:40.268163 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:40.316490 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9006180-840b-4d9b-9358-a4de04b4af51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:40.317118 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9006180-840b-4d9b-9358-a4de04b4af51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:40.317401 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9006180-840b-4d9b-9358-a4de04b4af51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:40.317679 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9006180-840b-4d9b-9358-a4de04b4af51 admin admin] PATH_INFO: `/v3/users/5d0e492f386b4c6295d50cd9ee24dd75` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:40.318808 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9006180-840b-4d9b-9358-a4de04b4af51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0e492f386b4c6295d50cd9ee24dd75)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:40.320777 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9006180-840b-4d9b-9358-a4de04b4af51 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:40.542252 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c9006180-840b-4d9b-9358-a4de04b4af51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0e492f386b4c6295d50cd9ee24dd75'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:40.555075 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c9006180-840b-4d9b-9358-a4de04b4af51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0e492f386b4c6295d50cd9ee24dd75'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:40.624042 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c9006180-840b-4d9b-9358-a4de04b4af51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0e492f386b4c6295d50cd9ee24dd75'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:40.631977 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c9006180-840b-4d9b-9358-a4de04b4af51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0e492f386b4c6295d50cd9ee24dd75'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:40.632708 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-c9006180-840b-4d9b-9358-a4de04b4af51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0e492f386b4c6295d50cd9ee24dd75'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:40.638638 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1470/2902] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:18:40 2022] DELETE /identity/v3/users/5d0e492f386b4c6295d50cd9ee24dd75 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:41.107252 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ad47d-eea7-438d-8ad6-fc55fed85b34 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:41.108900 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-f95ad47d-eea7-438d-8ad6-fc55fed85b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:41.122635 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ad47d-eea7-438d-8ad6-fc55fed85b34 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:41.176176 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:41.183771 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a7e5c-2ea3-4485-83c8-5bb530e13923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:41.184598 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a7e5c-2ea3-4485-83c8-5bb530e13923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:41.185033 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a7e5c-2ea3-4485-83c8-5bb530e13923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:41.185431 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a7e5c-2ea3-4485-83c8-5bb530e13923 admin admin] PATH_INFO: `/v3/projects/17b8e3aaadcb407e8ca349f63f603bce` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:41.186782 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a7e5c-2ea3-4485-83c8-5bb530e13923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b8e3aaadcb407e8ca349f63f603bce)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:41.188911 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a7e5c-2ea3-4485-83c8-5bb530e13923 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:41.331850 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4f0a7e5c-2ea3-4485-83c8-5bb530e13923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b8e3aaadcb407e8ca349f63f603bce', 'request_id': 'req-4f0a7e5c-2ea3-4485-83c8-5bb530e13923'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:41.337312 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4f0a7e5c-2ea3-4485-83c8-5bb530e13923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b8e3aaadcb407e8ca349f63f603bce', 'request_id': 'req-4f0a7e5c-2ea3-4485-83c8-5bb530e13923'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:41.475436 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4f0a7e5c-2ea3-4485-83c8-5bb530e13923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b8e3aaadcb407e8ca349f63f603bce', 'request_id': 'req-4f0a7e5c-2ea3-4485-83c8-5bb530e13923'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:41.486975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4f0a7e5c-2ea3-4485-83c8-5bb530e13923 admin admin] The token cache is being invalidate because project 17b8e3aaadcb407e8ca349f63f603bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:18:41.487277 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4f0a7e5c-2ea3-4485-83c8-5bb530e13923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:41.488021 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-4f0a7e5c-2ea3-4485-83c8-5bb530e13923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:18:41.489503 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1433/2903] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:18:41 2022] DELETE /identity/v3/projects/17b8e3aaadcb407e8ca349f63f603bce => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:18:41.495068 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466889d-a69c-4e3b-91a6-978103287209 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:41.495589 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466889d-a69c-4e3b-91a6-978103287209 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:41.495705 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466889d-a69c-4e3b-91a6-978103287209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:41.515417 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-1466889d-a69c-4e3b-91a6-978103287209 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:41.516667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-1466889d-a69c-4e3b-91a6-978103287209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:41.576046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1471/2904] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:41.584371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a29463-0186-4d1c-a51c-470870b8b43b None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:41.584692 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a29463-0186-4d1c-a51c-470870b8b43b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:41.584972 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a29463-0186-4d1c-a51c-470870b8b43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:41.605772 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-51a29463-0186-4d1c-a51c-470870b8b43b None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:41.606989 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-51a29463-0186-4d1c-a51c-470870b8b43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:41.615004 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1434/2905] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:18:41.619824 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466889d-a69c-4e3b-91a6-978103287209 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:41.629557 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466889d-a69c-4e3b-91a6-978103287209 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:41.635466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34164e9-d023-4a57-be08-dffa910cc616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:41.635466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34164e9-d023-4a57-be08-dffa910cc616 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:41.635466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34164e9-d023-4a57-be08-dffa910cc616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:41.635466 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34164e9-d023-4a57-be08-dffa910cc616 admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:41.635908 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34164e9-d023-4a57-be08-dffa910cc616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:18:41.636247 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34164e9-d023-4a57-be08-dffa910cc616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:41.637838 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34164e9-d023-4a57-be08-dffa910cc616 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:41.649949 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1472/2906] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:18:41.654393 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a29463-0186-4d1c-a51c-470870b8b43b None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:41.664342 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a29463-0186-4d1c-a51c-470870b8b43b None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:41.669272 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea179c2-881b-4fb1-982b-b8e09dc8cc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:41.669880 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea179c2-881b-4fb1-982b-b8e09dc8cc6b admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:41.670192 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea179c2-881b-4fb1-982b-b8e09dc8cc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:41.670467 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea179c2-881b-4fb1-982b-b8e09dc8cc6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:41.671107 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea179c2-881b-4fb1-982b-b8e09dc8cc6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:41.673057 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea179c2-881b-4fb1-982b-b8e09dc8cc6b admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:41.770405 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1435/2907] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:18:41 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:41.775113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34164e9-d023-4a57-be08-dffa910cc616 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:41.785309 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34164e9-d023-4a57-be08-dffa910cc616 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:41.802766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:41.841630 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aca927-952b-4510-91a7-2cb5114d72f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:41.842234 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aca927-952b-4510-91a7-2cb5114d72f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:41.842518 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aca927-952b-4510-91a7-2cb5114d72f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:41.842796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aca927-952b-4510-91a7-2cb5114d72f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:41.843435 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aca927-952b-4510-91a7-2cb5114d72f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:41.845423 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aca927-952b-4510-91a7-2cb5114d72f2 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:41.972191 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1473/2908] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:18:41 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:18:41.976532 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea179c2-881b-4fb1-982b-b8e09dc8cc6b admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:41.986945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea179c2-881b-4fb1-982b-b8e09dc8cc6b admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:41.992270 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c2f40-81b2-485c-9020-846479e6b4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:41.992873 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c2f40-81b2-485c-9020-846479e6b4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:41.993159 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c2f40-81b2-485c-9020-846479e6b4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:41.993434 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c2f40-81b2-485c-9020-846479e6b4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:41.994085 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c2f40-81b2-485c-9020-846479e6b4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:41.995717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c2f40-81b2-485c-9020-846479e6b4b7 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:42.006232 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1436/2909] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:42.010226 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aca927-952b-4510-91a7-2cb5114d72f2 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:42.020629 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aca927-952b-4510-91a7-2cb5114d72f2 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:42.025368 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fe1f9-9f5e-49b2-b806-73700f01cdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:42.025976 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fe1f9-9f5e-49b2-b806-73700f01cdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:42.026263 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fe1f9-9f5e-49b2-b806-73700f01cdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:42.026540 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fe1f9-9f5e-49b2-b806-73700f01cdc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:42.027185 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fe1f9-9f5e-49b2-b806-73700f01cdc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:42.028841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fe1f9-9f5e-49b2-b806-73700f01cdc1 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:42.042955 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1474/2910] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:18:42.047434 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c2f40-81b2-485c-9020-846479e6b4b7 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:42.062433 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c2f40-81b2-485c-9020-846479e6b4b7 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:42.067093 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5b0f6-6ee1-47f0-9cee-e230d8fa6025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:42.067752 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5b0f6-6ee1-47f0-9cee-e230d8fa6025 admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:42.068072 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5b0f6-6ee1-47f0-9cee-e230d8fa6025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:42.068354 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5b0f6-6ee1-47f0-9cee-e230d8fa6025 admin admin] PATH_INFO: `/v3/projects/340b03b6ce3c45fba26631a472f125d1/users/75112f5cbd8742ddb9e88c3ce011c890/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:42.083189 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5b0f6-6ee1-47f0-9cee-e230d8fa6025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340b03b6ce3c45fba26631a472f125d1, user_id=75112f5cbd8742ddb9e88c3ce011c890, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:42.086097 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5b0f6-6ee1-47f0-9cee-e230d8fa6025 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:42.169491 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1437/2911] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:18:42 2022] PUT /identity/v3/projects/340b03b6ce3c45fba26631a472f125d1/users/75112f5cbd8742ddb9e88c3ce011c890/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:18:42.180301 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2090-28db-484c-8b6d-e6051426cbfc None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:42.180594 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2090-28db-484c-8b6d-e6051426cbfc None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:42.180879 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca2090-28db-484c-8b6d-e6051426cbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:42.209580 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-17ca2090-28db-484c-8b6d-e6051426cbfc None None] MFA Rules not processed for user `75112f5cbd8742ddb9e88c3ce011c890`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:18:42.211332 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-17ca2090-28db-484c-8b6d-e6051426cbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:42.275233 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1475/2912] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:18:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:18:42.286604 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5b0f6-6ee1-47f0-9cee-e230d8fa6025 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:18:42.288838 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-a9d5b0f6-6ee1-47f0-9cee-e230d8fa6025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:18:42.366760 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5b0f6-6ee1-47f0-9cee-e230d8fa6025 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:18:42.371363 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1a78-617d-4764-8283-044311cf0a0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f750815038d404d9d39a68bf62db8c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:18:42.371363 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1a78-617d-4764-8283-044311cf0a0c service glance] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:18:42.371634 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1a78-617d-4764-8283-044311cf0a0c service glance] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:18:42.371735 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1a78-617d-4764-8283-044311cf0a0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:18:42.380269 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b1a78-617d-4764-8283-044311cf0a0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:18:42.381743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b1a78-617d-4764-8283-044311cf0a0c service glance] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:18:42.390880 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1438/2913] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:18:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:18:52.271678 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=57,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:52.386663 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:19:12.223340 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca2090-28db-484c-8b6d-e6051426cbfc None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:12.284897 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca2090-28db-484c-8b6d-e6051426cbfc None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:12.289377 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e4d7d-9e63-4c2d-893f-3f0f6de46094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:12.290008 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e4d7d-9e63-4c2d-893f-3f0f6de46094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:12.290289 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e4d7d-9e63-4c2d-893f-3f0f6de46094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:12.290567 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e4d7d-9e63-4c2d-893f-3f0f6de46094 admin admin] PATH_INFO: `/v3/users/75112f5cbd8742ddb9e88c3ce011c890` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:12.291674 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e4d7d-9e63-4c2d-893f-3f0f6de46094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75112f5cbd8742ddb9e88c3ce011c890)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:12.294163 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e4d7d-9e63-4c2d-893f-3f0f6de46094 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:12.474816 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3e7e4d7d-9e63-4c2d-893f-3f0f6de46094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75112f5cbd8742ddb9e88c3ce011c890'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:19:12.488207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3e7e4d7d-9e63-4c2d-893f-3f0f6de46094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75112f5cbd8742ddb9e88c3ce011c890'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:19:12.561688 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3e7e4d7d-9e63-4c2d-893f-3f0f6de46094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75112f5cbd8742ddb9e88c3ce011c890'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:19:12.569998 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3e7e4d7d-9e63-4c2d-893f-3f0f6de46094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75112f5cbd8742ddb9e88c3ce011c890'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:19:12.577367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-3e7e4d7d-9e63-4c2d-893f-3f0f6de46094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75112f5cbd8742ddb9e88c3ce011c890'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:19:12.577367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1476/2914] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:19:12 2022] DELETE /identity/v3/users/75112f5cbd8742ddb9e88c3ce011c890 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:19:12.581316 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab54ea9-fe25-4ace-98a7-f8803044f786 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:12.581788 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab54ea9-fe25-4ace-98a7-f8803044f786 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:12.581898 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab54ea9-fe25-4ace-98a7-f8803044f786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:12.602046 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-eab54ea9-fe25-4ace-98a7-f8803044f786 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:19:12.603256 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-eab54ea9-fe25-4ace-98a7-f8803044f786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:12.661999 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1439/2915] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:19:12.671796 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e4d7d-9e63-4c2d-893f-3f0f6de46094 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:12.673208 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3e7e4d7d-9e63-4c2d-893f-3f0f6de46094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:12.731088 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e4d7d-9e63-4c2d-893f-3f0f6de46094 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:12.734629 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68ea4d-e25b-4e12-8ff3-2a5affbf94ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:12.735230 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68ea4d-e25b-4e12-8ff3-2a5affbf94ab service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:12.735513 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68ea4d-e25b-4e12-8ff3-2a5affbf94ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:12.735786 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68ea4d-e25b-4e12-8ff3-2a5affbf94ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:12.744587 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68ea4d-e25b-4e12-8ff3-2a5affbf94ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:12.746034 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68ea4d-e25b-4e12-8ff3-2a5affbf94ab service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:12.755971 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1477/2916] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:19:13.186425 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab54ea9-fe25-4ace-98a7-f8803044f786 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:13.193379 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-eab54ea9-fe25-4ace-98a7-f8803044f786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:13.200463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab54ea9-fe25-4ace-98a7-f8803044f786 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:13.205506 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484da097-50dd-4ea3-b42f-2e5ba416b0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:13.206140 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484da097-50dd-4ea3-b42f-2e5ba416b0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:13.206421 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484da097-50dd-4ea3-b42f-2e5ba416b0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:13.206694 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484da097-50dd-4ea3-b42f-2e5ba416b0de admin admin] PATH_INFO: `/v3/projects/340b03b6ce3c45fba26631a472f125d1` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:13.207815 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484da097-50dd-4ea3-b42f-2e5ba416b0de admin admin] RBAC: Authorizing `identity:delete_project(project_id=340b03b6ce3c45fba26631a472f125d1)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:13.209789 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484da097-50dd-4ea3-b42f-2e5ba416b0de admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:13.312671 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-484da097-50dd-4ea3-b42f-2e5ba416b0de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '340b03b6ce3c45fba26631a472f125d1', 'request_id': 'req-484da097-50dd-4ea3-b42f-2e5ba416b0de'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:19:13.318717 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-484da097-50dd-4ea3-b42f-2e5ba416b0de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '340b03b6ce3c45fba26631a472f125d1', 'request_id': 'req-484da097-50dd-4ea3-b42f-2e5ba416b0de'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:19:13.407158 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-484da097-50dd-4ea3-b42f-2e5ba416b0de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '340b03b6ce3c45fba26631a472f125d1', 'request_id': 'req-484da097-50dd-4ea3-b42f-2e5ba416b0de'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:19:13.418783 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-484da097-50dd-4ea3-b42f-2e5ba416b0de admin admin] The token cache is being invalidate because project 340b03b6ce3c45fba26631a472f125d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:19:13.419517 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-484da097-50dd-4ea3-b42f-2e5ba416b0de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:19:13.419695 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-484da097-50dd-4ea3-b42f-2e5ba416b0de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:19:13.421210 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1440/2917] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:19:13 2022] DELETE /identity/v3/projects/340b03b6ce3c45fba26631a472f125d1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:19:13.426183 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedf3ad-07b1-48bd-b395-b81d609d982c None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:13.426663 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedf3ad-07b1-48bd-b395-b81d609d982c None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:13.426772 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedf3ad-07b1-48bd-b395-b81d609d982c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:13.445998 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-4aedf3ad-07b1-48bd-b395-b81d609d982c None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:19:13.447201 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-4aedf3ad-07b1-48bd-b395-b81d609d982c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:13.465005 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:19:13.507726 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1478/2918] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:19:13.515886 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb8e6d-65f2-4abf-972e-54ec1da7f0b1 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:13.516186 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb8e6d-65f2-4abf-972e-54ec1da7f0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:13.516486 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb8e6d-65f2-4abf-972e-54ec1da7f0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:13.536784 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-cbbb8e6d-65f2-4abf-972e-54ec1da7f0b1 None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:19:13.538206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-cbbb8e6d-65f2-4abf-972e-54ec1da7f0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:13.545970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1441/2919] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:19:13.550986 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedf3ad-07b1-48bd-b395-b81d609d982c None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:13.560675 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedf3ad-07b1-48bd-b395-b81d609d982c None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:13.566251 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e5d29-f1e7-4c97-9761-e085b995d468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:13.567319 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e5d29-f1e7-4c97-9761-e085b995d468 admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:13.567598 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e5d29-f1e7-4c97-9761-e085b995d468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:13.567890 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e5d29-f1e7-4c97-9761-e085b995d468 admin admin] PATH_INFO: `/v3/domains` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:13.568554 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e5d29-f1e7-4c97-9761-e085b995d468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81700) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 14:19:13.568859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e5d29-f1e7-4c97-9761-e085b995d468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:13.570446 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e5d29-f1e7-4c97-9761-e085b995d468 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:13.582050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1479/2920] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Sep 1 14:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 14:19:13.587238 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb8e6d-65f2-4abf-972e-54ec1da7f0b1 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:13.596417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb8e6d-65f2-4abf-972e-54ec1da7f0b1 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:13.601070 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45f5f0-8bec-4c58-be55-a4de6a532592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:13.601665 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45f5f0-8bec-4c58-be55-a4de6a532592 admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:13.601945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45f5f0-8bec-4c58-be55-a4de6a532592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:13.602217 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45f5f0-8bec-4c58-be55-a4de6a532592 admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:13.602851 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45f5f0-8bec-4c58-be55-a4de6a532592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:13.604785 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a45f5f0-8bec-4c58-be55-a4de6a532592 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:13.739812 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1442/2921] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:19:13 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:19:13.743985 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e5d29-f1e7-4c97-9761-e085b995d468 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:13.754127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e5d29-f1e7-4c97-9761-e085b995d468 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:13.812853 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5cb48-43cc-4018-82b4-b69f81e368c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:13.813465 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5cb48-43cc-4018-82b4-b69f81e368c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:13.813749 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5cb48-43cc-4018-82b4-b69f81e368c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:13.814023 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5cb48-43cc-4018-82b4-b69f81e368c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:13.814647 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5cb48-43cc-4018-82b4-b69f81e368c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:13.816667 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5cb48-43cc-4018-82b4-b69f81e368c4 admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:13.933194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1480/2922] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:19:13 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:19:13.937271 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45f5f0-8bec-4c58-be55-a4de6a532592 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:13.948296 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45f5f0-8bec-4c58-be55-a4de6a532592 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:13.954276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c034ff-6e77-4ca7-8b9f-fe9f4e022460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:13.954276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c034ff-6e77-4ca7-8b9f-fe9f4e022460 admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:13.954276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c034ff-6e77-4ca7-8b9f-fe9f4e022460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:13.954276 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c034ff-6e77-4ca7-8b9f-fe9f4e022460 admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:13.954884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c034ff-6e77-4ca7-8b9f-fe9f4e022460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:13.956495 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c034ff-6e77-4ca7-8b9f-fe9f4e022460 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:13.966349 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1443/2923] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:19:13.970244 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5cb48-43cc-4018-82b4-b69f81e368c4 admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:13.980203 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5cb48-43cc-4018-82b4-b69f81e368c4 admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:13.984848 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4693776-49ae-4196-a073-72daaba06a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:13.985428 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4693776-49ae-4196-a073-72daaba06a5f admin admin] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:13.985714 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4693776-49ae-4196-a073-72daaba06a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:13.985990 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4693776-49ae-4196-a073-72daaba06a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:13.986625 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4693776-49ae-4196-a073-72daaba06a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:13.988253 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4693776-49ae-4196-a073-72daaba06a5f admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:13.999259 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1481/2924] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:19:14.003251 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c034ff-6e77-4ca7-8b9f-fe9f4e022460 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:14.013655 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c034ff-6e77-4ca7-8b9f-fe9f4e022460 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:14.018147 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c0095-b818-48c6-af59-7800f1c7650a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:14.018787 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c0095-b818-48c6-af59-7800f1c7650a admin admin] REQUEST_METHOD: `PUT` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:14.019063 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c0095-b818-48c6-af59-7800f1c7650a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:14.019333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c0095-b818-48c6-af59-7800f1c7650a admin admin] PATH_INFO: `/v3/projects/167c2cffc27e4359bb01f828c8c895ad/users/77b0f195970a460887b449922c219991/roles/d949d82256654aa9b25ca259d33df4c3` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:14.033417 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c0095-b818-48c6-af59-7800f1c7650a admin admin] RBAC: Authorizing `identity:create_grant(project_id=167c2cffc27e4359bb01f828c8c895ad, user_id=77b0f195970a460887b449922c219991, role_id=d949d82256654aa9b25ca259d33df4c3)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:14.036066 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c0095-b818-48c6-af59-7800f1c7650a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:14.132952 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1444/2925] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:19:14 2022] PUT /identity/v3/projects/167c2cffc27e4359bb01f828c8c895ad/users/77b0f195970a460887b449922c219991/roles/d949d82256654aa9b25ca259d33df4c3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:19:14.137913 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fff6d-81d6-47f7-9ac7-319b90d07b7e None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:14.138207 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fff6d-81d6-47f7-9ac7-319b90d07b7e None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:14.138598 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fff6d-81d6-47f7-9ac7-319b90d07b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:14.158461 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-2a3fff6d-81d6-47f7-9ac7-319b90d07b7e None None] MFA Rules not processed for user `ff4c484fb0f14c218e0baa6d6c4c76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:19:14.159682 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2a3fff6d-81d6-47f7-9ac7-319b90d07b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:14.219285 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1482/2926] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:19:14.229371 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c0095-b818-48c6-af59-7800f1c7650a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:14.231055 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-823c0095-b818-48c6-af59-7800f1c7650a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:14.252529 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:19:14.287741 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c0095-b818-48c6-af59-7800f1c7650a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:14.291622 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe41d8-f54a-4b48-8f77-2844e1c0f8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:14.292430 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe41d8-f54a-4b48-8f77-2844e1c0f8dd service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:14.292922 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe41d8-f54a-4b48-8f77-2844e1c0f8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:14.293375 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe41d8-f54a-4b48-8f77-2844e1c0f8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:14.303493 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe41d8-f54a-4b48-8f77-2844e1c0f8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:14.304970 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe41d8-f54a-4b48-8f77-2844e1c0f8dd service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:14.314366 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1445/2927] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:19:20.001480 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d82f4-eb39-4a82-96cf-a9645cd6ea59 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:20.002022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d82f4-eb39-4a82-96cf-a9645cd6ea59 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:20.002022 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d82f4-eb39-4a82-96cf-a9645cd6ea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:20.033410 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-595d82f4-eb39-4a82-96cf-a9645cd6ea59 None None] MFA Rules not processed for user `77b0f195970a460887b449922c219991`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:19:20.034735 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-595d82f4-eb39-4a82-96cf-a9645cd6ea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:20.053041 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:19:20.103656 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1483/2928] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:19:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:19:20.108195 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe41d8-f54a-4b48-8f77-2844e1c0f8dd service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:20.118650 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe41d8-f54a-4b48-8f77-2844e1c0f8dd service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:20.123467 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76068a-bbc5-4880-a3b3-0740552144bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:20.124179 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76068a-bbc5-4880-a3b3-0740552144bc admin admin] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:20.124463 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76068a-bbc5-4880-a3b3-0740552144bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:20.124734 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76068a-bbc5-4880-a3b3-0740552144bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:20.125404 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76068a-bbc5-4880-a3b3-0740552144bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:20.127332 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76068a-bbc5-4880-a3b3-0740552144bc admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:20.300464 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1446/2929] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Sep 1 14:19:20 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:19:20.305159 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d82f4-eb39-4a82-96cf-a9645cd6ea59 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:20.316115 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d82f4-eb39-4a82-96cf-a9645cd6ea59 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:20.372608 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b4fdd-c835-4b0e-aa5e-deba9610d68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:20.373218 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b4fdd-c835-4b0e-aa5e-deba9610d68a admin admin] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:20.373496 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b4fdd-c835-4b0e-aa5e-deba9610d68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:20.373769 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b4fdd-c835-4b0e-aa5e-deba9610d68a admin admin] PATH_INFO: `/v3/users` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:20.374392 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b4fdd-c835-4b0e-aa5e-deba9610d68a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:20.376360 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b4fdd-c835-4b0e-aa5e-deba9610d68a admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:20.474854 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1484/2930] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Sep 1 14:19:20 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 14:19:20.478858 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76068a-bbc5-4880-a3b3-0740552144bc admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:20.489203 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76068a-bbc5-4880-a3b3-0740552144bc admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:20.494084 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cef89-e6b6-4c10-a978-50d1d648d90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:20.494684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cef89-e6b6-4c10-a978-50d1d648d90a admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:20.494980 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cef89-e6b6-4c10-a978-50d1d648d90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:20.495248 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cef89-e6b6-4c10-a978-50d1d648d90a admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:20.495907 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cef89-e6b6-4c10-a978-50d1d648d90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:20.500367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cef89-e6b6-4c10-a978-50d1d648d90a admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:20.508698 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1447/2931] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 14:19:20.513229 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b4fdd-c835-4b0e-aa5e-deba9610d68a admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:20.523995 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b4fdd-c835-4b0e-aa5e-deba9610d68a admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:20.528568 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53ae2-a487-4337-b9ae-d0caffbac8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:20.529212 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53ae2-a487-4337-b9ae-d0caffbac8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:20.529495 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53ae2-a487-4337-b9ae-d0caffbac8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:20.529770 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53ae2-a487-4337-b9ae-d0caffbac8ce admin admin] PATH_INFO: `/v3/projects/dc88698c989446bd8694a75439794e04/users/682ff43a62eb4523998f6f7e08134957/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:20.544778 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa53ae2-a487-4337-b9ae-d0caffbac8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc88698c989446bd8694a75439794e04, user_id=682ff43a62eb4523998f6f7e08134957, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:20.547374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa53ae2-a487-4337-b9ae-d0caffbac8ce admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:20.675281 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1485/2932] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:19:20 2022] PUT /identity/v3/projects/dc88698c989446bd8694a75439794e04/users/682ff43a62eb4523998f6f7e08134957/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:19:20.679534 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cef89-e6b6-4c10-a978-50d1d648d90a admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:20.689917 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cef89-e6b6-4c10-a978-50d1d648d90a admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:20.748497 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c43b3b-1be6-45db-8689-f204b42843cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:20.749114 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c43b3b-1be6-45db-8689-f204b42843cf admin admin] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:20.749392 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c43b3b-1be6-45db-8689-f204b42843cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:20.749664 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c43b3b-1be6-45db-8689-f204b42843cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:20.750303 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c43b3b-1be6-45db-8689-f204b42843cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:20.751947 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c43b3b-1be6-45db-8689-f204b42843cf admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:20.761963 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1448/2933] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Sep 1 14:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 14:19:20.766489 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53ae2-a487-4337-b9ae-d0caffbac8ce admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:20.777751 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53ae2-a487-4337-b9ae-d0caffbac8ce admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:20.782459 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61498c-1e54-4f77-83df-9d1a435ebf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:20.783135 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61498c-1e54-4f77-83df-9d1a435ebf5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:20.783416 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61498c-1e54-4f77-83df-9d1a435ebf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:20.783691 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61498c-1e54-4f77-83df-9d1a435ebf5c admin admin] PATH_INFO: `/v3/projects/dc88698c989446bd8694a75439794e04/users/682ff43a62eb4523998f6f7e08134957/roles/d1bd8a5b71324c839e80289ee9e4d600` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:20.786245 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61498c-1e54-4f77-83df-9d1a435ebf5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc88698c989446bd8694a75439794e04, user_id=682ff43a62eb4523998f6f7e08134957, role_id=d1bd8a5b71324c839e80289ee9e4d600)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:20.788945 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61498c-1e54-4f77-83df-9d1a435ebf5c admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:20.799920 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1486/2934] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Sep 1 14:19:20 2022] PUT /identity/v3/projects/dc88698c989446bd8694a75439794e04/users/682ff43a62eb4523998f6f7e08134957/roles/d1bd8a5b71324c839e80289ee9e4d600 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 14:19:26.504439 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367f4e4-c811-42ef-9391-bc33bd8d91b1 None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:26.504975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367f4e4-c811-42ef-9391-bc33bd8d91b1 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:26.505100 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367f4e4-c811-42ef-9391-bc33bd8d91b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:26.537684 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-c367f4e4-c811-42ef-9391-bc33bd8d91b1 None None] MFA Rules not processed for user `682ff43a62eb4523998f6f7e08134957`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:19:26.539092 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-c367f4e4-c811-42ef-9391-bc33bd8d91b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:26.617541 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1449/2935] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:19:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 14:19:26.638833 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61498c-1e54-4f77-83df-9d1a435ebf5c admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:26.640759 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-4c61498c-1e54-4f77-83df-9d1a435ebf5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:26.725241 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61498c-1e54-4f77-83df-9d1a435ebf5c admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:26.731511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e043af-c709-40d8-ac12-df3debbd9b27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:26.732181 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e043af-c709-40d8-ac12-df3debbd9b27 service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:26.732447 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e043af-c709-40d8-ac12-df3debbd9b27 service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:26.732722 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e043af-c709-40d8-ac12-df3debbd9b27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:26.738259 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:19:26.794374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e043af-c709-40d8-ac12-df3debbd9b27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:26.794374 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e043af-c709-40d8-ac12-df3debbd9b27 service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:26.804732 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1487/2936] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:19:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:19:29.900977 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e20d0-f940-4153-a206-e61a6f4b007b None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:29.901556 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e20d0-f940-4153-a206-e61a6f4b007b None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:29.901670 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e20d0-f940-4153-a206-e61a6f4b007b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:29.921795 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-fd3e20d0-f940-4153-a206-e61a6f4b007b None None] MFA Rules not processed for user `77b0f195970a460887b449922c219991`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:19:29.923019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-fd3e20d0-f940-4153-a206-e61a6f4b007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:29.930564 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1450/2937] 10.222.0.64 () {58 vars in 958 bytes} [Thu Sep 1 14:19:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:19:33.575880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e043af-c709-40d8-ac12-df3debbd9b27 service nova] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:33.577286 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-d4e043af-c709-40d8-ac12-df3debbd9b27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:33.647900 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e043af-c709-40d8-ac12-df3debbd9b27 service nova] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:33.654929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2b609-f24a-44b0-90e8-66aca2c79c28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec4f437077c41039cae3d505b43b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:33.654929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2b609-f24a-44b0-90e8-66aca2c79c28 service placement] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:33.654929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2b609-f24a-44b0-90e8-66aca2c79c28 service placement] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:33.654929 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2b609-f24a-44b0-90e8-66aca2c79c28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:33.656619 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0dc2b609-f24a-44b0-90e8-66aca2c79c28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:33.669602 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2b609-f24a-44b0-90e8-66aca2c79c28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:33.671297 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2b609-f24a-44b0-90e8-66aca2c79c28 service placement] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:33.698190 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1488/2938] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:19:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:19:39.915991 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:19:43.694214 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=56 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:19:48.107293 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e20d0-f940-4153-a206-e61a6f4b007b None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:48.108744 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-fd3e20d0-f940-4153-a206-e61a6f4b007b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:48.166333 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e20d0-f940-4153-a206-e61a6f4b007b None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:48.169964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a43b5-bc20-4f7c-9e94-2554eb1e5d82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:48.170573 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a43b5-bc20-4f7c-9e94-2554eb1e5d82 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:48.171356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a43b5-bc20-4f7c-9e94-2554eb1e5d82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:48.171356 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a43b5-bc20-4f7c-9e94-2554eb1e5d82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:48.172854 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-3e9a43b5-bc20-4f7c-9e94-2554eb1e5d82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:48.189419 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a43b5-bc20-4f7c-9e94-2554eb1e5d82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:48.191843 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a43b5-bc20-4f7c-9e94-2554eb1e5d82 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:48.200340 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1451/2939] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:19:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:19:49.044413 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2b609-f24a-44b0-90e8-66aca2c79c28 service placement] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:19:49.055595 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2b609-f24a-44b0-90e8-66aca2c79c28 service placement] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:19:49.061046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c28b8-7d05-4756-a05c-9be81ae8c8d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec4f437077c41039cae3d505b43b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:19:49.064755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c28b8-7d05-4756-a05c-9be81ae8c8d4 service placement] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:19:49.064755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c28b8-7d05-4756-a05c-9be81ae8c8d4 service placement] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:19:49.064755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c28b8-7d05-4756-a05c-9be81ae8c8d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:19:49.064755 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-3f6c28b8-7d05-4756-a05c-9be81ae8c8d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:19:49.077057 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c28b8-7d05-4756-a05c-9be81ae8c8d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:19:49.079085 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c28b8-7d05-4756-a05c-9be81ae8c8d4 service placement] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:19:49.090606 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1489/2940] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:19:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:19:58.196494 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=26 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:19:59.085655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=6 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:20:01.246224 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a43b5-bc20-4f7c-9e94-2554eb1e5d82 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:20:01.259571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a43b5-bc20-4f7c-9e94-2554eb1e5d82 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:20:01.265019 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cbc98-b55d-4207-b018-552dceed0f54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:20:01.265635 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cbc98-b55d-4207-b018-552dceed0f54 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:20:01.265968 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cbc98-b55d-4207-b018-552dceed0f54 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:20:01.266259 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cbc98-b55d-4207-b018-552dceed0f54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:20:01.268508 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1a9cbc98-b55d-4207-b018-552dceed0f54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:20:01.280372 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cbc98-b55d-4207-b018-552dceed0f54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:20:01.281931 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cbc98-b55d-4207-b018-552dceed0f54 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:20:01.293167 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1452/2941] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:20:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 14:20:04.643641 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c28b8-7d05-4756-a05c-9be81ae8c8d4 service placement] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:20:04.656844 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c28b8-7d05-4756-a05c-9be81ae8c8d4 service placement] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:20:04.662672 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e95fe1-47b1-4d05-a223-35808f1de9f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:20:04.663316 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e95fe1-47b1-4d05-a223-35808f1de9f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:20:04.663601 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e95fe1-47b1-4d05-a223-35808f1de9f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:20:04.663901 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e95fe1-47b1-4d05-a223-35808f1de9f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:20:04.676851 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e95fe1-47b1-4d05-a223-35808f1de9f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:20:04.678296 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e95fe1-47b1-4d05-a223-35808f1de9f6 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:20:04.688219 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1490/2942] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:20:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:20:06.902626 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cbc98-b55d-4207-b018-552dceed0f54 service nova] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:20:06.904206 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-1a9cbc98-b55d-4207-b018-552dceed0f54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:20:06.919627 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cbc98-b55d-4207-b018-552dceed0f54 service nova] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:20:06.926032 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb54ef7-916d-4b93-ab12-8ba0a01ef416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:20:06.926672 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb54ef7-916d-4b93-ab12-8ba0a01ef416 service nova] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:20:06.926953 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb54ef7-916d-4b93-ab12-8ba0a01ef416 service nova] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:20:06.927235 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb54ef7-916d-4b93-ab12-8ba0a01ef416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:20:06.929052 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-ffb54ef7-916d-4b93-ab12-8ba0a01ef416 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:20:06.941545 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb54ef7-916d-4b93-ab12-8ba0a01ef416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:20:06.943108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb54ef7-916d-4b93-ab12-8ba0a01ef416 service nova] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:20:06.954074 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1453/2943] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:20:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:20:14.683687 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=6 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:20:16.949889 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=12 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:22:31.101458 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e95fe1-47b1-4d05-a223-35808f1de9f6 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:22:31.110162 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e95fe1-47b1-4d05-a223-35808f1de9f6 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:22:31.113795 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cabfb-a994-48b9-909b-f7d8f1f990bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:22:31.114373 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cabfb-a994-48b9-909b-f7d8f1f990bf service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:22:31.114655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cabfb-a994-48b9-909b-f7d8f1f990bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:22:31.114926 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cabfb-a994-48b9-909b-f7d8f1f990bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:22:31.116845 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-cd7cabfb-a994-48b9-909b-f7d8f1f990bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:22:31.132127 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7cabfb-a994-48b9-909b-f7d8f1f990bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:22:31.133511 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7cabfb-a994-48b9-909b-f7d8f1f990bf service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:22:31.146765 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1491/2944] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:22:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:22:32.329390 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb54ef7-916d-4b93-ab12-8ba0a01ef416 service nova] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:22:32.338639 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb54ef7-916d-4b93-ab12-8ba0a01ef416 service nova] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:22:32.342215 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ea416-662a-4cb8-831e-b037834b8975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:22:32.342800 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ea416-662a-4cb8-831e-b037834b8975 service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:22:32.343079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ea416-662a-4cb8-831e-b037834b8975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:22:32.343351 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ea416-662a-4cb8-831e-b037834b8975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:22:32.345207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-8e0ea416-662a-4cb8-831e-b037834b8975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:22:32.358702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ea416-662a-4cb8-831e-b037834b8975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:22:32.360164 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ea416-662a-4cb8-831e-b037834b8975 service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:22:32.371494 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1454/2945] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:22:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:22:41.140849 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=6 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:22:41.416872 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cabfb-a994-48b9-909b-f7d8f1f990bf service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:22:41.426324 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cabfb-a994-48b9-909b-f7d8f1f990bf service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:22:41.429960 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11dfcc3-f2aa-44e0-a650-9531c2613083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:22:41.430557 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dfcc3-f2aa-44e0-a650-9531c2613083 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:22:41.430841 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dfcc3-f2aa-44e0-a650-9531c2613083 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:22:41.431113 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dfcc3-f2aa-44e0-a650-9531c2613083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:22:41.432980 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-a11dfcc3-f2aa-44e0-a650-9531c2613083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:22:41.442668 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11dfcc3-f2aa-44e0-a650-9531c2613083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:22:41.444124 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11dfcc3-f2aa-44e0-a650-9531c2613083 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:22:41.452404 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1492/2946] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:22:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:22:42.366177 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=6 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:22:45.508234 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ea416-662a-4cb8-831e-b037834b8975 service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:22:45.517585 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ea416-662a-4cb8-831e-b037834b8975 service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:22:45.521197 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead860b-4f7c-49d3-9f74-4248e8144bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:22:45.521787 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead860b-4f7c-49d3-9f74-4248e8144bec service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:22:45.522065 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead860b-4f7c-49d3-9f74-4248e8144bec service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:22:45.522335 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead860b-4f7c-49d3-9f74-4248e8144bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:22:45.524036 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-0ead860b-4f7c-49d3-9f74-4248e8144bec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:22:45.534123 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead860b-4f7c-49d3-9f74-4248e8144bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:22:45.535552 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead860b-4f7c-49d3-9f74-4248e8144bec service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:22:45.543498 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1455/2947] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:22:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:22:46.010314 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdea1a5-6b0e-4cdc-83ef-36fb75d74e48 None None] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:22:46.011046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdea1a5-6b0e-4cdc-83ef-36fb75d74e48 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:22:46.011046 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdea1a5-6b0e-4cdc-83ef-36fb75d74e48 None None] PATH_INFO: `/` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:22:46.012965 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1493/2948] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 14:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:22:46.018839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8ff0e-89b2-44c3-8083-8f10f608623f None None] REQUEST_METHOD: `POST` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:22:46.019207 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8ff0e-89b2-44c3-8083-8f10f608623f None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:22:46.019489 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8ff0e-89b2-44c3-8083-8f10f608623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:22:46.060352 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.auth.core [None req-05f8ff0e-89b2-44c3-8083-8f10f608623f None None] MFA Rules not processed for user `4a9703db64624bbeb392d693ca60c6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81699) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:22:46.061570 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-05f8ff0e-89b2-44c3-8083-8f10f608623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:22:46.068321 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1456/2949] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 14:22:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:22:46.082486 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdea1a5-6b0e-4cdc-83ef-36fb75d74e48 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:22:46.093815 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdea1a5-6b0e-4cdc-83ef-36fb75d74e48 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:22:46.097451 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153914e6-50a4-4c54-858f-ad74bd254c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:22:46.098050 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153914e6-50a4-4c54-858f-ad74bd254c27 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:22:46.098329 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153914e6-50a4-4c54-858f-ad74bd254c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:22:46.098597 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153914e6-50a4-4c54-858f-ad74bd254c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:22:46.105753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153914e6-50a4-4c54-858f-ad74bd254c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:22:46.107238 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153914e6-50a4-4c54-858f-ad74bd254c27 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:22:46.114892 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1494/2950] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:22:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:22:46.204536 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0b381-6eb7-411a-8046-861f2ca2cc36 None None] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:22:46.204830 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0b381-6eb7-411a-8046-861f2ca2cc36 None None] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:22:46.205108 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0b381-6eb7-411a-8046-861f2ca2cc36 None None] PATH_INFO: `/` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:22:46.206496 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1457/2951] 10.222.0.64 () {54 vars in 921 bytes} [Thu Sep 1 14:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 14:22:46.212619 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21358ade-d785-420e-9fe5-fcd6b0030c50 None None] REQUEST_METHOD: `POST` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:22:46.212922 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21358ade-d785-420e-9fe5-fcd6b0030c50 None None] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:22:46.213198 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21358ade-d785-420e-9fe5-fcd6b0030c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:22:46.253392 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.auth.core [None req-21358ade-d785-420e-9fe5-fcd6b0030c50 None None] MFA Rules not processed for user `4b3c8a90b97246a98612b627b5f8da80`. Rule list: `[]` (Enabled: `True`). {{(pid=81700) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 14:22:46.254599 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-21358ade-d785-420e-9fe5-fcd6b0030c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:22:46.263842 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1495/2952] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Sep 1 14:22:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 14:22:46.274473 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0b381-6eb7-411a-8046-861f2ca2cc36 None None] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:22:46.285710 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0b381-6eb7-411a-8046-861f2ca2cc36 None None] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:22:46.289264 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5753f59-a479-40c7-b538-29316192d43a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:22:46.289857 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753f59-a479-40c7-b538-29316192d43a service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:22:46.290139 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753f59-a479-40c7-b538-29316192d43a service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:22:46.290416 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5753f59-a479-40c7-b538-29316192d43a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:22:46.301037 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5753f59-a479-40c7-b538-29316192d43a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:22:46.302452 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5753f59-a479-40c7-b538-29316192d43a service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:22:46.321080 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1458/2953] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:22:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:22:56.251011 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=21 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:22:56.308483 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=21 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:24:33.857609 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21358ade-d785-420e-9fe5-fcd6b0030c50 None None] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:24:33.873859 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21358ade-d785-420e-9fe5-fcd6b0030c50 None None] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:24:33.877622 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e1037-4048-4f60-9aba-214297e6cb83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:24:33.878227 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e1037-4048-4f60-9aba-214297e6cb83 service neutron] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:24:33.878509 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e1037-4048-4f60-9aba-214297e6cb83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:24:33.878780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e1037-4048-4f60-9aba-214297e6cb83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:24:33.901192 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e1037-4048-4f60-9aba-214297e6cb83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:24:33.902608 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e1037-4048-4f60-9aba-214297e6cb83 service neutron] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:24:33.911367 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1496/2954] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:24:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:24:36.994434 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5753f59-a479-40c7-b538-29316192d43a service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:24:37.050460 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5753f59-a479-40c7-b538-29316192d43a service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:24:37.056079 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c02519-c086-438d-adbc-92fcc075c134 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec4f437077c41039cae3d505b43b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:24:37.056676 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c02519-c086-438d-adbc-92fcc075c134 service placement] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:24:37.056956 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c02519-c086-438d-adbc-92fcc075c134 service placement] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:24:37.057230 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c02519-c086-438d-adbc-92fcc075c134 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:24:37.065807 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c02519-c086-438d-adbc-92fcc075c134 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:24:37.067374 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c02519-c086-438d-adbc-92fcc075c134 service placement] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:24:37.077832 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1459/2955] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:24:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:24:37.658880 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e1037-4048-4f60-9aba-214297e6cb83 service neutron] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:24:37.672141 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e1037-4048-4f60-9aba-214297e6cb83 service neutron] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:24:37.679163 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b15f43-031d-4b2f-be66-c7896e73bf6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b3c8a90b97246a98612b627b5f8da80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:24:37.679780 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b15f43-031d-4b2f-be66-c7896e73bf6e service nova] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:24:37.680093 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b15f43-031d-4b2f-be66-c7896e73bf6e service nova] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:24:37.680370 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b15f43-031d-4b2f-be66-c7896e73bf6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:24:37.682076 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-f3b15f43-031d-4b2f-be66-c7896e73bf6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:24:37.705823 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b15f43-031d-4b2f-be66-c7896e73bf6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:24:37.707415 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b15f43-031d-4b2f-be66-c7896e73bf6e service nova] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:24:37.718433 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1497/2956] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:24:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:24:40.268119 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c02519-c086-438d-adbc-92fcc075c134 service placement] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:24:40.278242 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c02519-c086-438d-adbc-92fcc075c134 service placement] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:24:40.281820 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b24ce-9dcf-432c-be45-f6e7a5a50a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a9703db64624bbeb392d693ca60c6e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:24:40.282415 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b24ce-9dcf-432c-be45-f6e7a5a50a9c service neutron] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:24:40.282693 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b24ce-9dcf-432c-be45-f6e7a5a50a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:24:40.282964 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b24ce-9dcf-432c-be45-f6e7a5a50a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:24:40.343496 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b24ce-9dcf-432c-be45-f6e7a5a50a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:24:40.344969 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b24ce-9dcf-432c-be45-f6e7a5a50a9c service neutron] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:24:40.355042 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1460/2957] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:24:44.066829 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b15f43-031d-4b2f-be66-c7896e73bf6e service nova] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:24:44.080515 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b15f43-031d-4b2f-be66-c7896e73bf6e service nova] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:24:44.086164 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615b202-0a3a-4036-8e6f-9824d69a9fbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec4f437077c41039cae3d505b43b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:24:44.086774 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615b202-0a3a-4036-8e6f-9824d69a9fbe service placement] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:24:44.087059 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615b202-0a3a-4036-8e6f-9824d69a9fbe service placement] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:24:44.087337 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615b202-0a3a-4036-8e6f-9824d69a9fbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:24:44.089201 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-6615b202-0a3a-4036-8e6f-9824d69a9fbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:24:44.115529 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615b202-0a3a-4036-8e6f-9824d69a9fbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:24:44.117194 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615b202-0a3a-4036-8e6f-9824d69a9fbe service placement] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:24:44.127543 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1498/2958] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:24:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:24:47.878884 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b24ce-9dcf-432c-be45-f6e7a5a50a9c service neutron] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:24:47.890859 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b24ce-9dcf-432c-be45-f6e7a5a50a9c service neutron] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:24:47.896401 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339cc40-d9fa-45be-8a0d-bbbba4be69b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec4f437077c41039cae3d505b43b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:24:47.897012 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339cc40-d9fa-45be-8a0d-bbbba4be69b7 service placement] REQUEST_METHOD: `GET` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:24:47.897295 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339cc40-d9fa-45be-8a0d-bbbba4be69b7 service placement] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:24:47.897571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339cc40-d9fa-45be-8a0d-bbbba4be69b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:24:47.899430 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-3339cc40-d9fa-45be-8a0d-bbbba4be69b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:24:47.911458 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339cc40-d9fa-45be-8a0d-bbbba4be69b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:24:47.913582 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339cc40-d9fa-45be-8a0d-bbbba4be69b7 service placement] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:24:47.923945 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1461/2959] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:24:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:24:48.016694 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615b202-0a3a-4036-8e6f-9824d69a9fbe service placement] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:24:48.028111 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615b202-0a3a-4036-8e6f-9824d69a9fbe service placement] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:24:48.032684 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a006e41-f234-4e9b-a605-a2e828fa394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:24:48.033313 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a006e41-f234-4e9b-a605-a2e828fa394f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:24:48.033595 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a006e41-f234-4e9b-a605-a2e828fa394f admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:24:48.033871 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a006e41-f234-4e9b-a605-a2e828fa394f admin admin] PATH_INFO: `/v3/users/77b0f195970a460887b449922c219991` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:24:48.034983 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a006e41-f234-4e9b-a605-a2e828fa394f admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b0f195970a460887b449922c219991)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:24:48.036970 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a006e41-f234-4e9b-a605-a2e828fa394f admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:24:48.224883 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-0a006e41-f234-4e9b-a605-a2e828fa394f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b0f195970a460887b449922c219991'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:48.236949 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-0a006e41-f234-4e9b-a605-a2e828fa394f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b0f195970a460887b449922c219991'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:48.335921 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-0a006e41-f234-4e9b-a605-a2e828fa394f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b0f195970a460887b449922c219991'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:48.343508 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-0a006e41-f234-4e9b-a605-a2e828fa394f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b0f195970a460887b449922c219991'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:48.348469 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-0a006e41-f234-4e9b-a605-a2e828fa394f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b0f195970a460887b449922c219991'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:48.350840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1499/2960] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:24:48 2022] DELETE /identity/v3/users/77b0f195970a460887b449922c219991 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:24:48.617565 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339cc40-d9fa-45be-8a0d-bbbba4be69b7 service placement] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:24:48.629395 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339cc40-d9fa-45be-8a0d-bbbba4be69b7 service placement] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:24:48.689835 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:24:48.690465 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:24:48.690743 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:24:48.691011 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0 admin admin] PATH_INFO: `/v3/projects/167c2cffc27e4359bb01f828c8c895ad` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:24:48.692137 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=167c2cffc27e4359bb01f828c8c895ad)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:24:48.694872 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0 admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:24:48.800903 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:24:48.815975 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167c2cffc27e4359bb01f828c8c895ad', 'request_id': 'req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:48.839327 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167c2cffc27e4359bb01f828c8c895ad', 'request_id': 'req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:49.021208 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167c2cffc27e4359bb01f828c8c895ad', 'request_id': 'req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:49.033367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0 admin admin] The token cache is being invalidate because project 167c2cffc27e4359bb01f828c8c895ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:24:49.033659 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:49.034282 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:49.035906 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1462/2961] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:24:48 2022] DELETE /identity/v3/projects/167c2cffc27e4359bb01f828c8c895ad => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:24:49.040753 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a006e41-f234-4e9b-a605-a2e828fa394f admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:24:49.042151 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-0a006e41-f234-4e9b-a605-a2e828fa394f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:24:49.055259 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a006e41-f234-4e9b-a605-a2e828fa394f admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:24:49.103288 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:24:49.111652 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81d46c-a4b6-4d44-9580-ad6c4f31e8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:24:49.117655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81d46c-a4b6-4d44-9580-ad6c4f31e8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:24:49.117655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81d46c-a4b6-4d44-9580-ad6c4f31e8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:24:49.117655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81d46c-a4b6-4d44-9580-ad6c4f31e8de admin admin] PATH_INFO: `/v3/users/682ff43a62eb4523998f6f7e08134957` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:24:49.117655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81d46c-a4b6-4d44-9580-ad6c4f31e8de admin admin] RBAC: Authorizing `identity:delete_user(user_id=682ff43a62eb4523998f6f7e08134957)` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:24:49.117655 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e81d46c-a4b6-4d44-9580-ad6c4f31e8de admin admin] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:24:49.424470 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-2e81d46c-a4b6-4d44-9580-ad6c4f31e8de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682ff43a62eb4523998f6f7e08134957'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:49.436883 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-2e81d46c-a4b6-4d44-9580-ad6c4f31e8de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682ff43a62eb4523998f6f7e08134957'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:49.530171 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-2e81d46c-a4b6-4d44-9580-ad6c4f31e8de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682ff43a62eb4523998f6f7e08134957'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:49.538355 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-2e81d46c-a4b6-4d44-9580-ad6c4f31e8de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682ff43a62eb4523998f6f7e08134957'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:49.538991 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.notifications [None req-2e81d46c-a4b6-4d44-9580-ad6c4f31e8de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682ff43a62eb4523998f6f7e08134957'} {{(pid=81700) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:49.544988 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1500/2962] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Sep 1 14:24:49 2022] DELETE /identity/v3/users/682ff43a62eb4523998f6f7e08134957 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:24:49.805706 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0 admin admin] Authenticating user token {{(pid=81699) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:24:49.807191 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.fernet_utils [None req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81699) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:24:49.820994 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a943f50-64bb-4a74-a94c-4b9164a0f6a0 admin admin] Validating token access rules against request {{(pid=81699) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:24:49.890287 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2775d-e4c2-43d4-bc61-b9e6a1589bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4c484fb0f14c218e0baa6d6c4c76d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fc2f50aab224fc68a4db65bf6dd738c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81699) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:24:49.890940 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2775d-e4c2-43d4-bc61-b9e6a1589bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:24:49.891224 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2775d-e4c2-43d4-bc61-b9e6a1589bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:24:49.891528 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2775d-e4c2-43d4-bc61-b9e6a1589bec admin admin] PATH_INFO: `/v3/projects/dc88698c989446bd8694a75439794e04` {{(pid=81699) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:24:49.892702 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2775d-e4c2-43d4-bc61-b9e6a1589bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc88698c989446bd8694a75439794e04)` {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:24:49.894624 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2775d-e4c2-43d4-bc61-b9e6a1589bec admin admin] RBAC: Authorization granted {{(pid=81699) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:24:50.016113 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9fc2775d-e4c2-43d4-bc61-b9e6a1589bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc88698c989446bd8694a75439794e04', 'request_id': 'req-9fc2775d-e4c2-43d4-bc61-b9e6a1589bec'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:50.021571 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9fc2775d-e4c2-43d4-bc61-b9e6a1589bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc88698c989446bd8694a75439794e04', 'request_id': 'req-9fc2775d-e4c2-43d4-bc61-b9e6a1589bec'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:50.101367 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9fc2775d-e4c2-43d4-bc61-b9e6a1589bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc88698c989446bd8694a75439794e04', 'request_id': 'req-9fc2775d-e4c2-43d4-bc61-b9e6a1589bec'} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:50.112894 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9fc2775d-e4c2-43d4-bc61-b9e6a1589bec admin admin] The token cache is being invalidate because project dc88698c989446bd8694a75439794e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81699) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 14:24:50.113182 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9fc2775d-e4c2-43d4-bc61-b9e6a1589bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:50.120839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG keystone.notifications [None req-9fc2775d-e4c2-43d4-bc61-b9e6a1589bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81699) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 14:24:50.120839 dv-cinder-852211-7-smb devstack@keystone.service[81699]: [pid: 81699|app: 0|req: 1463/2963] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Sep 1 14:24:49 2022] DELETE /identity/v3/projects/dc88698c989446bd8694a75439794e04 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 14:24:59.541434 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:25:00.109912 dv-cinder-852211-7-smb devstack@keystone.service[81699]: DEBUG dbcounter [-] [81699] Writing DB stats keystone:SELECT=65,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:29:43.542884 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81d46c-a4b6-4d44-9580-ad6c4f31e8de admin admin] Authenticating user token {{(pid=81700) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 14:29:43.544331 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-2e81d46c-a4b6-4d44-9580-ad6c4f31e8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:29:43.617766 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81d46c-a4b6-4d44-9580-ad6c4f31e8de admin admin] Validating token access rules against request {{(pid=81700) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 14:29:43.676643 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af38c44-c584-48e4-94f5-8bb6005a99e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cec4f437077c41039cae3d505b43b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e7998cc03064a0bb9a9dc6a1475d73c', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81700) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 14:29:43.677249 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af38c44-c584-48e4-94f5-8bb6005a99e9 service placement] REQUEST_METHOD: `GET` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 14:29:43.677527 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af38c44-c584-48e4-94f5-8bb6005a99e9 service placement] SCRIPT_NAME: `/identity` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 14:29:43.677798 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af38c44-c584-48e4-94f5-8bb6005a99e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81700) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 14:29:43.679533 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.fernet_utils [None req-9af38c44-c584-48e4-94f5-8bb6005a99e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81700) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 14:29:43.691160 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af38c44-c584-48e4-94f5-8bb6005a99e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 14:29:43.692813 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af38c44-c584-48e4-94f5-8bb6005a99e9 service placement] RBAC: Authorization granted {{(pid=81700) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 14:29:43.702840 dv-cinder-852211-7-smb devstack@keystone.service[81700]: [pid: 81700|app: 0|req: 1501/2964] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Sep 1 14:29:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 14:29:53.698549 dv-cinder-852211-7-smb devstack@keystone.service[81700]: DEBUG dbcounter [-] [81700] Writing DB stats keystone:SELECT=60 {{(pid=81700) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}